AI - Shortwaves

Sign in Subscribe

AI

A collection of 3 posts

Self-Host Models With vLLM

Self-Host Models With vLLM

vLLm is the best way to run LLMs locally by offering a memory efficient framework, while basing the model repository on the industry standard HuggingFace. This guide explains how to set up vLLM, download Mistral Small, and inference directly on your server.

Self-Hosting Text Generation Models

Self-Hosting Text Generation Models

Ollama makes it easier to run LLMs locally by offering a framework with pre-quantized open-source models, eliminating the need for in-depth knowledge of tools such as git or transformers. This guide explains how to set up Ollama, download Mistral NeMo, and inference directly on your device.

How To Train AI Classification Models

How To Train AI Classification Models

A Text Classification model is an AI-based model trained to categorize or classify text into predefined categories or classes. It learns from a labeled dataset where each text sample is associated with a specific category. The model analyzes a string's patterns, features, and relationships to classify new or