Tag: ollama

Ollama Model Management: Beyond ollama run

You know how to pull and run a model. Now learn Modelfiles, GPU layer tuning, the REST API, running multiple models without OOM-killing your server, and actually useful system prompts.

The Embedding Model Choice Nobody Explains

Most people use OpenAI's embeddings because it's easy. But local embeddings exist. How to pick and when it actually matters.

GPU Memory Math: Will This Model Actually Fit?

Before you download a 70B model, calculate if it fits. The formulas, the gotchas, and a quick calculator you can actually use.

Running Gemma 4 Locally with Ollama

Google's Gemma 4 is the best open model they've shipped yet. Here's how to pull it, run it, and actually use it for real work with Ollama on your own hardware.

LLM Backends: vLLM vs llama.cpp vs Ollama

vLLM, llama.cpp, and Ollama all run local LLMs — compare throughput, memory use, GPU support, and which fits your hardware.

Running Multiple Ollama Models Without Running Out of RAM

Ollama can load one model at a time on limited hardware. How to switch between models, use CPU offloading, and manage VRAM intelligently.

Ollama Memory Management: Why Models Keep Loading

Why your GPU fills up with Ollama. How to inspect VRAM, tune keep-alive, force-unload models with a single request, and stop the reload pain in 2026.

n8n + LLM: Building Automations That Actually Think

Connect n8n to Ollama or any local LLM to build smart automations that classify, summarize, and triage — not just shuffle data around blindly.

Ollama Beyond the Basics: Model Management, Custom Models, and Optimization

Master Ollama with Modelfiles, GPU tuning, API usage, and performance tricks. Stop running 70B models on 8GB VRAM and wondering why everything is slow.

Key Parameters of Large Language Models

Temperature, top-p, top-k, context length — LLM inference parameters explained so you stop guessing why the model gives weird output.

Large Language Model Formats and Quantization

GGUF, GGML, AWQ, GPTQ — LLM file formats and quantization levels explained: trade-offs between model quality, size, and inference speed.

Exploring the Diverse World of LLM Models

LLaMA, Mistral, Falcon, GPT — the LLM landscape is crowded. Compare model families, sizes, licensing, and what each is actually good for.