Tag: performance

cgroups v2 unified hierarchy explained: read /sys/fs/cgroup/, limit CPU/IO/memory, use systemd slices and PSI pressure files.

runc, crun, and youki all run your containers, but they differ wildly in startup speed, language, and cgroups v2 support. Here's which to pick.

KV cache eats your VRAM at long context, not the weights. Q8/Q4 KV quantization in llama.cpp and vLLM cuts it 2-4x with almost no quality hit.

Dragonfly turns your container registry into a P2P swarm. Stop hammering one registry with 200 nodes pulling 4GB GPU images at once.

Speculative decoding, Gemma 4 MTP, and DeepSeek DSpark all make LLMs 2-6x faster losslessly. How each works, and which to use for local vs. serving.

Your gigabit link drops to 200 Mbps and you don't know why. iperf3 measures throughput honestly, nload visualizes traffic, together they find the bottleneck fast.

Stop trusting marketing IOPS numbers. fio measures what your disk actually does on your workload, sequential, random, mixed. Here's how to read the output honestly.

CUDA vs ROCm for AI on Linux: NVIDIA's easy path, AMD's emotional journey, and why CPU inference isn't dead yet. Real Docker setups included.

Learn how to set Docker resource limits for memory, CPU, swap, and PIDs. Practical guide with real-world sizing examples, OOM killer behavior, and cgroups explained.

io_uring slashes syscall overhead vs epoll and AIO. Covers the submission/completion queue model, liburing examples, security caveats, and when to skip it.

Speed up Ansible playbooks with pipelining, forks, fact caching, and async tasks, stop watching the spinning wheel on every play.

Make Plex actually fast: enable hardware transcoding, fix remote access without relay, tune Docker env vars, and decide if Jellyfin is calling your name.