LOCAL LLM GUIDE

Weight quantization guide

FP16, INT8/Q8, AWQ, GPTQ, and GGUF for local LLMs.

Complete guide

This legacy article remains available for durable links and now points to the main guide covering mechanism, constraints, and calculator use.