Tagged “getting-started”
-
Understanding GGUF and Quantization Levels
What GGUF is, how to read quantization labels like Q4_K_M, and how to choose a quant that balances quality and memory for your hardware.
-
How Much VRAM and RAM Do You Actually Need to Run an LLM?
A practical guide to sizing local LLMs: how to estimate VRAM and RAM from parameters and quantization, plus what happens when a model doesn't fit.
-
Run Your First Local LLM with Ollama
A hands-on getting-started guide to running an open-weight LLM locally with Ollama — install, pull a model, chat, and call the local API.