Run models locally
Pull and run your first model
Download a small quantized model, start an interactive session, and confirm which artifact is stored locally.
Start with a small model so the first experiment works on modest hardware.
This course uses Gemma 3 1B:
ollama run gemma3:1bThe first run downloads an approximately 815 MB Q4_K_M artifact. Later runs use the local copy.
At the prompt, enter:
Explain what a model weight is in two sentences.Leave the chat with:
/byeList stored models:
ollama listThe 1B model is useful for checking the complete pipeline. Do not use its successful installation as evidence that it can handle every application task. We will evaluate quality separately.
If your machine has more memory, you can later compare a larger model using the same evaluation examples.
Lesson completed