Ollama is a tool that downloads and runs language models on your own machine or server, with a local HTTP API. It simplifies installation, model management, and launching on CPU or GPU, and suits development and simple use cases.
Example
ollama run llama3.2