Ollama

Run large language models locally with ease. Supports Llama 3, Mistral, and many other open-source models with simple setup.