Ollama enables the download of open-source large language models directly to your computer, so sensitive data does not leave your infrastructure.
Ollama supports a wide range of large language models including general-purpose models like Llama 2, Yi, Orca2, yarn-llama2, specialized models like Code Llama for programming, and various sizes like Llama 2 7B, 13B, and 70B.
Its available natively for Mac or download with Docker, and with a Web UI and REST API support, it’s an amazing framework for developing Generative AI applications.
Learn more at https://ollama.ai
REST API support – https://python.langchain.com/docs/integrations/llms/ollama
Chat GPT style web UI – https://github.com/ollama-webui/ollama-webui
