Link to install Ollama: https://ollama.com/download
Link to Ollama latest models library: https://ollama.com/library
Link to download uv package manager: https://docs.astral.sh/uv/getting-started/installation/#standalone-installer
Follow instructions to configure appropriate version for your operating system and use a command below to run the example. (uv needs to be installed just once)
uv run main.py
Use (just an example) to pull your desired model.
ollama pull tinyllama:latest
Change DEFAULT_LLM_MODEL variable value in config/settings.py file.
Example:
DEFAULT_LLM_MODEL = "tinyllama" or DEFAULT_LLM_MODEL = "tinyllama:latest" (if you have multiple models)