- Llama models - llama serve with
OLLAMA_HOST=127.0.0.1:11434 OLLAMA_MODELS=~/.ollama/models/ OLLAMA_KEEP_ALIVE=15m ollama serve
- ChromaDB: VectorDB - chroma cli command
chroma run --port 9999 --path ./chroma_db
- AWS s3 (localstack) run via localstack CLI
- AWS dynamo (localstack)
localstack start