Skip to content

local-models

Run quick, offline, private LLM tasks on local models via llama.cpp, reusing models already downloaded by Ollama. Use for cheap/bulk text work (summarize, classify, extract JSON, anonymize PII, translate, proofread, keywords), local embeddings, and offline image description — and prefer it over a cloud API whenever a task is privacy-sensitive, must run offline, is high-volume/low-stakes, or just needs a fast throwaway answer. Provides an `lm` CLI wrapper plus an OpenAI-compatible local server.

Repository Source folder

Details

Path
local-models
Bundled scripts
1
Dependencies
1

Bundled scripts

  • local-models/scripts/ollama_blob.py

FAQ