Loading AI Models...

5,000+ Models
15+ Formats
100+ Publishers
GGUF Discovery

Professional AI Model Repository

GGUF Discovery

Professional AI Model Repository

Loading...
Total Models
Loading...
Last Updated
โŒ˜K
GGUF Loader ๐Ÿ”‹

Local AI Zone

Direct access to AI models for running large language models locally. Updated daily with direct download links, no registration required. Compatible with llama.cpp, GGUF Loader, LM Studio, Ollama, KoboldCpp, and other local LLM tools.

Need Help?

Get Started with Local AI

Choose your preferred platform to run GGUF models locally

๐Ÿ’ก Example Project: A Local AI Agent

A complete open-source reference implementation. If you want to build an agent on local models, study how this one is wired together.

REFERENCE PROJECTOpen Source ยท MIT

โš–๏ธ Lawyer Assistant โ€” A RAG Agent for Legal Documents

A reference project showing a complete retrieval-augmented generation pipeline: it indexes contracts into a local vector store, retrieves relevant passages for a query, and answers with citations. It uses BGE-M3 for embeddings, ChromaDB as the vector store, and Ollama for local LLM inference. Everything runs on-device; the source is MIT-licensed.

Patterns you can study in the source:

  • RAG pipeline โ€” full ingest โ†’ index โ†’ retrieve โ†’ generate flow
  • Multi-model orchestration โ€” embeddings, rerankers & LLM working as separate services
  • Agent loop โ€” query routing, tool calls, and iterative retrieval
  • Hybrid retrieval โ€” BM25 keyword + semantic vector search combined
  • Grounding & citations โ€” answers link back to exact page & paragraph numbers
  • Streaming responses โ€” REST + SSE (Server-Sent Events) output
BGE-M3 Embeddings ChromaDB Vector Store Ollama (Llama ยท Mistral ยท Gemma) BM25 Keyword Search OCR Document Parsing

Refine Your Search

Loading models...
Loading premium models...