llamacpp

Private & local AI personal knowledge management app for high entropy people.

Text-To-Speech, RAG, and LLMs. All local!

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.

A simple "Be My Eyes" web app with a llama.cpp/llava backend

A simple NPM interface for seamlessly interacting with 36 Large Language Model (LLM) providers, including OpenAI, Anthropic, Google Gemini, Cohere, Hugging Face Inference, NVIDIA AI, Mistral AI, AI21 Studio, LLaMA.CPP, and Ollama, and hundreds of models.

User friendly GUI for configuring and launching llama.cpp

Open source, local first AI medical agent for desktop and web.

一個基於 llama.cpp 的分佈式 LLM 推理程式，讓您能夠利用區域網路內的多台電腦協同進行大型語言模型的分佈式推理，使用 Electron 的製作跨平台桌面應用程式操作 UI。

Byte-Vision is a privacy-first document intelligence platform that transforms static documents into an interactive, searchable knowledge base. Built on Elasticsearch with RAG (Retrieval-Augmented Generation) capabilities, it offers document parsing, OCR processing, and a modern UI.

Local Llama.cpp + opencode for development

llama.cpp gguf file parser for javascript

"Pacha" TUI (Text User Interface) is a JavaScript application that utilizes the "blessed" library. It serves as a frontend for llama.cpp and provides a convenient and straightforward way to perform inference using local language models.

A web-based memory usage and performance calculator for Huggingface GGUF models

Download and run local LLMs within your browser

A frontend for large language models like 🐨 Koala or 🦙 Vicuna running on CPU with llama.cpp, using the API server library provided by llama-cpp-python. NOTE: I had to discontinue this project because its maintenance takes more time than I can and want to invest. Feel free to fork :)

Refactor your code with local LLM in VSCode

WildReality Dreamengine, a new gen opensource LLM powered web roleplay engine.

sddao v1: a P2P chat over TON, libp2p (supporting local LLM), available as a binary file.