Home
Softono

LLM Tools & Chat UIs Software & Alternatives

Local LLM runners, AI chat interfaces and model management (Ollama, Open WebUI).

Ollama

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

173.7K stars open source
LLM Tools & Chat UIs

Open-WebUI

User-friendly AI Interface, supports Ollama, OpenAI API.

140.8K stars open source
LLM Tools & Chat UIs

NextChat

NextChat is a lightweight and fast AI assistant designed for seamless interaction across Web, iOS, macOS, Android, Linux, and Windows platforms. It supports integration with major... Read More

88.2K stars open source
AI Agents LLM Tools & Chat UIs

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

82.3K stars open source
AI & Machine Learning LLM Tools & Chat UIs

LobeHub

Modern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking.

78.4K stars open source
LLM Tools & Chat UIs

Prompt-Engineering-Guide

🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.

75.4K stars open source
LLM Tools & Chat UIs Education & Learning

LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

72K stars open source
LLM Tools & Chat UIs ML Frameworks

gpt4free

gpt4free is a community-driven project designed to provide free and flexible access to numerous large language models and media-generation capabilities without requiring paid API s... Read More

66.3K stars open source
LLM Tools & Chat UIs Live Chat & Chatbots

unsloth

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.

66.1K stars open source
LLM Tools & Chat UIs ML Frameworks

AnythingLLM

All-in-one desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.

61.3K stars open source
LLM Tools & Chat UIs Knowledge Bases & RAG

Flowise

Build AI Agents, Visually

53.4K stars open source
AI Agents LLM Tools & Chat UIs

litellm

LiteLLM is an open-source AI gateway and Python SDK designed to simplify interactions with over 100 large language model providers including OpenAI, Anthropic, Google Vertex AI, Am... Read More

49.8K stars open source
API Tools LLM Tools & Chat UIs

cherry-studio

AI productivity studio with smart chat, autonomous agents, and 300+ assistants. Unified access to frontier LLMs

47.1K stars open source
AI Agents LLM Tools & Chat UIs

LocalAI

Run your AI models locally and generate images and audio (alternative to OpenAI and Claude).

46.7K stars open source
Video Editing LLM Tools & Chat UIs

CowAgent

Open-source super AI assistant & Agent Harness. Plans tasks, runs tools and skills, self-evolves with memory and knowledge. Multi-model, multi-channel. Lightweight, extensible, one... Read More

45.2K stars open source
AI Agents LLM Tools & Chat UIs

janhq/jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

43K stars open source
AI & Machine Learning LLM Tools & Chat UIs

gradio

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

42.9K stars open source
AI & Machine Learning LLM Tools & Chat UIs

BettaFish

微舆:人人可用的多Agent舆情分析助手,打破信息茧房,还原舆情原貌,预测未来走向,辅助决策!从0实现,不依赖任何框架。

41.3K stars open source
AI Agents LLM Tools & Chat UIs

chatbox

Powerful AI Client

40.4K stars open source
Code Editors & IDEs LLM Tools & Chat UIs

ChatTTS

A generative speech model for daily dialogue.

39.4K stars open source
Audio Editing & DAW LLM Tools & Chat UIs

quivr

Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama.... Read More

39.2K stars open source
LLM Tools & Chat UIs Knowledge Bases & RAG

LibreChat

Enhanced ChatGPT-compatible AI chat interface supporting multiple AI providers, with multi-user auth, message search, and plugin support.

38.7K stars open source
AI & Machine Learning LLM Tools & Chat UIs

Langchain-Chatchat

LangChain-Chatchat formerly known as Langchain-ChatGLM is an open-source application for Retrieval-Augmented Generation and Agent workflows built on the LangChain framework. It ena... Read More

38.1K stars open source
LLM Tools & Chat UIs Knowledge Bases & RAG

About LLM Tools & Chat UIs Software

Best open source LLM tool and Ollama alternatives.