Shimmy
Open source
Apache-2.0
Rust
5.4K
Stars
508
Forks
11
Issues
39
Watchers
2 months
Last Commit
About Shimmy
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Need Help Installing Shimmy?
We provide expert installation service for this software. Our team will install, configure, and secure Shimmy on your server. plans start at just $30.
Alternatives to Shimmy
View AllMistral.rs
Fast, flexible LLM inference
7.3K
Deepreasoning
A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.
5.4K
Api For Open Llm
Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源
2.5K
Published by
michael-a-kuykendall