Llmops Trending Repositories

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

Go7,3961,062Built by

Community maintained hardware plugin for vLLM on Ascend

C++2,6612,068Built by

Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.

Jupyter Notebook3,044523Built by

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Python2,220327Built by