

LLM Inference & Serving — Synthszr Charts
This category covers frameworks and engines used to run large language models in production – from inference servers to batching and scheduling layers to optimizations for latency and throughput. It includes projects like vLLM, SGLang and TGI, used to serve models behind APIs or in self-hosted data centers. They're used by teams that need to run models at scale and cost-efficiently, not just train them.
The Synthszr Charts measure momentum for this category from mentions across thousands of news and newsletter sources, recency-weighted and version-granular, so that new releases such as EAGLE 3.1 are tracked individually. The ranking is updated daily, showing which serving solutions are gaining or losing attention.
- 1DeepInferdeepseek · 27× · Nov 01, 2026100
- 2vLLMvllm · 90× · Oct 28, 202673
- 3Clef-flashcloudflare · 17× · Oct 13, 202658
- 4SGLanglmsys · 22× · Nov 15, 202646
- 5MACaQhuawei · 2× · Nov 13, 202645
- 6Workers AIcloudflare · 6× · Nov 06, 202644
- 7DeepInferunknown · 3× · Oct 23, 202628
- 8Modalmodal · 3× · Oct 23, 202619
- 9Mango Inferencemangoboost · 2× · Oct 19, 202618
- 10Computercloudflare · 4× · Oct 27, 202615
- 11TabPFN-3.5prior-labs · 5× · Sep 30, 202613
- 12Mercury 2.5inception · 2× · Oct 21, 202612
- 13NeMo-DCRnvidia · 2× · Oct 09, 202612
- 14Ultrafast modeopenai · 2× · Oct 06, 202610
- 15vLLM-Omnivllm · 4× · Oct 09, 20268
- 16Jevanthropic · 2× · Oct 06, 20268
- 17SubQsubquadratic · 22× · Sep 22, 20268
- 18Crusoe Managed Inferencecrusoe · 4× · Sep 21, 20265
- 19TensorRT-LLMnvidia · 6× · Sep 22, 20265
- 20SIE (Superlinked Inference Engine)superlinked · 2× · Sep 10, 20262
- 21FastH3fastvideo · 2× · Sep 03, 20262
- 22Lightningnvidia · 4× · Aug 13, 20262
- 23Mojomodular · 2× · Aug 24, 20261
- 24Tritonopenai · 2× · Aug 26, 20261
- 25TabFMgoogle · 9× · Jul 27, 20261
- 26Mooncakemoonshot · 2× · Jul 19, 20260
- 27ModelOptnvidia · 2× · Jul 15, 20260
- 28Yansubentoml · 3× · Jun 01, 20260
- 29TGIhugging-face · 2× · Jun 19, 20260
- 30CoreWeave Sandboxescoreweave · 3× · May 24, 20260
- 31Text Generation Inferencehugging-face · 2× · May 28, 20260
- 32Groq Llamagroq · 2× · May 17, 20260
- 33vLLM 0.20.0vllm · 4× · Apr 29, 20260
- 34TokenSpeedlightseeking · 2× · May 12, 20260
- 35Docker Model Runnerdocker · 2× · May 08, 20260
- 36HybridClawhybridai · 2× · Apr 29, 20260
- 37NEAR AI Cloudnear-ai · 7× · Apr 03, 20260
- 38IronClawnear-ai · 7× · Apr 03, 20260
- 39ClawProtencent · 2× · May 04, 20260
- 40HDNA Workbenchunknown · 2× · Apr 15, 20260