Control center / Discover
Browse by category instead of drowning in search results. Every category opens a submenu of subcategories with live counts, and checking one narrows the grid to exactly that slice.
Portable writing skill that removes common AI-generated patterns while preserving meaning and voice.
Best match because its name, category, capabilities, or owner matches “serving”. Adoption and trust break close ties.
Fast serving framework for LLMs with radix attention based prefix caching for lower cost.
Best match because its name, category, capabilities, or owner matches “serving”. Adoption and trust break close ties.
High throughput and memory efficient inference and serving engine for large language models.
Best match because its name, category, capabilities, or owner matches “serving”. Adoption and trust break close ties.
Framework for serving thousands of fine tuned LLM adapters on shared GPU infrastructure.
Best match because its name, category, capabilities, or owner matches “serving”. Adoption and trust break close ties.
Platform for running and deploying open source LLMs cost effectively in production.
Best match because its name, category, capabilities, or owner matches “serving”. Adoption and trust break close ties.
Platform for training, serving and evaluating multiple open LLMs with routing capabilities.
Best match because its name, category, capabilities, or owner matches “serving”. Adoption and trust break close ties.
Production ready inference server for LLMs optimized for throughput and cost efficiency.
Best match because its name, category, capabilities, or owner matches “serving”. Adoption and trust break close ties.
KV cache management layer that speeds up LLM serving by reusing cached context.
Best match because its name, category, capabilities, or owner matches “serving”. Adoption and trust break close ties.
Framework for serving and routing queries between strong and weak LLMs to slash costs by 85%.
Best match because its name, category, capabilities, or owner matches “serving”. Adoption and trust break close ties.
A toolkit for compressing deploying and serving large language models locally with high throughput.
Best match because its name, category, capabilities, or owner matches “serving”. Adoption and trust break close ties.
Fast inference server for serving text embedding models in production.
Best match because its name, category, capabilities, or owner matches “serving”. Adoption and trust break close ties.