Control center / Discover

Discover

Browse by category instead of drowning in search results. Every category opens a submenu of subcategories with live counts, and checking one narrows the grid to exactly that slice.

Verified against GitHub · scores pending
5 results for “Local Inference” across 1 categories
Sort by:Type:Trust:Maturity:5 shown

LLM Ops & Observability

5

Exo

exo-explore47kToolstable

Run your own AI cluster at home with everyday consumer devices to serve models locally.

Best match because its name, category, capabilities, or owner matches “Local Inference”. Adoption and trust break close ties.

Stars
47k
Downloads
Updated
2026-06-23
Skill installs
Trust pendingMomentum not matched

LocalAI

mudler48kToolstable

A drop in replacement REST API that is compatible with OpenAI for local LLM inferencing.

Best match because its name, category, capabilities, or owner matches “Local Inference”. Adoption and trust break close ties.

Stars
48k
Downloads
Updated
2026-08-03
Skill installs
Trust pendingMomentum not matched

Outlines

dottxt-ai15kToolstable

Structured text generation library for large language models.

Best match because its name, category, capabilities, or owner matches “Local Inference”. Adoption and trust break close ties.

Stars
15k
Downloads
Updated
2026-08-01
Skill installs
Trust pendingMomentum not matched

LMDeploy

InternLM8.0kToolexperimental

A toolkit for compressing deploying and serving large language models locally with high throughput.

Best match because its name, category, capabilities, or owner matches “Local Inference”. Adoption and trust break close ties.

Stars
8.0k
Downloads
Updated
2026-08-01
Skill installs
Trust pendingMomentum not matched

Mistral.rs

EricLBuehler7.6kToolexperimental

A fast LLM inference engine written in Rust for local model deployment.

Best match because its name, category, capabilities, or owner matches “Local Inference”. Adoption and trust break close ties.

Stars
7.6k
Downloads
Updated
2026-07-29
Skill installs
Trust pendingMomentum not matched
Discover · SkillPilot