Control center / Discover

Discover

Browse by category instead of drowning in search results. Every category opens a submenu of subcategories with live counts, and checking one narrows the grid to exactly that slice.

Verified against GitHub · scores pending
5 results for “Local Inference” across 1 categories
Sort by:Type:Trust:Maturity:5 shown

LLM Ops & Observability

5

Exo

exo-explore★ 48kToolactive

Run your own AI cluster at home with everyday consumer devices to serve models locally.

Best match because its name, category, capabilities, or owner matches “Local Inference”. Adoption and trust break close ties.

Stars
48k
Downloads
—
Updated
2026-09-28
Skill installs
—
Trust pendingMomentum not matched

LocalAI

mudler★ 49kToolstable

A drop in replacement REST API that is compatible with OpenAI for local LLM inferencing.

Best match because its name, category, capabilities, or owner matches “Local Inference”. Adoption and trust break close ties.

Stars
49k
Downloads
—
Updated
2026-09-28
Skill installs
—
Trust pendingMomentum not matched

Outlines

dottxt-ai★ 16kToolstable

Structured text generation library for large language models.

Best match because its name, category, capabilities, or owner matches “Local Inference”. Adoption and trust break close ties.

Stars
16k
Downloads
—
Updated
2026-09-21
Skill installs
—
Trust pendingMomentum not matched

LMDeploy

InternLM★ 8.1kToolexperimental

A toolkit for compressing deploying and serving large language models locally with high throughput.

Best match because its name, category, capabilities, or owner matches “Local Inference”. Adoption and trust break close ties.

Stars
8.1k
Downloads
—
Updated
2026-09-23
Skill installs
—
Trust pendingMomentum not matched

Mistral.rs

EricLBuehler★ 7.7kToolexperimental

A fast LLM inference engine written in Rust for local model deployment.

Best match because its name, category, capabilities, or owner matches “Local Inference”. Adoption and trust break close ties.

Stars
7.7k
Downloads
—
Updated
2026-09-25
Skill installs
—
Trust pendingMomentum not matched
Discover · SkillPilot