Flyte

What's Changed

• Add ArtifactService.ListArtifactNames (distinct names with version counts) by @kumare3 in https://github.com/flyteorg/flyte/pull/7748

Full Changelog: https://github.com/flyteorg/flyte/compare/v2.0.34...v2.0.35

[!IMPORTANT]

## Flyte 2 Devbox is now available!

Check out the guide here to get started.

Looking for Flyte 1? Go to the master branch, where Flyte 1 is now maintained.

---

Flyte 2

Reliably orchestrate ML pipelines, models, and agents at scale — in pure Python.

Version

Python

License

Try in Browser

Docs

SDK Reference

CLI Reference

Flyte is a Graduated project of the LF AI & Data Foundation.

<a href="https://lfaidata.foundation/projects/flyte/">

<img src="https://raw.githubusercontent.com/flyteorg/static-resources/main/flyte/readme/flyte_and_lf.png" alt="Flyte and LF AI & Data Logo" width="250">

</a>

Install

uv pip install flyte

For the full SDK and development tools, see the flyte-sdk repository.

Example

import asyncio
import flyte

env = flyte.TaskEnvironment(
    name="hello_world",
    image=flyte.Image.from_debian_base(python_version=(3, 12)),
)

@env.task
def calculate(x: int) -> int:
    return x * 2 + 5

@env.task
async def main(numbers: list[int]) -> float:
    results = await asyncio.gather(*[
        calculate.aio(num) for num in numbers
    ])
    return sum(results) / len(results)

if __name__ == "__main__":
    flyte.init()
    run = flyte.run(main, numbers=list(range(10)))
    print(f"Result: {run.result}")

<table>

<tr><td><b>Python</b></td><td><b>Flyte CLI</b></td></tr>

<tr>

<td>

python hello.py

</td>

<td>

flyte run hello.py main --numbers '[1,2,3]'

</td>

</tr>

</table>

Serve a Model

# serving.py
from fastapi import FastAPI
import flyte
from flyte.app.extras import FastAPIAppEnvironment

app = FastAPI()
env = FastAPIAppEnvironment(
    name="my-model",
    app=app,
    image=flyte.Image.from_debian_base(python_version=(3, 12)).with_pip_packages(
        "fastapi", "uvicorn"
    ),
)

@app.get("/predict")
async def predict(x: float) -> dict:
    return {"result": x * 2 + 5}

if __name__ == "__main__":
    flyte.init_from_config()
    flyte.serve(env)

<table>

<tr><td><b>Python</b></td><td><b>Flyte CLI</b></td></tr>

<tr>

<td>

python serving.py

</td>

<td>

flyte serve serving.py env

</td>

</tr>

</table>

Local Development Experience

Install the TUI for a rich local development experience:

uv pip install flyte[tui]

Watch the local development experience

Try the hosted demo in your browser — no installation required.

Open Source Backend

The open source backend for Flyte 2 is coming soon. This repository will contain the Kubernetes-native backend infrastructure for deploying Flyte 2 as a distributed, multi-node service. See the Backend README for the current state of the backend, protocol buffer definitions, and contribution guide.

If you need an enterprise-ready, production-grade backend for Flyte 2 today, it is available on Union.ai.

Learn More

• Live Demo — Try Flyte 2 in your browser
• Documentation — Get started running locally
• SDK Reference — API reference docs
• CLI Reference — CLI docs
• flyte-sdk — The Flyte 2 Python SDK repository
• Join the Flyte 2 Production Preview — Get early access
• Slack | GitHub Discussions | Issues

Contributing

We welcome contributions! See the Backend README for backend development, or join us on slack.flyte.org.

Sponsors

CI container image builds for this repository are sponsored by Depot — fast, native multi-arch Docker builds with persistent layer caching.

Built with Depot

License

Apache 2.0 — see LICENSE.