Discover / Automation
Apache NiFi
by apacheJava
Automate and manage the flow of data between systems.
Maturity: stable because 12y old, rel/nifi-2.10.0 released 41d ago. Derived from release and commit history, not a rating.
- Stars
- 6.2k
- Forks
- 3.0k
- Downloads / mo
- —
- Last commit
- 2026-08-01
- License
- Apache-2.0
- Open issues
- 32
Market and trust evidence
Edition not yet matchedNo exact skills.sh identity match is available for this repository. Repository adoption and freshness remain visible above; install momentum is not inferred.
Trust analysis is a screening signal, not a security warranty. Read the ranking and trust methodology.
In practice
Written by AI from this repository’s README · high confidenceMoving and transforming data between systems needs prioritization, guaranteed delivery and lineage that scripts do not provide.
Use it when
When you need visually designed dataflows with provenance tracking, clustering and role based access control.
Not the right pick when
Requires Java 21 and a running server, so it is the wrong pick for a lightweight embedded transformation step.
Capabilities
- browser user interface for design, control and monitoring
- configurable prioritization with guaranteed delivery, retry and backoff
- horizontal scaling with clustering
- provenance tracking with searchable history and data lineage
- plugin interface for Processors and Controller Services, including native Python
- single sign on with OpenID Connect or SAML 2
Requirements
- Java 21
- Python 3.10 or higher as an optional dependency
Cost: Free and open source
Video walkthroughs
DFM 2.0 - Apache NiFi Automation with Agentic AI | Explained by Ksolves CTO
Intro to Apache NiFi! Apache NiFi Explained for Beginners!
Third-party YouTube uploads matched to this tool by title, channel and repository name on 2026-08-03. Not made, reviewed or endorsed by SkillPilot. View counts and publish months are as of the match date and the month is approximate. Nothing loads from YouTube until you press play.
What the repository ships
Detected from the actual files in the repository root.
Latest release rel/nifi-2.10.0
Published 2026-06-23
Version 2.10.0 is feature improvement and bug fix release with over 160 issues resolved.
Release Date: June 18th, 2026
New Capabilities
- Registry Clients - Support for branch creation
- Connectors - UI support
Improvements
- Improve leniency of JSON readers and flexibility of JSON Writer
- Partial defragmentation of Content Repository via tail-claim truncation
- Add support for Author+Committer with git-based Flow Registry Clients
- Support parameter value references to parameters from inherited parameter contexts
- Remove Restricted Component Authorization from Framework and remove Restricted Annotation from Components
Bug Fixes
- Cluster coordinator can disconnect a freshly-rejoined node
- If a node is offloaded or load balanced, receive node may prematurely truncate the data
- If an extension stores LOCAL state and then modifies the Map, it could lead to corrupted state
- StandardProcessSession.create() produces FlowFiles with ambiguous Start Lineage Index
New Contributors
- @vishal-firgan-ksolves made their first contribution in https://github.com/apache/nifi/pull/11095
- @0BVer made their first contribution in https://github.com/apache/nifi/pull/11172
- @rakesh-rsky made their first contribution in https://github.com/apache/nifi/pull/11212
- @venkateshwaracholan made their first contribution in https://github.com/apache/nifi/pull/11293
- @arkadiusjonczek made their first contribution in https://github.com/apache/nifi/pull/11321
- @grovem1 made their first contribution in https://github.com/apache/nifi/pull/11311
Full Changelog: https://github.com/apache/nifi/compare/rel/nifi-2.9.0...rel/nifi-2.10.0
Tags
README
<!--
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to You under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
Apache NiFi
<img src="https://nifi.apache.org/images/apache-nifi-logo.svg" width="300" alt="Apache NiFi"/>
Status
Resources
Contacts
Community
Features
Apache NiFi is an easy to use, powerful, and reliable system to process and distribute data.
NiFi automates cybersecurity, observability, event streams, and generative AI data pipelines and distribution
for thousands of companies worldwide across every industry.
- Browser User Interface
- Seamless experience for design, control, and monitoring
- Runtime management and versioned pipelines
- Secure by default with HTTPS
- Scalable Processing
- Configurable prioritization for throughput and latency
- Guaranteed delivery with retry and backoff strategies
- Horizontal scaling with clustering
- Provenance Tracking
- Searchable history with configurable attributes
- Graph data lineage from source to destination
- Metadata and content for each processing decision
- Extensible Design
- Plugin interface for Processors and Controller Services
- Support for Processors in native Python
- REST API for orchestration and monitoring
- Secure Configuration
- Single sign-on with OpenID Connect or SAML 2
- Flexible authorization policies for role-based access
- Encrypted communication with TLS and SFTP
Requirements
NiFi supports modern operating systems and requires recent language versions for developing and running the application.
Platform Requirements
- Java 21
Optional Dependencies
- Python 3.10 or higher
Projects
The source repository includes several component projects.
Please review individual project documentation for additional details.
Getting Started
Project guides provide extensive documentation for installing and extending the application.
Developing
NiFi uses the Maven Wrapper for project development. The Maven Wrapper provides
shell scripts that download and cache a selected version of Apache Maven for running build
commands.
Developing on Microsoft Windows requires using mvnw.cmd instead of mvnw to run Maven commands.
Building
Run the following command to build project modules using parallel execution:
./mvnw install -T1C
Run the following command to build project modules using parallel execution with static analysis to confirm compliance
with code and licensing requirements:
./mvnw install -T1C -P contrib-check
Run the following command to build the application binaries without building other optional modules:
./mvnw install -T1C -am -pl :nifi-assembly
Binaries
The nifi-assembly module contains the binary distribution.
ls nifi-assembly/target/nifi-*-bin.zip
The nifi-assembly module includes the binary distribution in a directory for local development and testing.
cd nifi-assembly/target/nifi-*-bin/nifi-*/
Running
NiFi provides shell scripts for starting and stopping the system.
Running on Microsoft Windows requires using nifi.cmd instead of nifi.sh for system commands.
Starting
Run the following command to start NiFi from the distribution directory:
./bin/nifi.sh start
Accessing
The default configuration generates a random username and password on startup. NiFi writes the generated credentials
to the application log located in logs/nifi-app.log under the NiFi installation directory.
The following command can be used to find the generated credentials on operating systems with grep installed:
grep Generated logs/nifi-app*log
NiFi logs the generated credentials as follows:
Generated Username [USERNAME]
Generated Password [PASSWORD]
The USERNAME will be a random UUID composed of 36 characters. The PASSWORD will be a random string.
The username and password can be replaced with custom credentials using the following command:
./bin/nifi.sh set-single-user-credentials <username> <password>
NiFi defaults to running on the localhost address with HTTPS on port 8443 at the following URL:
https://localhost:8443/nifi
Browsers will display a warning message indicating a potential security risk due to the self-signed certificate
generated during initialization. Production deployments should provision a certificate from a trusted certificate
authority and update the NiFi keystore and truststore configuration.
License
Except as otherwise noted this software is licensed under the
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
https://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
Export Control
This distribution includes cryptographic software. The country in which you
currently reside may have restrictions on the import, possession, use, and/or
re-export to another country, of encryption software. BEFORE using any
encryption software, please check your country's laws, regulations and
policies concerning the import, possession, or use, and re-export of encryption
software, to see if this is permitted. See https://www.wassenaar.org for more
information.
The U.S. Government Department of Commerce, Bureau of Industry and Security
(BIS), has classified this software as Export Commodity Control Number (ECCN)
5D002.C.1, which includes information security software using or performing
cryptographic functions with asymmetric algorithms. The form and manner of this
Apache Software Foundation distribution makes it eligible for export under the
License Exception ENC Technology Software Unrestricted (TSU) exception (see the
BIS Export Administration Regulations, Section 740.13) for both object code and
source code.
The following provides more details on the included cryptographic software:
Apache NiFi uses the following libraries and frameworks for encrypted
communication and storage of sensitive information: