Apache Hop Graduates as a Top-Level Project
Apache Hop graduates as a Top-Level Project at the Apache Software Foundation... Read More
The Hop Orchestration Platform, or Apache Hop, aims to facilitate all aspects of data and metadata orchestration.
Hop is an entirely new open source data integration platform that is easy to use, fast and flexible
Hop aims to be the future of data integration. Visual development enables developers to be more productive than they can be through code. Our Design once, run anywhere workflows and pipelines can be designed in the Hop Gui and run on the Hop native engine (local or remote), or on Spark, Flink, Google Dataflow or AWS EMR through Beam. Lifecycle Management enables developers and administrators to switch between projects, environments and purposes without leaving your train of thought.
Hop is entirely metadata driven. Every object type in Hop describes how data is read, manipulated or written, or how workflows and pipelines need to be orchestrated.
Metadata is what drives Hop internally as well. Hop uses a kernel architecture with a robust engine. Plugins add functionality to the engine through their own metadata.
Hop workflows and pipelines are definitions of how data needs to be processed.
Once designed, a pipeline can be executed on any supported runtime. Hop has built-in support to run pipelines locally and remotely in the native Hop runtime, or on Apache Spark, Apache Flink or Google Dataflow through the Apache Beam runtimes.
Hop workflows and pipelines are developed visually through an intuitive drag and drop interface.
Visual development allows data developers and data engineers to keep focus on the business logic that needs to be implemented, on what needs to be done instead of how it needs to be done.
Managing, testing and deploying workflows and pipelines can be a daunting task.
Developers and engineers can manage the entire project life cycle from the Hop Gui: switch between projects, environments, runtime configurations, manage git versions etc.
Hop is your project!
Hop is an Apache Software Foundation project, available under the Apache v2 license. It’s a complete open community, always listening to proposals and comments.
Sources, mailing lists, issue tracker: it’s fully open, you can access directly.
We also love contributions: don’t hesitate to contribute. You can contribute by editing this page!