Apache Falcon

Apache Falcon is basically a data management system for Apache Hadoop installations.

It helps developers move around and process data recorded in a Hadoop database.

Developers can create custom routines and then use them for automated or custom data processing tasks.

What is new in this release:

• NEW FEATURES:
• Added SLA for processes.
• Added SLA for Feeds.
• Added hooks for extensions in Audit.
• Added a sample recipe for disaster recovery of hdfs dirs/files.
• Added recipe option in falcon client.
• Added pipleline element to lineage graph.
• Added pipeline element to process entity.
• Baselining designer code.

What is new in version 0.6.1:

• NEW FEATURES:
• Added SLA for processes.
• Added SLA for Feeds.
• Added hooks for extensions in Audit.
• Added a sample recipe for disaster recovery of hdfs dirs/files.
• Added recipe option in falcon client.
• Added pipleline element to lineage graph.
• Added pipeline element to process entity.
• Baselining designer code.

What is new in version 0.6:

• NEW FEATURES:
• Added SLA for processes.
• Added SLA for Feeds.
• Added hooks for extensions in Audit.
• Added a sample recipe for disaster recovery of hdfs dirs/files.
• Added recipe option in falcon client.
• Added pipleline element to lineage graph.
• Added pipeline element to process entity.
• Baselining designer code.

What is new in version 0.5:

• Design Action Interface.
• Design Transformation Interface.
• Pipeline Monitor addition.
• Bootstrap designer module.
• Support updates at specific time.
• Support Lineage information capture.
• Provide REST APIs for discovering lineage metadata over the store.
• Enable SSL for Falcon REST API.

Requirements:

• Apache Hadoop

Limitations:

• The project is still under development in the Apache Incubator repository and might change drastically from version to version.