Latest revision as of 10:18, 25 October 2014

Apache Pig

Summary

Apache Pig is a data analysis tool built on top of Apache Hadoop.

Owner

Name: Peter MacKinnon
Email: pmackinn@redhat.com
Release notes owner: Simon Clark (sclark)

Current status

Targeted release: Fedora 21
Last updated: 26 March 2014
Tracker bug: #1089198

Detailed Description

Apache Pig is a platform for analysing large data sets that consists of a high-level language for expressing data analysis programs, coupled with infrastructure for evaluating these programs. The salient property of Pig programs is that their structure is amenable to substantial parallelization, which in turns enables them to handle very large data sets.

Benefit to Fedora

Apache Pig is a data analysis tool used by many parts of the Hadoop ecosystem. Including it in Fedora increases usefulness of the Apache Hadoop package that is already in Fedora.

Scope

Proposal owners: The Pig package has been accepted into Fedora and provides all the functionality from the upstream release with the exception of jython (version) and parquet (unpackaged) support.
Other developers: N/A (not a System Wide Change)
Release engineering: N/A (not a System Wide Change)
Policies and guidelines: N/A (not a System Wide Change)

Upgrade/compatibility impact

N/A (not a System Wide Change)

How To Test

An upstream quickstart guide is available here which describes setup and simple examples.

User Experience

Users should be able to write and run applications that use Apache Pig for analysis of large data sets stored in Hadoop.

Dependencies

Apache HBase

Contingency Plan

Contingency mechanism: N/A (not a System Wide Change)
Contingency deadline: N/A (not a System Wide Change)
Blocks release? N/A (not a System Wide Change)
Blocks product? N/A

Documentation