Apache Pig
Summary
Apache Pig is a data analysis tool built on top of Apache Hadoop.
Owner
- Name: Peter MacKinnon
- Email: pmackinn@redhat.com
- Release notes owner:
Current status
- Targeted release: Fedora 21
- Last updated: 26 March 2014
- Tracker bug: <will be assigned by the Wrangler>
Detailed Description
Apache Pig is a platform for analysing large data sets that consists of a high-level language for expressing data analysis programs, coupled with infrastructure for evaluating these programs. The salient property of Pig programs is that their structure is amenable to substantial parallelization, which in turns enables them to handle very large data sets.
Benefit to Fedora
Apache Pig is a data analysis tool used by many parts of the Hadoop ecosystem. Including it in Fedora increases usefulness of the Apache Hadoop package that is already in Fedora.
Scope
- Proposal owners: The Pig package has been accepted into Fedora and provides all the functionality from the upstream release with the exception of jython (version) and parquet (unpackaged) support.
- Other developers: N/A (not a System Wide Change)
- Release engineering: N/A (not a System Wide Change)
- Policies and guidelines: N/A (not a System Wide Change)
Upgrade/compatibility impact
N/A (not a System Wide Change)
How To Test
An upstream quickstart guide is available here which describes setup and simple examples.
User Experience
Users should be able to write and run applications that use Apache Hive for executing queries on large data sets stored in Hadoop.
Dependencies
N/A (not a System Wide Change)
Contingency Plan
- Contingency mechanism: N/A (not a System Wide Change)
- Contingency deadline: N/A (not a System Wide Change)
- Blocks release? N/A (not a System Wide Change)
- Blocks product? N/A
Documentation
N/A (not a System Wide Change)
Release Notes
Fedora 21 includes Apache Pig, the Hadoop data analysis tool.