From Fedora Project Wiki

< SIGs‎ | bigdata‎ | packaging

Line 34: Line 34:
  |-
  |-
  | scalaz
  | scalaz
  | preliminary package done
  | [https://bugzilla.redhat.com/show_bug.cgi?id=1055809 waiting for review]
  |
  |
  | willb
  | willb
  | dependency of lift-json; see willb's github for preliminary package.  Will be submitted for review once sbt is available
  | dependency of lift-json
  |-
  |-
  | metrics
  | metrics
  | [https://bugzilla.redhat.com/show_bug.cgi?id=861502 available]
  | [https://bugzilla.redhat.com/show_bug.cgi?id=861502 available in F20]
  |  
  |  
  | gil
  | gil
  | Coda Hale's metrics (Java/Maven build).
  | Coda Hale's metrics (Java/Maven build).
  |-}
  |-}

Revision as of 20:36, 24 January 2014

Spark packaging

Background

See Scala packaging for details on Fedora support for the Scala toolchain; briefly, we have version 2.10.3 of Scala in F19, F20, and Rawhide and are currently (late 2013) working to get sbt 0.13.1 in Fedora as well.

There is no official release of Spark that works with Scala 2.10.3 (or SBT 0.13.x), but the upstream Spark project maintains a branch (tracking master pretty closely) that works with Scala 2.10. I believe the current plan from upstream is to officially support Scala 2.10 in the Spark 0.9 timeframe (early 2014).

Current Status

With some light Fedora-specific patching, we are able to build and run the Scala 2.10 branch of Spark locally in Fedora against our SBT and Scala. Once SBT is available, other things should follow pretty quickly. Detailed dependency information is below.

Dependencies

Spark requires Scala and SBT in order to build. (Note that there is a Maven build option as well, but it requires artifacts that need to be built with SBT.)

The easiest and most up-to-date place to see the dependency list is in the Spark repository itself, but here we will call out some notable dependencies that aren't already in Fedora:

Dependencies
Project State Review BZ Packager Notes
lift-json waiting on sbt availability willb
akka waiting on sbt availability willb
scalaz waiting for review willb dependency of lift-json
metrics available in F20 gil Coda Hale's metrics (Java/Maven build).