SIGs/bigdata/meetings/20131031minutes

<mattf> morning tim

masta mattf misc mjg59 mkolman mkolman_ muep

<tstclair> morning mattf

<mattf> who's here for the big data sig meeting?

* rsquared raises his hand

* orc_emac_ is now known as orc_fedo

* opuk (~kupo@h-1-5.a176.priv.bahnhof.se) has joined #fedora-meeting-1

* besser82 (~besser82@fedora/besser82) has joined #fedora-meeting-1

* gil__ (~quassel@151.60.14.100) has joined #fedora-meeting-1

<gil__> hi

<tstclair> Morning gil__

* mizdebsk (mizdebsk__@nat/redhat/x-qpgqpnidykcdkxrl) has joined #fedora-meeting-1

<tstclair> Morning Folks, I figured I would collect a list of agenda items: 1.) Status 2.) Issues / Blockers 3.) Feel free to add to the list.

<samkottler> tstclair: do we want to use meetbot?

<mattf> samkottler, good idea

<mattf> first meeting hiccups

<tstclair> samkottler, 1st time doing this..

<gil__> tstclair: +1

<samkottler> tstclair: hehe no worries :)

* suehle has quit (Ping timeout: 240 seconds)

<samkottler> tstclair: http://meetbot.debian.net/Manual.html is a good intro

<tstclair> I thought this channel was always recorded according to the docs.

<tstclair> I think we can figure out logistics for next round.

<tstclair> So current question: is https://fedoraproject.org/wiki/SIGs/bigdata/packaging up to date? And are there other items that folks thave been looking into?

* witlessb (~wb@cpc29-lewi15-2-0-cust72.2-4.cable.virginm.net) has joined #fedora-meeting-1

<tstclair> witlessb, <tstclair> So current question: is https://fedoraproject.org/wiki/SIGs/bigdata/packaging up to date? And are there other items that folks thave been looking into?

<mattf> gil__, i added solr to the packaging list when you announced it on the mailing list, fyi

<gil__> ok

<mattf> tstclair, it's up2date wrt what i'm working on

<tstclair> To give a brief synopsis: I've submitted curator and updated tachyon to build against the latest 0.4.0 branch. There were several issues in testing and I have to patches that hack around the issues and opened tickets upstream .

<tstclair> Are there any new developments that are not on the list?

<gil__> ... again some BR from finish to review....

<gil__> https://bugzilla.redhat.com/show_bug.cgi?id=1002154

<tstclair> besser82, witlessb, rsquared, pmackinn any updates / issues ?

<gil__> https://bugzilla.redhat.com/show_bug.cgi?id=1002170

<gil__> https://bugzilla.redhat.com/show_bug.cgi?id=1005904

<rsquared> Developments as in new bits being packaged or updates on existing packages?

<mizdebsk> i'm trying to find time to work on better Ivy integration, which should improve packaging of some applications (Scala stuff and others) </nowiki>

randomuser` rbergeron rdieter robyduck roshi rsquared

<tstclair> rsquared, both.

<besser82> tstclair: actually no issues / updates from me...

<pmackinn> tstclair, nothing here

<witlessb> tstclair: none from me

<tstclair> mizdebsk, I'm sure pmackinn and willb would be interested there.

<mattf> tstclair, did zookeeper get settled?

<rsquared> hadoop 2.2.0 in F20 has a minor issue with the hadoop-common testing jar/pom. It's misnamed. I've got a fix I can spin if it's blocking anyone.

<tstclair> I took ownership, I'm heavily dependent..

* msrb (msrb@nat/redhat/x-sllcvrytyozxcsgd) has joined #fedora-meeting-1

<tstclair> both tachyon and mesos require. </nowiki>

masta mattf misc mizdebsk mjg59 mkolman mkolman_ msrb muep

<tstclair> mattf, ^

<mattf> gotcha

<tstclair> are some of our friends from IBM in the audience?

<rsquared> masta: FYI, guava update coming in rawhide

<mizdebsk> i'll work on guava next week

<gil__> lucene-spatial https://bugzilla.redhat.com/show_bug.cgi?id=1002154

<tstclair> Second Item: Are there any issues folks are blocked on or need assistance with.

<tstclair> ?

<mattf> i'm not blocked

<gil__> lucene-analysis-morfologik https://bugzilla.redhat.com/show_bug.cgi?id=1002170

<tstclair> I'll follow up with willb tomorrow, but I know there were issues with scala and sbt.

<gil__> solr core https://bugzilla.redhat.com/show_bug.cgi?id=1005904

<pmackinn> tstclair, https://bugzilla.redhat.com/show_bug.cgi?id=1010383 to start, fpc exception request filed

<rsquared> hadoop-2.2.0 is currently blocked in rawhide by bz1023116. mizdebsk knows about it and is looking into it

<mattf> gil__, will you add those to the packages in review or to the review tracker?

<gil__> just the 1^

<gil__> ops

<tstclair> I have no blockers.

<tstclair> Item 3: Any new developments in the BIG-DATA ecosystem that are worth watching?

<tstclair> I've seen a lot of new ML coming into the works, no clear leaders.

<gil__> i have only a problem with solr contib module:

<tstclair> A lot of stuff based on Spark 0.8+

<rsquared> HBase has a few dependencies awaiting review and I need to submit the jamon packages as well.

<rsquared> HBase itself is compiling but need eval of test suite

<mattf> at hadoop world this week i had a discussion and the topic of data nucleus came up. turns out it's something the community would like to get rid of.

<gil__> clustering require carrot2-mini-3.8.0 (this one depend with non-free mahout-math-0.6)

<rsquared> pmackinn: I'm sure you're glad to hear that about data nucleus

<pmackinn> i will eagerly follow upstream's lead in this regard

<mattf> ok, i'll give it a few days and see what shakes out

<tstclair> Is jline2 an issue for anyone, I have not dug in there.

<gil__> +1

<mizdebsk> jline stuff should be no problem, there is either 1.x or 2.x to choose from

<rsquared> I'm not sure how much jline is used in hadoop, but I am expecting jline 2 to cause a problem. Unsure if I'll need to rely on the compat package

<tstclair> mizdebsk, for now... I thought that there was the intention of deprecating.

<rsquared> tstclair: There's also netty and guava changes coming

<rsquared> I expect both to be an issue for hadoop

<mizdebsk> ideally, yes, i can't say much, but i've ported 2 packages to jline 2.10 and this was just a simple namespace change

<tstclair> do we need compat packages?

<gil__> netty breaks some thing also on gradle

<mizdebsk> for guava, i'll investigate

<mizdebsk> netty already has a compat package (netty31), netty will be updated to 4.x

<tstclair> rsquared, ^

<gil__> for gradle netty31 is unusable

<rsquared> The maintainer of netty said he doesn't plan to maintain a compat package

<mizdebsk> rsquared: i am maintainer of netty and there already is a compat package

<tstclair> well don't they usually hang on until the deps transition?

<gil__> littleproxy is the library which caause the problem with gradle/netty

<rsquared> mizdebsk: who is Jon VanAlten then? He sent the e-mails about the new netty and said he didn't plan to maintain a compat version

<mizdebsk> tstclair: of course, for reasonable time, but i cannot wait for months

<mizdebsk> rsquared: he is a comaintainer

<rsquared> hadoop uses the current netty (3.6). Not sure if 3.1 will work. Is there need/plan for a netty 3.6 compat package?

<gil__> newer littleproxy required some libraries wich dont work and dont compile under java7

<tstclair> mizdebsk, what is a reasonable time?

<gil__> https://github.com/barchart/barchart-udt/

<mizdebsk> tstclair: depends on the case, if i can see there are difficulties and there is some progress, i can wait

<gil__> Java wrapper for native C++ UDT protocol require also for build native libraries

<mizdebsk> otherwise i'm updating; maintainers of dependant packages can always fork the old version and convert it to compat package

<gil__> org.codeswarm:maven-nar-plugin:20121119 which is not compatible with our surefire version

<rsquared> gil__: Is gradle planning to be dropped?

* aeperezt (~aeperezt@fedora/aeperezt) has joined #fedora-meeting-1

<gil__> yes

<gil__> rsquared: there are too many problems with gradle at the moment

<gil__> asm conflict

<gil__> newer eclipse aether apis

<rsquared> mizdebsk: What's the typical timeline line for updates like these? If a package breaks in rawhide because of a dep update is there a problem so long as it's fixed by next release cycle?

<gil__> please mizdebsk,remember if i've forgotten something...

<mizdebsk> rsquared: according to the policy, announce 1 week in advance and then you can update

<mizdebsk> (that's why i wait with guava for next week)

<rsquared> mizdebsk: What about the packages that are broken by the update? What is there time line like?

<mizdebsk> rsquared: that is up to maintainers of dependant packages

<mizdebsk> sometimes they are not fixed for multiple releases

<gil__> http://pastebin.com/xqed2aWv barchart-udt java7 problems

* cwawak (~cwawak@redhat/cwawak) has left #fedora-meeting-1 ("Textual IRC Client: www.textualapp.com")

<mizdebsk> gil__: these gradle problems you mentioned are IMO minor

* fabian_a has quit (Read error: Operation timed out)

<masta> rsquared: huh?

<mizdebsk> the biggest 2 problems are version incompatibility and problems with bootstrapping

<mattf> masta, tab-completion fail

* masta guesses that was a tab-completion thing

<masta> =)

<tstclair> Another question which I've not been paying too much attention to, is there going to be a transition to 1.8 in the mid/near term?

<gil__> ah ok is for import latest littleproxy release with netty 4.x support(gradle)

<tstclair> Are there other items folks wanted to discuss...? gil__, mattf, mizdebsk, pmackinn, rsquared , besser82 ?

<mizdebsk> not really

<mattf> let's use the meeting bot next time

<mattf> that's it from me

<tstclair> +1

<pmackinn> no

<gil__> +1

* tim_1 (~chatzilla@c122-106-60-81.rivrw1.nsw.optusnet.com.au) has joined #fedora-meeting-1

<rsquared> I've got nothing more

<tstclair> kalev, I will try to summarize some of the items and I have a few open questions and I will email the list.

<tstclair> Thanks everyone!