From Fedora Project Wiki
 
(22 intermediate revisions by 2 users not shown)
Line 2: Line 2:


== Summary ==
== Summary ==
Update Erlang/OTP to version 18.2.x, and improve Erlang support in Fedora.
Update Erlang/OTP to version 18, and improve Erlang support in Fedora.


== Owner ==
== Owner ==
* Name: [[User:Peter|Peter Lemenkov]], [[SIGs/Erlang|Fedora Erlang SIG]], [[User:rbarlow|Randy Barlow]], [[User:jcline|Jeremy Cline]]
* Name: [[User:Peter|Peter Lemenkov]], [[SIGs/Erlang|Fedora Erlang SIG]], [[User:rbarlow|Randy Barlow]], [[User:jcline|Jeremy Cline]]
* Email: lemenkov@gmail.com, erlang@lists.fedoraproject.org, rbarlow@fedoraproject.org, jcline@fedoraproject.org
* Email: lemenkov@gmail.com, erlang@lists.fedoraproject.org, rbarlow@fedoraproject.org, jcline@fedoraproject.org
* Release notes owner: <!--- To be assigned by docs team [[User:FASAccountName| Release notes owner name]] <email address> -->
* Release notes owner: <!--- To be assigned by docs team [[User:FASAccountName| Release notes owner name]] <email address> -->[mailto:sclark@fedoraproject.org Simon Clark] ([[User:sclark|sclark]])
<!--- UNCOMMENT only for Changes with assigned Shepherd (by FESCo)
<!--- UNCOMMENT only for Changes with assigned Shepherd (by FESCo)
* FESCo shepherd: [[User:FASAccountName| Shehperd name]] <email address>
* FESCo shepherd: [[User:FASAccountName| Shehperd name]] <email address>
Line 34: Line 34:
* A lot of scalability and performance improvements.
* A lot of scalability and performance improvements.
* Even better Ellyptic Curve Crypto support.
* Even better Ellyptic Curve Crypto support.
* Initial support for IPv6 Erlang clustering. See these GitHub pull requests - [https://github.com/erlang/otp/pull/602 #1] and [https://github.com/erlang/otp/pull/864 #2].
* Initial support for IPv6 Erlang clustering. See these GitHub pull requests - [https://github.com/erlang/otp/pull/602 #602] and [https://github.com/erlang/otp/pull/864 #864].
* New language feature - [http://www.erlang.org/doc/man/maps.html maps].
* New language feature - [http://www.erlang.org/doc/man/maps.html maps].
* Better, production-ready [https://www.it.uu.se/research/group/hipe/index.shtml HiPE] support.
* Better, production-ready [https://www.it.uu.se/research/group/hipe/index.shtml HiPE] support.
Line 59: Line 59:
** <s>[https://bugzilla.redhat.com/1221824 Upgrade Erlang to the latest version (18.2.2)].</s> Done!
** <s>[https://bugzilla.redhat.com/1221824 Upgrade Erlang to the latest version (18.2.2)].</s> Done!
*** <s>Fix [https://bugzilla.redhat.com/1240487 failures on i686 achitecture].</s> Done!
*** <s>Fix [https://bugzilla.redhat.com/1240487 failures on i686 achitecture].</s> Done!
** <s>We must rebuild every package which requires NIF or Driver version (listed below in the [[#Dependencies|Dependencies]] section) against Erlang 18.2.x.</s> Almost done (except Ejabberd we're going to upgrade soon).
** <s>We must rebuild every package which requires NIF or Driver version (listed below in the [[#Dependencies|Dependencies]] section) against Erlang 18.2.x.</s> Done!
** Every Erlang daemon's systemd unit must require epmd.socket.
** Every Erlang daemon's systemd unit must require epmd.socket.
** Allow EPMD implementation switching - Erlang is about choice!
** Allow EPMD implementation switching - Erlang is about choice!
Line 65: Line 65:
*** We have to fill new review request for [https://github.com/travelping/lager_journald_backend erlang-lager_journald_backend]
*** We have to fill new review request for [https://github.com/travelping/lager_journald_backend erlang-lager_journald_backend]
** Add another default directory to look for Erlang *.beam files.
** Add another default directory to look for Erlang *.beam files.
** Every Erlang package must require erlang-rpm-macros.
** <s>Every Erlang package must require erlang-rebar (or erlang-rpm-macros directly)</s>. Done.
** Upgrade outdated packages:
** Upgrade outdated packages:
*** {{package|ejabberd|Ejabberd}}
*** <s>{{{package|ejabberd|Ejabberd}}</s> Done!
**** We'd better to package all the bundled libraries {{package|ejabberd|Ejabberd}} requires. [https://bugzilla.redhat.com/show_bug.cgi?id=1204119 This bug] has all of the needed review requests marked as blockers.
**** <s>We'd better to package all the bundled libraries {{package|ejabberd|Ejabberd}} requires. [https://bugzilla.redhat.com/show_bug.cgi?id=1204119 This bug] has all of the needed review requests marked as blockers.</s> Done!
*** {{package|riak|Riak}}
*** {{package|riak|Riak}}
**** {{package|riak|Riak}} has growing Bugzilla backlog, and badly outdated. We have to address all of these issues and package some additional libraries required by new {{package|riak|Riak}} version.
**** {{package|riak|Riak}} has growing Bugzilla backlog, and badly outdated. We have to address all of these issues and package some additional libraries required by new {{package|riak|Riak}} version. Unfortunately it has been retired. We'll re-add it later.
*** <s>{{package|wings|Wings3D}}</s> Done!
*** <s>{{package|wings|Wings3D}}</s> Done!
* Other developers: N/A
* Other developers: N/A
Line 87: Line 87:
| '''Name''' || '''Tested'''
| '''Name''' || '''Tested'''
|-
|-
| {{package|couchdb}}  || {{no}}
| {{package|couchdb}}  || {{yes}}
|-
|-
| {{package|ejabberd}} || {{no}}
| {{package|ejabberd}} || {{yes}}
|-
|-
| {{package|mochiweb}} || {{no}}
| {{package|mochiweb}} || {{yes}}
|-
|-
| {{package|rabbitmq-server}} || {{yes}}
| {{package|rabbitmq-server}} || {{yes}}
|-
|-
| {{package|riak}} || {{no}} (broken currently :( )
| {{package|riak}} || {{no}} (package was retired :( )
|-
|-
| {{package|wings}} || {{no}}
| {{package|wings}} || {{yes}}
|}
|}


Line 115: Line 115:
| {{package|couchdb}}  || {{yes}}
| {{package|couchdb}}  || {{yes}}
|-
|-
| {{package|ejabberd}}  || {{no}}
| {{package|ejabberd}}  || {{Yes}}
|-
|-
| {{package|erlang-basho_metrics}}  || {{yes}}
| {{package|erlang-basho_metrics}}  || {{yes}}
Line 136: Line 136:
|-
|-
| {{package|erlang-js}}  || {{yes}}
| {{package|erlang-js}}  || {{yes}}
|-
| {{package|erlang-lfe}}  || {{yes}}
|-
|-
| {{package|erlang-sd_notify}}  || {{yes}}
| {{package|erlang-sd_notify}}  || {{yes}}
Line 158: Line 160:
<!-- N/A (not a System Wide Change) -->
<!-- N/A (not a System Wide Change) -->


* [http://www.erlang.org/news/88 Erlang/OTP 18.0 release notes]
* [http://www.erlang.org/news/86 Erlang/OTP 18.0 release notes]
* [http://www.erlang.org/news/92 Erlang/OTP 18.1 release notes (bugfix release)]
* [http://www.erlang.org/news/88 Erlang/OTP 18.1 release notes (bugfix release)]
* [http://www.erlang.org/news/97 Erlang/OTP 18.2 release notes (bugfix release)]
* [http://www.erlang.org/news/98 Erlang/OTP 18.2 release notes (bugfix release)]
* [http://www.erlang.org/news/101 Erlang/OTP 18.3 release notes (bugfix release)]


== Release Notes ==
== Release Notes ==


Erlang/OTP 18.2.3 is available in Fedora 24.
Erlang/OTP 18.3.4 is available in Fedora 24.


[[Category:ChangeAcceptedF24]]
[[Category:ChangeAcceptedF24]]

Latest revision as of 13:37, 17 June 2016

Erlang 18

Summary

Update Erlang/OTP to version 18, and improve Erlang support in Fedora.

Owner

Current status

Detailed Description

Upgrade Erlang to version 18 which brings a lot of good stuff. Just a few highlights:

  • A lot of scalability and performance improvements.
  • Even better Ellyptic Curve Crypto support.
  • Initial support for IPv6 Erlang clustering. See these GitHub pull requests - #602 and #864.
  • New language feature - maps.
  • Better, production-ready HiPE support.

Aside from this, we plan to improve quality of Erlang and related packages. These are shortcomings we want to address:

  • We should enable so-called dirty NIF scheduler which is disabled currently.
  • Every daemon written in Erlang has its own logging solution which doesn't use neither syslog nor Journald. We should start switching them to Journald.
  • Erlang packaging is quite complex and mostly undocumented.
  • Improve coredump producing (see this patch for further details) and investigating.

Benefit to Fedora

Fedora users, both developers and end-users, will have visible benefits from using Fedora-provided packages. Namely:

  • Even better EC support in Erlang. Enough to start experimenting with cryptocurrencies using Erlang out of the box.
  • More scalable and reliable applications with better performance.
  • Better support for running Erlang apps in a fully IPv6 environments.
  • Improved logging, better unified with the rest of system.
  • Improved post-mortem Erlang applications analysis.
  • Packagers won't be afraid of packaging Erlang-related applications anymore. Also they will spend less time on packaging.

Scope

  • Proposal owners:
    • Upgrade Erlang to the latest version (18.2.2). Done!
    • We must rebuild every package which requires NIF or Driver version (listed below in the Dependencies section) against Erlang 18.2.x. Done!
    • Every Erlang daemon's systemd unit must require epmd.socket.
    • Allow EPMD implementation switching - Erlang is about choice!
    • We need to fill new review request for erlang-ejournald
    • Add another default directory to look for Erlang *.beam files.
    • Every Erlang package must require erlang-rebar (or erlang-rpm-macros directly). Done.
    • Upgrade outdated packages:
      • {Ejabberd Done!
        • We'd better to package all the bundled libraries Ejabberd requires. This bug has all of the needed review requests marked as blockers. Done!
      • Riak
        • Riak has growing Bugzilla backlog, and badly outdated. We have to address all of these issues and package some additional libraries required by new Riak version. Unfortunately it has been retired. We'll re-add it later.
      • Wings3D Done!
  • Other developers: N/A
  • Release engineering: N/A
  • Policies and guidelines:
    • We should create Erlang Packaging Guidelines which doesn't exist yet.

Upgrade/compatibility impact

Every Erlang upgrade requires the rebuilding of modules which contains ports or NIFs, and we will rebuild all such modules in Fedora. However if a user has some additional modules not available in a Fedora repository, then these modules must be rebuilt manually.

How To Test

  • Ensure that high-grade Erlang applications are still working:
Name Tested
couchdb Yes
ejabberd Yes
mochiweb Yes
rabbitmq-server Yes
riak No (package was retired :( )
wings Yes
  • Collect feedback from volunteers regarding their experience with this Erlang/OTP version

User Experience

Users will get more robust, scalable, and fast Erlang applications.

Dependencies

The following packages must be rebuilt:

Name Rebuilt
couchdb Yes
ejabberd Yes
erlang-basho_metrics Yes
erlang-bitcask Yes
erlang-cl Yes
erlang-ebloom Yes
erlang-eleveldb Yes
erlang-emmap Yes
erlang-erlsyslog Yes
erlang-esasl Yes
erlang-esdl Yes
erlang-js Yes
erlang-lfe Yes
erlang-sd_notify Yes
erlang-skerl Yes
erlang-snappy Yes
wings Yes

Contingency Plan

  • Contingency mechanism: None necessary. Instead of falling back to the previous version we should fix existing packages in order to help the Community. We should also monitor upstream development process for potentially discovered issues and proactively apply patches (as we already did with Erlang R14, Erlang R15, Erlang R16, and Erlang 17). It should be noted that this change consists from an independent or loosely coupled smaller changes. If we fail to deliver some changes in time, we should reschedule these exact changes to the future Fedora release while keeping already implemented ones.
  • Contingency deadline: N/A
  • Blocks release? N/A
  • Blocks product? N/A

Documentation

Release Notes

Erlang/OTP 18.3.4 is available in Fedora 24.

Retrieved from "https://fedoraproject.org/w/index.php?title=Changes/Erlang_18&oldid=456976"