Kernel Vanilla Repositories

Overview

This page contains information about a set of package repositories which contain RPMs of Linux vanilla kernels built for Fedora. Vanilla in this scope means 'unmodified', hence these packages do not contain any of those enhancements the Fedora developers integrate into the Linux kernel packages that Fedora normally uses.

Currently there are these repositories:

• kernel-vanilla-mainline for F19 and F20
• kernel-vanilla-stable for F19 and F20
• kernel-vanilla-stable-testing for F19 and F20

To install the kernels from these repositories download the repo definitions for kernel-vanilla-mainline, kernel-vanilla-stable or kernel-vanilla-stable and put it in /etc/yum.repos.d/. You can do this with commands like these:

# for the mainline repo
curl -s http://repos.fedorapeople.org/repos/thl/kernel-vanilla-mainline/fedora-kernel-vanilla-mainline.repo | sudo tee /etc/yum.repos.d/fedora-kernel-vanilla-mainline.repo

# for the stable repo
curl -s http://repos.fedorapeople.org/repos/thl/kernel-vanilla-stable/fedora-kernel-vanilla-stable.repo | sudo tee /etc/yum.repos.d/fedora-kernel-vanilla-stable.repo

# for the stable-testing repo
curl -s http://repos.fedorapeople.org/repos/thl/kernel-vanilla-stable/fedora-kernel-vanilla-stable.repo | sudo tee /etc/yum.repos.d/fedora-kernel-vanilla-stable.repo
curl -s http://repos.fedorapeople.org/repos/thl/kernel-vanilla-stable-testing/fedora-kernel-vanilla-stable-testing.repo | sudo tee /etc/yum.repos.d/fedora-kernel-vanilla-stable-testing.repo 

To list the available packages use a command like this:

yum --disablerepo=* --enablerepo='fedora-kernel-vanilla-mainline' list available

To install the latest kernel from the repo use a command like this:

sudo yum --disablerepo=* --enablerepo='fedora-kernel-vanilla-mainline' install kernel

When you install a kernel from the repo for the first time yum will ask you if you trust the the public key that is used to verify the signature of the packages from the kernel vanilla repositories. It will look like this:

Retrieving key from http://repos.fedorapeople.org/repos/thl/kernel-vanilla-stable/RPM-GPG-KEY-fedora-kernel-vanilla
Importing GPG key 0xCC9DBCAB:
 Userid     : "Thorsten Leemhuis (key for signing vanilla kernel pkgs for fedora) <fedora@leemhuis.info>"
 Fingerprint: e5e8 d53e e5af be95 633d 690f d792 7a2f cc9d bcab
 From       : http://repos.fedorapeople.org/repos/thl/kernel-vanilla-stable/RPM-GPG-KEY-fedora-kernel-vanilla
Is this ok [y/N]: 

Yum will proceed once you acknowledge this.

You are advised to add "kernel-devel" to above 'yum install' call, because that way you get the package that contains the files needed to compile kernel modules for the kernel you are installing; installing them later might not be possible, as the package you need might get removed when the repositories get updated the next time.

Note that the kernel-vanilla-stable-testing repo is meant to be used in addition to kernel-vanilla-stable, so when you enable the former you should enable the latter as well; this will happen automatically if you rely on the commands mentioned above.

Important notes

Please note:

• none of the developers that maintain the Fedora kernel is involved in this effort
• most systems work better and are run in a more secure manner with the official Fedora kernels
• if you don't know what above command do then you likely should not use these packages

More details on this can be found in the FAQ.

FAQ

For users

Who is behind this effort?

Right now the Linux kernel vanilla repositories for Fedora are maintained by Thorsten Leemhuis (aka "knurd") only. Maybe over time people join to help, that's why this text is written as if a team is keeping care of the repositories.

Can we trust the people behind it?

You have to decide yourself if you can trust the packages from these repositories. If it is any help: Some of those that use or contribute to Fedora since a while will know that Thorsten has quite a history of Fedora contributions, even if he was not that much active in the past few years. You can assume he has no interest in ruin his reputation quickly by providing crap in these repositories. On the other hand you should know that Thorsten started these repositories to dig deeper into the kernel and kernel development; so expect he'll make some mistakes along the way. And be reminded that using vanilla kernels has some known downsides and risks (see below).

What's the goal?

The main ideas is to help upstream development, which in the end will be of benefit for Fedora as well. With the packages from the mainline repositories it for example is quite easy to test kernels that are still under development and report bugs upstream, so they get fixed before a certain kernel version get released and later shipped as update to Fedora.

The kernels from the stable repositories on the other hand make it easy to check if a bug that happens with a kernel from Fedora is specific to it or also present in the newest vanilla kernel from the mainline or the stable series; if that is the case users can directly work with upstream on working out solutions for the problem and don't have to go through the sometimes overworked and quite busy developers that maintain the Linux kernel packages in Fedora.

Are the kernels from the kernel-vanilla repositories as good as those Fedora provides?

No. There are several reasons for why not; the most important ones:

• the developers that take care of the kernel package in Fedora are far more experienced in packaging kernels and kernel development than those that take care of the kernel-vanilla repositories
• the kernels that get used in Fedora or released as proper update get a lot of testing. The kernels from the kernel-vanilla repositories get nearly no testing; they are only started in virtual machine and published if they boot.
• the official Fedora kernels sometimes contain changes that fix security problems or other crucial bugs before they get merged upstream

In addition:

• the mainline repository contain kernels that are still under heavy development and hence sometimes have serious bugs.

But in the end using the kernels from the kernel-vanilla repositories should not be any more dangerous than compiling and installing a kernel from source yourself.

Thorsten, do you use the vanilla kernels yourself?

Yes, I normally use one of the x86-64 vanilla kernels from the mainline repo, but I don't boot into each of them .

Are the kernels safe to use?

Depends on your definition of 'safe'.

The Linux kernel is a complex piece of software which contains bugs. Those bugs lead to data loss sometimes; in very rare situations they can even damage hardware. Those bugs might only show up under specific circumstances – for example when a specific mix of hardware is used with a specific kernel version that was built with a specific configuration. It might be unlikely that such a bug is triggered by one of the non-development kernels from the kernel-vanilla repositories, but it's definitely possible. Self compiled kernels bear exactly the same risk; chances of hitting serious bugs are lower for kernels that have undergone widespread testing already, as those found in the official Fedora repositories.

In other words: The kernels from the kernel-vanilla repositories will work just fine for most people. But use them on your own risk and have backups handy, as you always should.

Will everything work with the vanilla kernels that works with the official Fedora kernels?

No. Linux vanilla kernels are not that different from the kernels Fedora provides, but the latter include a few enhancements. Each was added for a good reason to make Fedora better, hence these improvements are missing when you use Linux vanilla kernels.

When this text was written in the spring of 2012 Fedora for example included utrace in their Linux kernels to support userspace tracing with systemtap; hence this feature didn't work with the kernels from the kernel-vanilla repositories, but should be these days, as systemtap these days uses a upstream solution for its work.

Another example: The kernels from Fedora sometimes include fresher drivers which some systems will require to work properly.

Furthermore, sometimes there are inter-dependencies between drivers in kernel and userland. The nouveau driver for graphics hardware from Nvidia was one such driver, as it had no stable API yet when this text was written; that's why the DRM/KMS driver in the kernel was marked as 'staging' back then. The Mesa 3D or X.org drivers included in a particular Fedora release therefore might depend on the nouveau DRM/KMS driver which is part of the kernels Fedora ships for this release; thus the nouveau drivers for Mesa 3D and X.org that are part of a certain Fedora release might not work properly with kernels found in the kernel-vanilla repositories, as those might contain an incompatible nouveau DRM/KMS driver because it they are older or newer than the one part of the official Fedora kernel.

The non-development kernels found in the kernel-vanilla repositories therefore should work on a lot of systems, but on some systems they will definitely be worse than the kernels Fedora provides.

Where to report bugs

If the Linux kernels in the packages from these repositories show any bugs please report them upstream to the Linux kernel developers, just as you would after installing a Linux kernel yourself with the sources available at kernel.org; that way all the bug reports go to the place where the people hang out that know how to fix them.

In case there are bugs in the packaging sent a mail to Thorsten Leemhuis (aka "knurd").

How can I avoid switching back and forth between vanilla kernels and Fedora kernels ?

Add 'exclude=kernel' to the first section of these files in /etc/yum.repos.d/

fedora.repo fedora-updates.repo fedora-updates-testing.repo

Will this repository also ship updates userland components like drivers or udev that match the kernels in the repositories?

No, as there should be no need to, as the interfaces between the kernel and userland software should never change in an incompatible way; Linus Torvalds makes this pretty clear now and then.

That is the long story short. There are situations where the world is more complicated:

• above mentioned rule does not apply to staging drivers, so situations might arise where the vanilla kernels are not usable for people that need staging drivers for their system.
• Fedora sometimes might contain software that depends on bits that are not upstream

And even with this rule sometimes a new mainline kernel versions brings changes that require updates userland software. Three examples:

• the version number jump from 2.6.39 to 3.0 confused some software
• in rare cases fixing security problems was only possible my changing the interfaces in an incompatible way
• sometimes nobody notices early enough that interfaces have changed

and reverting the change might break systems that already rely on the new behaviour.

It remains to be seen how often we hit such issues and how bad they are; how we deal with them will be decided on a case by case basis. In some cases we might have to other solution then to add new versions of other software to the repositories. But the plan is to avoid this if possible.

Do you plan to provide packages for "linux-next" or "linux-rt" as well?

For now: No. I know there is some interest in packages for them, but maintaining those will consume a lot of time regularly and we have not enough resources to do it properly right now.

Furthermore, the CCMA people already build RT kernels and it might be the best for everyone to not compete with them.

Packaging -next kernels might not be a good idea in general, as chances these kernels contain serious bugs are way bigger than in the mainline of stable series. Hence it might be wise to leave -next to people that build kernels themselves.

Get in contact if you think investing time in these areas makes sense.

Do you plan to provide vanilla kernels for RHEL and derivatives like CentOS and SL?

Sounds like a good addition. But there are people more familiar with these distributions that provide such packages already. It would mean additional work for us, too; and we currently have no one that would regularly run such kernels. So for now we won't get our feet wet in that area. But if you want to step up and help, get in contact.

Do you plan to provide packages for longterm kernels

Unlikely. Main goal of the kernel-vanilla repositories is to help upstream kernel development; but longterm kernels are a dead end and quite far away from mainline development, so they would not fit that well.

What configuration do those kernels use?

The mainline kernels ofBasically the same configuration the Fedora kernels use. Maybe a few staging drivers might get turned on to help their development, but apart from it the plan is to stick closely to what Fedora does.

Why don't you put these kernels in Fedoras main repositories

The current consensus in the Fedora project as far as we see is: That's not a good idea, as that would make the vanilla Linux kernels more 'official' and people might simply use those kernels without knowing what their downsides are.

That's the long story rough and short. And sure, there are reasons why having vanilla kernels in the main repositories would make sense. Feel free to start a discussion on Fedoras devel mailing list, we'll watch and might jump in.

Putting the kernels in a well know 3rd party add-on repository for Fedora might make sense, but some of the problems would be similar. It would lead to more problems, as then users might ask to build add-on modules for those kernels, too.

The best approach would be to reduce the number of patches the Fedora kernel developers include for one reason or another down to zero. That would require changes not only in Fedora, but in the upstream workflow as well.

Are those kernels really unpatched?

No, they contain a handful of very small changes that are needed for packaging.

From time to time the packages might use patches that are necessary temporary to make the kernel build or usable for most people; fixes like these will normally head upstream quickly and hence vanish from the vanilla packages pretty soon again. Furthermore, this normally should only happen with mainline development kernels, not with stable kernels.

How up2date will those repositories be?

We do the work in our spare time. Sometimes the day job and this strange thing called 'real life' leave not much time to work on these kernels, so there will be a lag.

Can you please include the patch found at <URL>?

No. Get your patch merged upstream, then the change you are interested in will automatically show up in these packages. And even better: it will automatically get into Fedora and other distributions, too!

Is there a Git tree somewhere?

Sure.

Let us know if we should do modifications to allow others to contribute to or benefit from this git tree better.

What Fedora versions will be supported

The plan is to always support the most recent Fedora version in the stable and mainline repositories. The mainline and sometimes the stable repo will also be provides for the distribution that is currently under development (rawhide on the first half of Fedoras development cycle iteration or the alpha/beta/rcs in the second half).

Why are there no debug kernels and not even debuginfo packages

The space on repos.fedoraprople.org is limited, hence we need to limit the number of packages we can provide. The debuginfo packages are also quite big, which makes them hard to handle. If there is interest, then may in the sort or medium timeframe solutions can be found to provide these packages.

Why don't you commit your changes to Fedora's kernel git repo on pkgs.fedoraproject.org?

That might make sense. But it bears the risk that a commit is done to a wrong branch and disturbs the work of the Fedora kernels maintainer. Further: Not all of those that contribute to Fedora can commit there. That's similar with the fedorapeople git repository, but the docs indicate others can be given access with the help of ACLs.

But whatever: Git is made for distributed development, so simply clone it and send pull requests if you have any additions.

Can I help?

Of course. Talk to Thorsten; best if you come with some ideas what you can and want to do.

Do you work together with the developers that maintain Fedora's kernel packages?

There is cooperation already. If you think more is needed in some area let us know.

Please stop providing alternative kernel packages, they take attention away from the kernel packages Fedora provide and thus harm Fedora!

That's a valid concern, but we think the benefits outweigh the downsides.

That again that is the long story short. Just to get a little bit deeper into it and show a different view on the matter at hand: Similar arguments could be used to argue that Fedora should stop shipping patched kernels, as they take attention away from the upstream kernel. Up to a point such an argument is valid, too, but there are good reasons why Fedora patches its kernels.

Why did you drop the '-vanilla' postfix that normally gets added to the 'name' macro when you build Fedora's kernel RPM without patches locally?

I've thought about dropping or leaving it for a while, as both schemes have various benefits and downsides. In the end I went for dropping it due to reasons like this:

• nearly every other repository in Fedoraland that ships variants of a packages that are included in Fedora do not change the name
• the postfix in the name breaks some tool -- for example things like 'fedpkg srpm' on the git checkout
• external solutions that heavily depend on the naming scheme Fedora uses (like the akmod/kmod stuff used in some external repositories) would break with the -vanilla postfix in the name
• yum would not recognize kernel packages with a '-vanilla' postfix as 'installonly' and thus would perform a regular update for vanilla packages instead of installing them parallel to the current one

What kernel versions do the repos currently contain?

See yourself with a small script like this:

releases="19 20"; branches="mainline stable stable-testing"; for branch in ${branches} ; do
    for release in ${releases} ; do
        echo -n "${branch} ${release} "
        repoquery --repofrompath=repo,http://repos.fedorapeople.org/repos/thl/kernel-vanilla-${branch}/fedora-${release}/x86_64/ --disablerepo=* --enablerepo=repo --qf '%{evr}' -q kernel
    done
done | column -t

Known issues and differences

The following sections will list differences to Fedora's proper kernel packages that might be relevant to users. It will also lists known problems specific to the packaging of the vanilla kernels.

Please note that these section will not lists any issues known in kernel version that are packaged, as it's best to maintain that information in a central place. So for a list of known bugs in the kernels packaged look at the the upstream bugtracker and the [[1]] of mailing lists like the LKML].

General

No issues known.

F19

No issues known.

F20

No issues known.

ToDo list

• enable some of the staging drivers Fedora avoids (basically those a well known add-on repository for Fedora ships as add-on package)