(making an "or" condition clearer; fixing formatting) |
(Fix backticks not showing inside <code> line for Configuring the kernel) |
||
(156 intermediate revisions by 49 users not shown) | |||
Line 1: | Line 1: | ||
[[Category:Documentation]][[Category:Tutorials]] | [[Category:Documentation]][[Category:Tutorials]] | ||
{{autolang|base=yes}} | |||
This document provides instructions for advanced users who want to rebuild the kernel from some source. Note, however, that when building or running any such kernel, one should NOT expect support from the Fedora kernel team; you're pretty much on your own here if something doesn't work as you'd hoped or expected. But hey, you're an advanced user, so you can handle it, right? Anyway, advanced users build custom kernels for a variety of reasons: | |||
* To apply patches for testing that they either generated or obtained from another source | * To apply patches for testing that they either generated or obtained from another source | ||
* To reconfigure the existing kernel | * To reconfigure the existing kernel | ||
* To learn more about the kernel and kernel development | * To learn more about the kernel and kernel development | ||
== Dependencies for building kernels == | |||
Not all of these will apply to all methods but this provides a good dependency list of items to install | |||
<code> # sudo dnf install fedpkg fedora-packager rpmdevtools ncurses-devel pesign grubby</code> | |||
Give the following command from the top directory of the kernel source tree once you have checked it out | |||
< | <code> # sudo dnf builddep kernel.spec</code> | ||
</ | |||
if you plan to run 'make xconfig' | |||
<code> # sudo dnf install qt5-qtbase-devel libXi-devel gcc-c++</code> | |||
# | |||
Also make sure you add the user doing the build to /etc/pesign/users and run the authorize user script: | |||
<code># sudo /usr/libexec/pesign/pesign-authorize</code> | |||
It should be noted that pesign pesign-rh-test-certs gets pulled in automatically for some, but not for everyone, it depends on how you installed pesign. It is best to make sure that you have it installed. | |||
{{admon/note|pesign|Also note that <code>pesign</code> is applicable only for UEFI platforms (x86, arm, aarch64), it's not used on eg. ppc64le or s390x.}} | |||
{{admon/note|dnf versus yum|As of Fedora 22[https://docs.fedoraproject.org/en-US/Fedora/22/html/Release_Notes/] [[dnf]] has replaced [[yum]] as the default package manager. In the event you are building a kernel for an older system you will either have to install dnf or substitute <code>yum</code> for <code>dnf</code> and/or <code>yumdownloader</code> from the <code>yum-utils</code> package.}} | |||
== Building a Kernel from the Fedora source tree == | |||
Make sure you have installed all dependencies | |||
<code> $ fedpkg clone kernel </code> | |||
you will likely need to checkout the source anonymously unless you have an Fedora developer account | |||
<code> $ fedpkg clone -a kernel </code> | |||
As of the time of this wiki writing, the kernel is managed using git. Each fedora release is a separate branch. rawhide tracks master. To get the tree for a particular release, you can use git checkout from the top of your newly created source tree. | |||
e.g. for fedora 23, | |||
<code> $ git checkout origin/f23 </code> | |||
You can now make whatever changes / customizations you need before generating the rpms and installing them. To avoid conflicts you may want to consider changing | |||
<code> # define buildid .local </code> | |||
# | |||
to e.g. | |||
<code> %define buildid .foobar </code> | |||
< | in <code>kernel.spec</code>. | ||
</ | |||
Whatever you choose instead of foobar will show up in the name of the generated rpm's and will also show up in the GRUB boot menu. | |||
When finished, generate the appropriate rpms with | |||
<code> $ fedpkg local </code> | |||
The rpms will be generated in a subdirectory $ARCH which can then be installed: | |||
<pre>$ sudo dnf install --nogpgcheck \ | |||
./x86_64/kernel-modules-core-$version.rpm \ | |||
./x86_64/kernel-core-$version.rpm \ | |||
./x86_64/kernel-modules-$version.rpm \ | |||
./x86_64/kernel-$version.rpm | |||
</pre> | </pre> | ||
After installing the packages, the kernel will appear in the GRUB menu after next reboot. To uninstall, boot into a kernel different from the one to be uninstalled and do | |||
<code> | |||
$ sudo dnf remove kernel-core-$version | |||
</code> | |||
A complete walkthrough could look like this: | |||
<pre>sudo dnf install fedpkg fedora-packager rpmdevtools ncurses-devel pesign grubby | |||
sudo dnf install qt5-qtbase-devel libXi-devel gcc-c++ | |||
sudo bash -c "echo $USER >> /etc/pesign/users" | |||
sudo /usr/libexec/pesign/pesign-authorize | |||
fedpkg clone -a kernel | |||
cd kernel | |||
git fetch | |||
git switch f34 | |||
sed -i 's/# define buildid .local/%define buildid .foobar/g' kernel.spec | |||
sudo dnf builddep kernel.spec | |||
fedpkg local | |||
cd x86_64 | |||
sudo dnf install --nogpgcheck \ | |||
kernel-core-5.17.12-100.foobar.fc34.x86_64.rpm \ | |||
kernel-modules-5.17.12-100.foobar.fc34.x86_64.rpm \ | |||
kernel-5.17.12-100.foobar.fc34.x86_64.rpm | |||
</pre> | </pre> | ||
=== Building a non-debugging kernel === | |||
Branched kernels are built with debugging enabled by default in the early stages of the release to assist developers. To make a kernel with debugging information disabled, you can follow the above instructions to check out and do: | |||
<code> $ make release </code> | |||
<code> $ fedpkg local </code> | |||
=== Enabling config options === | |||
If there are configuration options that need to be adjusted for your build, you can add changes in the kernel-local file. These changes will get picked up when you build. | |||
=== Updating === | |||
* <code> $ cd kernel </code> | |||
* <code> kernel $ git status </code> | |||
** your tree will be dirty in the configs and kernel.spec | |||
* <code> kernel $ git stash </code> | |||
** puts aside your changes so your tree will be clean | |||
* <code> kernel $ git pull origin </code> | |||
** update to the latest tree from fedpkg git | |||
Now you can run whatever other commands you want (e.g. make release) | |||
== | == Building a kernel from the exploded git trees == | ||
Fedora maintains a git tree containing Fedora patches applied on top of the vanilla sources. | |||
< | <code> $ git clone https://gitlab.com/cki-project/kernel-ark </code> | ||
</ | |||
<code> $ git checkout -b my_branch kernel-4.7.4-200.fc24</code> | |||
You can now build the kernel following regular kernel instructions. This tree is useful for generating patches that can be applied to the kernel.spec. | |||
This | |||
== Building a Kernel from the source RPM == | |||
Instructions for this are on a [[Building_a_custom_kernel/Source_RPM | separate page]]. In general, you should use one of the other methods for building the kernel which are much easier. | |||
== Building Only Kernel Modules == | == Building Only Kernel Modules (Out Of Tree Modules) == | ||
{{Admon/warning | This section needs to be updated and fleshed out}} | {{Admon/warning | This section needs to be updated and fleshed out}} | ||
This section is for users who are only interested in working on a kernel module, and who do not wish to build an entire custom kernel. It is not necessary to download and rebuild the entire kernel to build a module. To build a module for the currently running kernel, only the <code>kernel-devel</code> package is required. Run the following command to install the <code>kernel-devel</code> package using <code> | This section is for users who are only interested in working on a kernel module, and who do not wish to build an entire custom kernel. It is not necessary to download and rebuild the entire kernel in order to build a module. To build a module for the currently running kernel, only the matching <code>kernel-devel</code> package is required. Run the following command to install the <code>kernel-devel</code> package using <code>dnf</code>. | ||
<pre>su -c ' | <pre>su -c 'dnf install kernel-devel' | ||
</pre> | </pre> | ||
{{Admon/note | You may need to install 'kernel-PAE-devel' if you are using the PAE kernel}} | |||
You can build against any kernel version, as long as you have <code>kernel</code> and <code>kernel-devel</code> packages installed for that version. The rest of this section assumes we're building for the running kernel; if not, replace <code>`uname -r`</code> with the desired version number. | |||
As a simple example, to build the <code>foo.ko</code> module from <code>foo.c</code>, create the following <code>Makefile</code> in the directory containing the <code>foo.c</code> file: | |||
<pre>obj-m := foo.o | <pre>obj-m := foo.o | ||
Line 185: | Line 160: | ||
default: | default: | ||
$(MAKE) -C $(KDIR) M=$(PWD) modules | [TAB]$(MAKE) -C $(KDIR) M=$(PWD) modules | ||
</pre> | </pre> | ||
[TAB] Denotes a tab character which must come first for makefile lines containing commands. | |||
Then, issue the <code>make</code> command to build the <code>foo.ko</code> module. | Then, issue the <code>make</code> command to build the <code>foo.ko</code> module. | ||
The above is a helpful local Makefile wrapper invoking kbuild; in general you can simply do things like | |||
<pre># make -C /lib/modules/`uname -r`/build M=`pwd` modules | |||
# make -C /lib/modules/`uname -r`/build M=`pwd` clean | |||
# make -C /lib/modules/`uname -r`/build M=`pwd` modules_install | |||
</pre> | |||
etc to build those targets. | |||
== Building Vanilla upstream kernel == | |||
Sometimes a Fedora developer may ask you to try building and installing an upstream kernel (possibly with a patch added) for testing. | |||
If there are multiple iterations, it may be quicker for you to do this than for the developer to turn around several RPMs. | |||
=== Existing Fedora Vanilla packages === | |||
There is an effort underway for packaging vanilla kernels. [[Kernel_Vanilla_Repositories | See if this meets your needs first]] | |||
=== Getting the sources === | |||
Clone a kernel tree from kernel.org | |||
{{Admon/note | Tips for developing with kernel.org sources|The README file in the top-level directory provides very good build instructions, including how to direct the build to a particular directory, the necessary make targets, and the order in which to issue them. Save time by reviewing the Documentation directory and its sub-directories containing informative ".txt" files. View the top level Makefile for kernel version information.}} | |||
<code> $ git clone git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git </code> | |||
This will clone the entire upstream tree. This may take a while depending on your connection speed. (While the tree is syncing, why not take the time to update some steps on this wiki that are inevitably out of date?) | |||
<code> $ cd linux </code> | |||
If you need the stable kernel releases, add the stable remote: | |||
<code> $ git remote add -f stable git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git </code> | |||
Double check what baseline is being used and check out a new one if necessary: | |||
<code> $ git checkout v4.5.2</code> | |||
=== Applying patches === | |||
==== The patch method ==== | |||
If you were asked to apply any patches by the developer, this is the stage at which we would do so. | |||
These would typically be applied using a command something like.. | |||
<code> $ cat ~/testpatch.diff | patch -p1 </code> | |||
If you have to try multiple different patches individually, you can unapply the previous one after testing by adding -R on the end of the above command. | |||
==== The git method ==== | |||
Most developers these days generate patches using git and you can use git to help apply patches. You can do: | |||
<code> $ git am -3 <patch file> </code> | |||
This will create a git commit of a single patch in your tree. | |||
=== Configuring the kernel === | |||
{{admon/note| Potential options to the instructions below|Consider using the make targets "mrproper" and "menuconfig" as specified in the top-level README file. The "menuconfig" target is an alternative to "oldconfig" and pops up a menu that allows you to easily set virtually all build options. Accepting the defaults is generally fine, although you can use the "General Setup->Local version" option to append a label to your build instead of tweaking "EXTRAVERSION" in the .config file.}} | |||
Chances are that the kernel you are running is older than the one you are about to configure. This means there will be new options. | |||
There are several possibilities here. | |||
* If the developer has pointed you at a specific config file to use, save it in the linux directory with the filename .config | |||
* You can take your existing .config file by using the command <code>cp /boot/config-$(uname -r)* .config</code> | |||
When you run the next step, you'll be asked (potentially lots of) questions about all the new options. Just hitting return 'should' always pick the safe decision for each option. However, it's worth taking care and reading each option, as this isn't always the case, and they may introduce new features your distro isn't capable of running, which may result in a non-booting system. | |||
* FIXME how to grab a rawhide config | |||
With the config in place, you are now ready to move on to the next step. | |||
=== Building the kernel === | |||
<code> $EDITOR Makefile </code> | |||
Change the EXTRAVERSION line to add something on the end. For example, if it reads "EXTRAVERSION = -rc5" change it to "EXTRAVERSION = -rc5-dave" (what you choose is only relevant for the final part of this procedure) | |||
<code> $ make oldconfig </code> | |||
<code> $ make bzImage </code> | |||
<code> $ make modules </code> | |||
(become root) | |||
<code> # make modules_install </code> | |||
<code> # make install </code> | |||
You have now built and installed a kernel. It will show up in the grub menu next time you reboot. | |||
=== Rebuilding === | |||
If you have been asked to try several different things, the procedure once you have already built the tree once is mostly the same. A <code>make clean</code> is recommended between builds. This will leave the .config in place, so you can skip that step above and proceed straight to the <code>make bzImage</code> part of the steps above. Because we installed ccache in the first step, subsequent builds may go a lot faster as the compiler hits files that haven't changed since the last time it built them. | |||
=== Cleaning up === | |||
Once you have tested the kernel, and you've booted back to one of your kernels installed from an RPM, you can clean up the files that the above procedure installed by becoming root, and calling these commands. (Be sure to get the kernel version correct!) Remember above, we changed EXTRAVERSION to add a 'tag' to the kernel ? All the files it installed will have this as part of the filename. So you should be able to use wildcards to delete them safely using commands similar to those below. (Just replace 'dave' with whatever tag you chose) | |||
<pre> | |||
rm -f /boot/config-2.6.*dave* /boot/initrd-2.6.*dave* /boot/vmlinuz-*dave* /boot/System.map-*dave* /boot/loader/entries/*dave* | |||
rm -rf /lib/modules/2.6*dave* | |||
</pre> | |||
Finally, you will need to remove the kernel as an option to your bootloader. This will change from architecture to architecture. For x86, (as root), edit /boot/grub2/grub.cfg or /boot/efi/EFI/fedora/grub.cfg if you have EFI enabled and delete the four lines relating to your kernel (They should be easy to spot, they'll be the ones with your tag). They'll look something like this.. | |||
<pre> | |||
title Fedora Core (2.6.22-rc3-dave) | |||
root (hd0,0) | |||
kernel /vmlinuz-2.6.22-rc3-dave ro root=/dev/md0 | |||
initrd /initrd-2.6.22-rc3-dave.img | |||
</pre> |
Latest revision as of 09:05, 22 July 2024
This document provides instructions for advanced users who want to rebuild the kernel from some source. Note, however, that when building or running any such kernel, one should NOT expect support from the Fedora kernel team; you're pretty much on your own here if something doesn't work as you'd hoped or expected. But hey, you're an advanced user, so you can handle it, right? Anyway, advanced users build custom kernels for a variety of reasons:
- To apply patches for testing that they either generated or obtained from another source
- To reconfigure the existing kernel
- To learn more about the kernel and kernel development
Dependencies for building kernels
Not all of these will apply to all methods but this provides a good dependency list of items to install
# sudo dnf install fedpkg fedora-packager rpmdevtools ncurses-devel pesign grubby
Give the following command from the top directory of the kernel source tree once you have checked it out
# sudo dnf builddep kernel.spec
if you plan to run 'make xconfig'
# sudo dnf install qt5-qtbase-devel libXi-devel gcc-c++
Also make sure you add the user doing the build to /etc/pesign/users and run the authorize user script:
# sudo /usr/libexec/pesign/pesign-authorize
It should be noted that pesign pesign-rh-test-certs gets pulled in automatically for some, but not for everyone, it depends on how you installed pesign. It is best to make sure that you have it installed.
Building a Kernel from the Fedora source tree
Make sure you have installed all dependencies
$ fedpkg clone kernel
you will likely need to checkout the source anonymously unless you have an Fedora developer account
$ fedpkg clone -a kernel
As of the time of this wiki writing, the kernel is managed using git. Each fedora release is a separate branch. rawhide tracks master. To get the tree for a particular release, you can use git checkout from the top of your newly created source tree.
e.g. for fedora 23,
$ git checkout origin/f23
You can now make whatever changes / customizations you need before generating the rpms and installing them. To avoid conflicts you may want to consider changing
# define buildid .local
to e.g.
%define buildid .foobar
in kernel.spec
.
Whatever you choose instead of foobar will show up in the name of the generated rpm's and will also show up in the GRUB boot menu.
When finished, generate the appropriate rpms with
$ fedpkg local
The rpms will be generated in a subdirectory $ARCH which can then be installed:
$ sudo dnf install --nogpgcheck \ ./x86_64/kernel-modules-core-$version.rpm \ ./x86_64/kernel-core-$version.rpm \ ./x86_64/kernel-modules-$version.rpm \ ./x86_64/kernel-$version.rpm
After installing the packages, the kernel will appear in the GRUB menu after next reboot. To uninstall, boot into a kernel different from the one to be uninstalled and do
$ sudo dnf remove kernel-core-$version
A complete walkthrough could look like this:
sudo dnf install fedpkg fedora-packager rpmdevtools ncurses-devel pesign grubby sudo dnf install qt5-qtbase-devel libXi-devel gcc-c++ sudo bash -c "echo $USER >> /etc/pesign/users" sudo /usr/libexec/pesign/pesign-authorize fedpkg clone -a kernel cd kernel git fetch git switch f34 sed -i 's/# define buildid .local/%define buildid .foobar/g' kernel.spec sudo dnf builddep kernel.spec fedpkg local cd x86_64 sudo dnf install --nogpgcheck \ kernel-core-5.17.12-100.foobar.fc34.x86_64.rpm \ kernel-modules-5.17.12-100.foobar.fc34.x86_64.rpm \ kernel-5.17.12-100.foobar.fc34.x86_64.rpm
Building a non-debugging kernel
Branched kernels are built with debugging enabled by default in the early stages of the release to assist developers. To make a kernel with debugging information disabled, you can follow the above instructions to check out and do:
$ make release
$ fedpkg local
Enabling config options
If there are configuration options that need to be adjusted for your build, you can add changes in the kernel-local file. These changes will get picked up when you build.
Updating
$ cd kernel
kernel $ git status
- your tree will be dirty in the configs and kernel.spec
kernel $ git stash
- puts aside your changes so your tree will be clean
kernel $ git pull origin
- update to the latest tree from fedpkg git
Now you can run whatever other commands you want (e.g. make release)
Building a kernel from the exploded git trees
Fedora maintains a git tree containing Fedora patches applied on top of the vanilla sources.
$ git clone https://gitlab.com/cki-project/kernel-ark
$ git checkout -b my_branch kernel-4.7.4-200.fc24
You can now build the kernel following regular kernel instructions. This tree is useful for generating patches that can be applied to the kernel.spec.
Building a Kernel from the source RPM
Instructions for this are on a separate page. In general, you should use one of the other methods for building the kernel which are much easier.
Building Only Kernel Modules (Out Of Tree Modules)
This section is for users who are only interested in working on a kernel module, and who do not wish to build an entire custom kernel. It is not necessary to download and rebuild the entire kernel in order to build a module. To build a module for the currently running kernel, only the matching kernel-devel
package is required. Run the following command to install the kernel-devel
package using dnf
.
su -c 'dnf install kernel-devel'
You can build against any kernel version, as long as you have kernel
and kernel-devel
packages installed for that version. The rest of this section assumes we're building for the running kernel; if not, replace
with the desired version number.
uname -r
As a simple example, to build the foo.ko
module from foo.c
, create the following Makefile
in the directory containing the foo.c
file:
obj-m := foo.o KDIR := /lib/modules/$(shell uname -r)/build PWD := $(shell pwd) default: [TAB]$(MAKE) -C $(KDIR) M=$(PWD) modules
[TAB] Denotes a tab character which must come first for makefile lines containing commands.
Then, issue the make
command to build the foo.ko
module.
The above is a helpful local Makefile wrapper invoking kbuild; in general you can simply do things like
# make -C /lib/modules/`uname -r`/build M=`pwd` modules # make -C /lib/modules/`uname -r`/build M=`pwd` clean # make -C /lib/modules/`uname -r`/build M=`pwd` modules_install
etc to build those targets.
Building Vanilla upstream kernel
Sometimes a Fedora developer may ask you to try building and installing an upstream kernel (possibly with a patch added) for testing. If there are multiple iterations, it may be quicker for you to do this than for the developer to turn around several RPMs.
Existing Fedora Vanilla packages
There is an effort underway for packaging vanilla kernels. See if this meets your needs first
Getting the sources
Clone a kernel tree from kernel.org
$ git clone git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
This will clone the entire upstream tree. This may take a while depending on your connection speed. (While the tree is syncing, why not take the time to update some steps on this wiki that are inevitably out of date?)
$ cd linux
If you need the stable kernel releases, add the stable remote:
$ git remote add -f stable git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git
Double check what baseline is being used and check out a new one if necessary:
$ git checkout v4.5.2
Applying patches
The patch method
If you were asked to apply any patches by the developer, this is the stage at which we would do so. These would typically be applied using a command something like..
$ cat ~/testpatch.diff | patch -p1
If you have to try multiple different patches individually, you can unapply the previous one after testing by adding -R on the end of the above command.
The git method
Most developers these days generate patches using git and you can use git to help apply patches. You can do:
$ git am -3 <patch file>
This will create a git commit of a single patch in your tree.
Configuring the kernel
Chances are that the kernel you are running is older than the one you are about to configure. This means there will be new options. There are several possibilities here.
- If the developer has pointed you at a specific config file to use, save it in the linux directory with the filename .config
- You can take your existing .config file by using the command
cp /boot/config-$(uname -r)* .config
When you run the next step, you'll be asked (potentially lots of) questions about all the new options. Just hitting return 'should' always pick the safe decision for each option. However, it's worth taking care and reading each option, as this isn't always the case, and they may introduce new features your distro isn't capable of running, which may result in a non-booting system.
- FIXME how to grab a rawhide config
With the config in place, you are now ready to move on to the next step.
Building the kernel
$EDITOR Makefile
Change the EXTRAVERSION line to add something on the end. For example, if it reads "EXTRAVERSION = -rc5" change it to "EXTRAVERSION = -rc5-dave" (what you choose is only relevant for the final part of this procedure)
$ make oldconfig
$ make bzImage
$ make modules
(become root)
# make modules_install
# make install
You have now built and installed a kernel. It will show up in the grub menu next time you reboot.
Rebuilding
If you have been asked to try several different things, the procedure once you have already built the tree once is mostly the same. A make clean
is recommended between builds. This will leave the .config in place, so you can skip that step above and proceed straight to the make bzImage
part of the steps above. Because we installed ccache in the first step, subsequent builds may go a lot faster as the compiler hits files that haven't changed since the last time it built them.
Cleaning up
Once you have tested the kernel, and you've booted back to one of your kernels installed from an RPM, you can clean up the files that the above procedure installed by becoming root, and calling these commands. (Be sure to get the kernel version correct!) Remember above, we changed EXTRAVERSION to add a 'tag' to the kernel ? All the files it installed will have this as part of the filename. So you should be able to use wildcards to delete them safely using commands similar to those below. (Just replace 'dave' with whatever tag you chose)
rm -f /boot/config-2.6.*dave* /boot/initrd-2.6.*dave* /boot/vmlinuz-*dave* /boot/System.map-*dave* /boot/loader/entries/*dave* rm -rf /lib/modules/2.6*dave*
Finally, you will need to remove the kernel as an option to your bootloader. This will change from architecture to architecture. For x86, (as root), edit /boot/grub2/grub.cfg or /boot/efi/EFI/fedora/grub.cfg if you have EFI enabled and delete the four lines relating to your kernel (They should be easy to spot, they'll be the ones with your tag). They'll look something like this..
title Fedora Core (2.6.22-rc3-dave) root (hd0,0) kernel /vmlinuz-2.6.22-rc3-dave ro root=/dev/md0 initrd /initrd-2.6.22-rc3-dave.img