8:41 p.m.
I am trying to build custom kernel on Fedora-34 following this quick-doc
https://docs.fedoraproject.org/en-US/quick-docs/kernel/build-custom-kernel/
I got error:
# fedpkg clone -a kernel
Cloning into 'kernel'...
remote: Enumerating objects: 2656, done.
remote: Counting objects: 100% (2656/2656), done.
remote: Compressing objects: 100% (926/926), done.
fetch-pack: unexpected disconnect while reading sideband packet
fatal: early EOF
fatal: fetch-pack: invalid index-pack output
Could not execute clone: Failed to execute command.
This is my first time trying to do that.
Please help.
8:57 p.m.
On 7/26/21 9:41 PM, Sampson Fung wrote:
I am trying to build custom kernel on Fedora-34 following this
quick-doc
...
fatal: fetch-pack: invalid index-pack output
Could not execute clone: Failed to execute command.
I had similar fails ...
Are you building to pkg for Fedora-compliant distribution?
Or for your own use, e.g. to patch/bisect/etc?
9:41 p.m.
On 7/26/21 10:29 PM, Sampson Fung wrote:
For my own use. Trying to enable more btrfs debug options.
for me, fedpkg mockbuilds were ... unsuccessful. same errors you're seeing; and then
some.
if you're !building for official pkg'ing, you can live without it.
asking in #fedora-kernel, i got some experienced "don't bother" advice ...
instead, worked out the following for myself.
it works reliably for me.
I exec'd this once, to ensure all kernel build deps were in place
git clone --branch f34 https://src.fedoraproject.org/rpms/kernel.git
cd kernel
dnf builddep kernel.spec
cd ../
rm -rf kernel
then, for repeatable builds, checkout source
git clone --filter=tree:0 https://gitlab.com/cki-project/kernel-ark.git
cd kernel-ark
and checkout branch/tag as req'd. or, start a bisect, etc.
never hurts to clean/reset
git clean -xfd
git reset --hard
clean-up your rmpbuild tree (might want to use a smaller hammer here ...)
rm -rf ~/rpmbuild/*
rpmdev-setuptree
tree ~/rpmbuild/
~/rpmbuild/
├── BUILD
├── RPMS
├── SOURCES
├── SPECS
└── SRPMS
clean the build
make clean
copy your config of choice, e.g.
/bin/cp -f /boot/config-5.12.15-300.fc34.x86_64 .config
modify, &/or, create a custom config. i label mine for convenience
_LABEL=$( git rev-parse --short HEAD )
perl -pi -e 's|^(EXTRAVERSION).*|${1} = -custom-'${_LABEL}'|g' Makefile
prep the config
make oldconfig
and build; here, I'm building the rpm target, as I build locally on a big box, and
transport/install on a small one
make -j16 binrpm-pkg
this is useful to have around
https://www.kernel.org/doc/makehelp.txt
with that^, you'll end up with
tree ~/rpmbuild/RPMS/
~/rpmbuild/RPMS/
└── x86_64
├── kernel-5.12.15_custom_XXXXXXXX.x86_64.rpm
└── kernel-headers-5.12.15_custom_XXXXXXXX.x86_64.rpm
install the
kernel-5.12.15_custom_XXXXXXXX.x86_64.rpm
rebuild your initrd.
reboot.
enjoy.
hth.
10:27 p.m.
Got below error during git clone-
2021-07-27 11:18:13
$ git clone --branch f34 https://src.fedoraproject.org/rpms/kernel.git
Cloning into 'kernel'...
remote: Enumerating objects: 2656, done.
remote: Counting objects: 100% (2656/2656), done.
remote: Compressing objects: 100% (926/926), done.
fetch-pack: unexpected disconnect while reading sideband packet
fatal: early EOF
fatal: fetch-pack: invalid index-pack output
No kernel folder created.
6:55 a.m.
On 7/26/21 11:27 PM, Sampson Fung wrote:
Got below error during git clone-
2021-07-27 11:18:13
$ git clone --branch f34 https://src.fedoraproject.org/rpms/kernel.git
Cloning into 'kernel'...
As mentioned, this step was only to grab/ensure the builddeps. You don't NEED the
whole tree.
if you can't pull the tree, pull the BuildRequires directly from the spec
https://src.fedoraproject.org/rpms/kernel/blob/rawhide/f/kernel.spec#_563
and install them manually.
or, assuming you're running a close-to-current kernel, this should do it as well
dnf builddep kernel
if anything's missing @ build time, your build will tell you.
6:48 p.m.
Thank you very much!
My first build just finished after ~8 hours.
du -ah
1.3M ./kernel-headers-5.14.0_custom_437467a359f+-1.x86_64.rpm
1.1G ./kernel-5.14.0_custom_437467a359f+-1.x86_64.rpm
It is huge!
7:01 p.m.
On 7/27/21 7:48 PM, Sampson Fung wrote:
Thank you very much!
My first build just finished after ~8 hours.
8! What are you building on?
On a Ryzen 3700X desktop, with -j12, it's taking <~20 mins here ...
du -ah
1.3M ./kernel-headers-5.14.0_custom_437467a359f+-1.x86_64.rpm
1.1G ./kernel-5.14.0_custom_437467a359f+-1.x86_64.rpm
It is huge!
Without knowing more ...
I'm gonna guess you've built kernel & modules with debug info enabled?
Did you simply copy config from /boot?
Note, e.g.,
grep CONFIG_DEBUG_INFO= /boot/config-*
/boot/config-5.12.15-300.fc34.x86_64:CONFIG_DEBUG_INFO=y
/boot/config-5.12.17-300.fc34.x86_64:CONFIG_DEBUG_INFO=y
/boot/config-5.13.4-200.fc34.x86_64:CONFIG_DEBUG_INFO=y
8:39 p.m.
I am on AMD A10-7850K . Last build is with -j2
Yes, I just copied /boot/config-5.13.4-200.fc34.x86_64
I changed CONFIG_DEBUG_INFO= and rebuilding with -j5 now.
9:52 p.m.
After disabled CONFIG_DEBUG_INFO, stop background tasts, the second build finished in
about 1 hour.
The result kernel installed OK but failed to boot.
$ du -a
1288 ./kernel-headers-5.14.0_custom_437467a359f+-2.x86_64.rpm
83120 ./kernel-5.14.0_custom_437467a359f+-2.x86_64.rpm
Do I need to build the kernel-modules and kernel-core as well?
11:49 a.m.
On Tue, 27 Jul 2021 01:41:58 -0000
"Sampson Fung" <sampsonfung(a)gmail.com> wrote:
I am trying to build custom kernel on Fedora-34 following this
quick-doc
https://docs.fedoraproject.org/en-US/quick-docs/kernel/build-custom-kernel/
I got error:
# fedpkg clone -a kernel
Cloning into 'kernel'...
remote: Enumerating objects: 2656, done.
remote: Counting objects: 100% (2656/2656), done.
remote: Compressing objects: 100% (926/926), done.
fetch-pack: unexpected disconnect while reading sideband packet
fatal: early EOF
fatal: fetch-pack: invalid index-pack output
Could not execute clone: Failed to execute command.
This is an old and deprecated way to do this.
You can also build using the src.rpm from here
https://koji.fedoraproject.org/koji/packageinfo?packageID=8
run in /home/[your home]
rpmdev-setuptree
to create the rpmbuild heirarchy. Then run, as *user* (important)
rpm -ivh [kernel*src.rpm]
to install the src.rpm in the rpmbuild heirarchy. Edit the kernel.spec
file and uncomment the #define line and add something like 20210727 to
distinguish this kernel from repository kernel.
Run rpmbuild -bp kernel.spec
in the SPECS directory of the rpmbuild heirarchy to expand the src.rpm
Switch to ~/rpmbuild/BUILD/kernel[]/linux[] Then cp a
/boot/config-[] of a kernel to ./.config and run
make oldconfig
Then run
makemenuconfig
and make the changes to the kernel configuration that you want in your
custom kernel. Save them. Then cp the .config file to a local config
to override the defaults.
cp ./.config ~/rpmbuild/SOURCES/kernel-local
Switch back to ~/rpmbuild/SPECS and run
rpmbuild -bb kernel.spec
The output rpms will be in ~/rpmbuild/RPMS/x86_64. Run
dnf -C install $(ls *.rpm)
in that directory to install them.
Seems complicated, but really isn't. If you are going to do this a
lot, you could set up a screen instance to have access to all the
directories needed just by using Ctrl-A [#] to make it easier.
This does not sign the kernel so it can be booted via UEFI secure boot.
So, you either have to turn that off in the BIOS when running it, or
create your own signing key and sign it using pesign. I recommed the
former for a one off.
7:25 p.m.
I got "user mockbuild does not exist - using root"
$ rpm -ivh kernel-5.13.5-200.fc34.src.rpm
Updating / installing...
1:kernel-5.13.5-200.fc34 warning: user mockbuild does not exist - using root
warning: user mockbuild does not exist - using root
warning: user mockbuild does not exist - using root
Edit the kernel.spec
file and uncomment the #define line and
add something like 20210727 to
distinguish this kernel from repository kernel.
I find at line 107: # define .local, after un-comment it:
$ rpmbuild -bp kernel.spec
error: line 107: Unknown tag: define buildid .local
Thus I undo and continue.
rpmbuild -bb kernel.spec
Exit with error:
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.13.5/linux-5.13.5-200.fc34.x86_64/configs/kernel-5.13.5-s390x.config
... done
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.13.5/linux-5.13.5-200.fc34.x86_64/configs/kernel-5.13.5-x86_64-debug.config
... Error: Mismatches found in configuration files
Found CONFIG_CC_VERSION_TEXT="gcc (scripts/dummy-tools/gcc)" after generation,
had CONFIG_CC_VERSION_TEXT="gcc (GCC) 11.1.1 20210531 (Red Hat 11.1.1-3)" in
Source tree
Found CONFIG_GCC_VERSION=200000 after generation, had CONFIG_GCC_VERSION=110101 in Source
tree
Found CONFIG_AS_VERSION=25000 after generation, had CONFIG_AS_VERSION=23501 in Source
tree
Found CONFIG_LD_VERSION=25000 after generation, had CONFIG_LD_VERSION=23501 in Source
tree
error: Bad exit status from /var/tmp/rpm-tmp.wCoe4b (%prep)
RPM build errors:
Bad exit status from /var/tmp/rpm-tmp.wCoe4b (%prep)
12:51 p.m.
On Wed, 28 Jul 2021 00:25:42 -0000
I see you got the other method working, so you really don't need this,
but I'll comment just in case someone else reads this in the far
future. :-)
"Sampson Fung" <sampsonfung(a)gmail.com> wrote:
I got "user mockbuild does not exist - using root"
$ rpm -ivh kernel-5.13.5-200.fc34.src.rpm
Updating / installing...
1:kernel-5.13.5-200.fc34 warning: user mockbuild does
not exist - using root warning: user mockbuild does not exist - using
root warning: user mockbuild does not exist - using root
Harmless.
> Edit the kernel.spec
file and uncomment the #define line and add something like 20210727 to
distinguish this kernel from repository kernel.
I find at line 107: # define .local, after un-comment it:
$ rpmbuild -bp kernel.spec
error: line 107: Unknown tag: define buildid .local
Thus I undo and continue.
It has to be
%define buildid .local
Note the % sign in front of the define, it matters.
> rpmbuild -bb kernel.spec
Exit with error:
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.13.5/linux-5.13.5-200.fc34.x86_64/configs/kernel-5.13.5-s390x.config
... done Processing
/home/fcc/rpmbuild/BUILD/kernel-5.13.5/linux-5.13.5-200.fc34.x86_64/configs/kernel-5.13.5-x86_64-debug.config
... Error: Mismatches found in configuration files Found
CONFIG_CC_VERSION_TEXT="gcc (scripts/dummy-tools/gcc)" after
generation, had CONFIG_CC_VERSION_TEXT="gcc (GCC) 11.1.1 20210531
(Red Hat 11.1.1-3)" in Source tree Found CONFIG_GCC_VERSION=200000
after generation, had CONFIG_GCC_VERSION=110101 in Source tree Found
CONFIG_AS_VERSION=25000 after generation, had CONFIG_AS_VERSION=23501
in Source tree Found CONFIG_LD_VERSION=25000 after generation, had
CONFIG_LD_VERSION=23501 in Source tree error: Bad exit status from
/var/tmp/rpm-tmp.wCoe4b (%prep)
RPM build errors:
Bad exit status from /var/tmp/rpm-tmp.wCoe4b (%prep)
You can try the below. It will show whether the installed gcc on your
system is the same as the config files are expecting.
What is the output of rpm -q gcc?
What is the output of grep -i cc_version
/home/fcc/rpmbuild/BUILD/kernel-5.13.5/linux-5.13.5-200.fc34.x86_64/configs/kernel-5.13.5-x86_64-debug.confiG
?
Are they different? I think that creating the
~/rpmbuild/SOURCES/kernel-local file will fix this.
You can turn off debug config in the kernel.spec file. Set the switch
to 0 as it is set below.
# kernel-debug
%define with_debug %{?_without_debug: 0} %{?!_without_debug: 0}
# kernel-debuginfo
%define with_debuginfo %{?_without_debuginfo: 0} %{?!_without_debuginfo: 0}
You might as well turn off PAE as well as you don't need it.
# kernel PAE (only valid for ARM (lpae))
%define with_pae %{?_without_pae: 0} %{?!_without_pae: 0}
You can also turn off the build of architectures that you are not
interested in. Add the last line to your spec (it won't be there).
%define nobuildarches i386 i686 %{arm}
%endif
%define nobuildarches i386 i686 ppc64 s390x %{arm} %{power64} aarch64 ppc64le
That should get you a little further, if the other method doesn't work
out. It is more user friendly than this technique, which is a lot more
manual. Probably why it was replaced.
I recommend you put your effort into getting the other method working.
9:55 a.m.
On Wed, 28 Jul 2021 00:25:42 -0000
I see you got the other method working, so you really don't need this,
but I'll comment just in case someone else reads this in the far
future. :-)
"Sampson Fung" <sampsonfung(a)gmail.com> wrote:
Harmless.
got it.
It has to be
%define buildid .local
Note the % sign in front of the define, it matters.
got it.
You can try the below. It will show whether the installed gcc on your
system is the same as the config files are expecting.
What is the output of rpm -q gcc?
$ rpm -q gcc
gcc-11.1.1-3.fc34.x86_64
What is the output of grep -i cc_version
/home/fcc/rpmbuild/BUILD/kernel-5.13.5/linux-5.13.5-200.fc34.x86_64/configs/kernel-5.13.5-x86_64-debug.confiG
?
$ grep -i cc_version
~/rpmbuild/BUILD/kernel-5.13.5/linux-5.13.5-200.local.20210729.fc34.x86_64/configs/kernel-5.13.5-x86_64-debug.config
CONFIG_CC_VERSION_TEXT="gcc (GCC) 11.1.1 20210531 (Red Hat 11.1.1-3)"
CONFIG_GCC_VERSION=110101
Are they different? I think that creating the
~/rpmbuild/SOURCES/kernel-local file will fix this.
both reads like 11.1.1 to me. I did cp .config as kernel-local after make
menuconfig. After rm -rf ~/rpmbuild and start over, exit with same error.
You can turn off debug config in the kernel.spec file. Set the
switch
to 0 as it is set below.
# kernel-debug
%define with_debug %{?_without_debug: 0} %{?!_without_debug: 0}
# kernel-debuginfo
%define with_debuginfo %{?_without_debuginfo: 0} %{?!_without_debuginfo: 0}
You might as well turn off PAE as well as you don't need it.
# kernel PAE (only valid for ARM (lpae))
%define with_pae %{?_without_pae: 0} %{?!_without_pae: 0}
You can also turn off the build of architectures that you are not
interested in. Add the last line to your spec (it won't be there).
%define nobuildarches i386 i686 %{arm}
%endif
%define nobuildarches i386 i686 ppc64 s390x %{arm} %{power64} aarch64 ppc64le
That should get you a little further, if the other method doesn't work
out. It is more user friendly than this technique, which is a lot more
manual. Probably why it was replaced.
I recommend you put your effort into getting the other method working.
I will. And
come back to using kernel-spec later.
2:07 p.m.
On Thu, 29 Jul 2021 14:55:25 -0000
"Sampson Fung" <sampsonfung(a)gmail.com> wrote:
both reads like 11.1.1 to me. I did cp .config as kernel-local
after make menuconfig. After rm -rf ~/rpmbuild and start over, exit
with same error.
I agree, the gcc version isn't the problem. I suggest you turn on
verbose in the spec file,
# verbose build, i.e. no silent rules and V=1
%define with_verbose %{?_with_verbose: 1} %{?!_with_verbose: 1}
It is set to 0 as default.
You might as well make the other changes to the spec file at the same
time.
Then run the rpmbuild as
rpmbuild -bb kernel.spec > build_output 2> error_output
If they aren't too large, could you attach them to an email (< 30k?).
If they are too large, could you put them on fedora paste (Fedora
Pastebin at http://paste.fedoraproject.org) and provide a link. I think
fedora has fpaste to do that easily, you might have to install it.
There can be errors further back, or at least warnings, so they may
point to the problem.
If I get time I'll try to reproduce the issue. It has to be something
simple, a switch or configuration option, I *think*.
2:47 p.m.
On Fri, 30 Jul 2021 12:07:19 -0700
stan <upaitag(a)zoho.com> wrote:
On Thu, 29 Jul 2021 14:55:25 -0000
"Sampson Fung" <sampsonfung(a)gmail.com> wrote:
> both reads like 11.1.1 to me. I did cp .config as kernel-local
> after make menuconfig. After rm -rf ~/rpmbuild and start over, exit
> with same error.
If I get time I'll try to reproduce the issue. It has to be
something
simple, a switch or configuration option, I *think*.
I looked at the output from a successful kernel build (under
~/rpmbuild/BUILD/kernel []/linux []) here using rpmbuild. I checked for
the error message you received. This is the output.
configs/kernel-5.14.0-x86_64.config:CONFIG_GCC_VERSION=200000
configs/kernel-local:CONFIG_GCC_VERSION=110101
configs/kernel-5.14.0-armv7hl-lpae.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-aarch64.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-ppc64le.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-i686.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-armv7hl.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-s390x.config:CONFIG_GCC_VERSION=200000
include/config/auto.conf:CONFIG_GCC_VERSION=110101
include/generated/autoconf.h:#define CONFIG_GCC_VERSION 110101
kernel/config_data:CONFIG_GCC_VERSION=110101
So the compiler version set in the kernel-local is overriding the
default. Can you do a grep on your kernel-local to be sure it has the
version set as above. It should be in ~/rpmbuild/SOURCES/
grep -i -e 'config_gcc_version' ~/rpmbuild/SOURCES/kernel-local
You could also run the grep I did to see what it shows, in
~/rpmbuild/BUILD/kernel []/linux []
grep -i -r -e 'config_gcc_version' * | less
2 a.m.
Thank you for your help.
Here I start with a empty ~/rpmbuild:
- build error is 64K, so I uploaded to pastebin the content of kernel.spec, build_report
and build_error to http://cwillu.com:8080/112.119.240.206/3 (in step 16)
1.
https://kojipkgs.fedoraproject.org//packages/kernel/5.14.0/0.rc3.29.fc35/...
2. mount ~/rpmbuild to /mnt/250G/rpmbild
3. rpmdev-setuptree
4. rpm -ivh kernel-5.14.0-0.rc3.29.fc35.src.rpm
5. kernel.spec: %define .20210803
6. rpmbuild -bp kernel.spec
7. sudo cp /boot/config-5.13.6-200.fc34.x86_64
~/rpmbuild/BUILD/kernel-5.14-rc3/linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/.config
8. make oldconfig #press enter for all prompts
9. make menuconfig #CONFIG_BTRFS_ASSERT=y
10. cp
~/rpmbuild/BUILD/kernel-5.14-rc3//linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/.config
~/rpmbuild/SOURCES/kernel-local
11. rpmbuild -bb kernel.spec
+ ./process_configs.sh -w -n -c kernel 5.14.0
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.14-rc3/linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/configs/kernel-5.14.0-aarch64-debug.config
... done
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.14-rc3/linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/configs/kernel-5.14.0-aarch64.config
... done
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.14-rc3/linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/configs/kernel-5.14.0-armv7hl-debug.config
... done
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.14-rc3/linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/configs/kernel-5.14.0-armv7hl-lpae-debug.config
... done
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.14-rc3/linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/configs/kernel-5.14.0-armv7hl-lpae.config
... done
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.14-rc3/linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/configs/kernel-5.14.0-armv7hl.config
... done
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.14-rc3/linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/configs/kernel-5.14.0-i686-debug.config
... done
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.14-rc3/linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/configs/kernel-5.14.0-i686.config
... done
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.14-rc3/linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/configs/kernel-5.14.0-ppc64le-debug.config
... done
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.14-rc3/linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/configs/kernel-5.14.0-ppc64le.config
... done
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.14-rc3/linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/configs/kernel-5.14.0-s390x-debug.config
... done
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.14-rc3/linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/configs/kernel-5.14.0-s390x.config
... done
Processing
/home/fcc/rpmbuild/BUILD/kernel-5.14-rc3/linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/configs/kernel-5.14.0-x86_64-debug.config
... Error: Mismatches found in configuration files
Found CONFIG_CC_VERSION_TEXT="gcc (scripts/dummy-tools/gcc)" after generation,
had CONFIG_CC_VERSION_TEXT="gcc (GCC) 11.2.1 20210728 (Red Hat 11.2.1-1)" in
Source tree
Found CONFIG_GCC_VERSION=200000 after generation, had CONFIG_GCC_VERSION=110201 in Source
tree
Found CONFIG_AS_VERSION=25000 after generation, had CONFIG_AS_VERSION=23501 in Source
tree
Found CONFIG_LD_VERSION=25000 after generation, had CONFIG_LD_VERSION=23501 in Source
tree
error: Bad exit status from /var/tmp/rpm-tmp.b3Ax1d (%prep)
RPM build errors:
Bad exit status from /var/tmp/rpm-tmp.b3Ax1d (%prep)
12. pm -q gcc
gcc-11.2.1-1.fc34.x86_64
13. grep -i cc_version
~/rpmbuild/BUILD/kernel-5.14-rc3/linux-5.14.0-0.rc3.29.20210803.fc34.x86_64/configs/kernel-5.14.0-x86_64-debug.config
CONFIG_CC_VERSION_TEXT="gcc (GCC) 11.2.1 20210728 (Red Hat 11.2.1-1)"
CONFIG_GCC_VERSION=110201
14. (before redo 11, modify kernel.spec)
- #kernel-debug -> 0
- #kernel-debuginfo -> 0
- #kernel PAE (only valid for ARM (lpae)) -> 0
- %define nobuildarches i386 i686 ppc64 s390x %{arm} %{power64} aarch64 ppc64le
- # verbose build, i.e. no silent rules and V=1 -> 1
15. rpmbuild -bb kernel.spec > build_output 2> error_output
+ cp /home/fcc/rpmbuild/SOURCES/kernel-aarch64-debug-fedora.config
/home/fcc/rpmbuild/SOURCES/kernel-aarch64-debug-rhel.config
/home/fcc/rpmbuild/SOURCES/kernel-aarch64-fedora.config
/home/fcc/rpmbuild/SOURCES/kernel-aarch64-rhel.config
/home/fcc/rpmbuild/SOURCES/kernel-armv7hl-debug-fedora.config
/home/fcc/rpmbuild/SOURCES/kernel-armv7hl-fedora.config
/home/fcc/rpmbuild/SOURCES/kernel-armv7hl-lpae-debug-fedora.config
/home/fcc/rpmbuild/SOURCES/kernel-armv7hl-lpae-fedora.config
/home/fcc/rpmbuild/SOURCES/kernel-i686-debug-fedora.config
/home/fcc/rpmbuild/SOURCES/kernel-i686-fedora.config
/home/fcc/rpmbuild/SOURCES/kernel-ppc64le-debug-fedora.config
/home/fcc/rpmbuild/SOURCES/kernel-ppc64le-debug-rhel.config
/home/fcc/rpmbuild/SOURCES/kernel-ppc64le-fedora.config
/home/fcc/rpmbuild/SOURCES/kernel-ppc64le-rhel.config
/home/fcc/rpmbuild/SOURCES/kernel-s390x-debug-fedora.config
/home/fcc/rpmbuild/SOURCES/kernel-s390x-debug-rhel.config
/home/fcc/rpmbuild/SOURCES/kernel-s390x-fedora.config
/home/fcc/rpmbuild/SOURCES/kernel-s390x-rhel.config
/home/fcc/rpmbuild/SOURCES/kernel-s390x-zfcpdump-rhel.config
/home/fcc/rpmbuild/SOURCES/kernel-x86_64-debug-fedora.config
/home/fcc/rpmbuild/SOURCES/kernel-x86_64-debug-rhel.config
/home/fcc/rpmbuild/SOURCES/kernel-x86_64-fedora.config
/home/fcc/rpmbuild/SOURCES/kernel-x86_64-rhel.config .
+ cp /home/fcc/rpmbuild/SOURCES/generate_all_configs.sh .
+ cp /home/fcc/rpmbuild/SOURCES/merge.pl .
+ cp /home/fcc/rpmbuild/SOURCES/kernel-local .
+ VERSION=5.14.0
+ ./generate_all_configs.sh fedora 1
+ for i in kernel-5.14.0-x86_64*.config
+ mv kernel-5.14.0-x86_64-debug.config kernel-5.14.0-x86_64-debug.config.tmp
+ ./merge.pl /home/fcc/rpmbuild/SOURCES/kernel-local
kernel-5.14.0-x86_64-debug.config.tmp
+ rm kernel-5.14.0-x86_64-debug.config.tmp
+ for i in kernel-5.14.0-x86_64*.config
+ mv kernel-5.14.0-x86_64.config kernel-5.14.0-x86_64.config.tmp
+ ./merge.pl /home/fcc/rpmbuild/SOURCES/kernel-local kernel-5.14.0-x86_64.config.tmp
+ rm kernel-5.14.0-x86_64.config.tmp
+ cp /home/fcc/rpmbuild/SOURCES/process_configs.sh .
+ OPTS=
+ OPTS=' -w -n -c'
+ ./process_configs.sh -w -n -c kernel 5.14.0
error: Bad exit status from /var/tmp/rpm-tmp.yeTFEV (%prep)
Bad exit status from /var/tmp/rpm-tmp.yeTFEV (%prep)
16. cat kernel.spec build_output error_output | nc cwillu.com 10101
http://cwillu.com:8080/112.119.240.206/3
17.
grep -i -e 'config_gcc_version' ~/rpmbuild/SOURCES/kernel-local
CONFIG_GCC_VERSION=110201
18. grep -i -r -e 'config_gcc_version' *
configs/kernel-local:CONFIG_GCC_VERSION=110201
configs/kernel-5.14.0-x86_64-debug.config:CONFIG_GCC_VERSION=110201
configs/kernel-5.14.0-x86_64.config:CONFIG_GCC_VERSION=110201
configs/kernel-5.14.0-aarch64-debug.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-aarch64.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-armv7hl-debug.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-armv7hl-lpae-debug.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-armv7hl-lpae.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-armv7hl.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-i686-debug.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-i686.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-ppc64le-debug.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-ppc64le.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-s390x-debug.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-s390x.config:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-x86_64-debug.config.orig.old:CONFIG_GCC_VERSION=110201
configs/kernel-5.14.0-x86_64-debug.config.orig:CONFIG_GCC_VERSION=200000
configs/kernel-5.14.0-x86_64-debug.config.tmp:CONFIG_GCC_VERSION=200000
include/config/auto.conf:CONFIG_GCC_VERSION=200000
include/generated/autoconf.h:#define CONFIG_GCC_VERSION 200000
scripts/Makefile.compiler:cc-ifversion = $(shell [ $(CONFIG_GCC_VERSION)0 $(1) $(2)000 ]
&& echo $(3) || echo $(4))
11:41 a.m.
On Tue, 03 Aug 2021 07:00:56 -0000
"Sampson Fung" <sampsonfung(a)gmail.com> wrote:
This all looks OK.
Here is my relevant error output from the configuration step.
+ cp /home/stan/rpmbuild/SOURCES/generate_all_configs.sh .
+ cp /home/stan/rpmbuild/SOURCES/merge.pl .
+ cp /home/stan/rpmbuild/SOURCES/kernel-local .
+ VERSION=5.14.0
+ ./generate_all_configs.sh fedora 0
+ for i in kernel-5.14.0-x86_64*.config
+ mv kernel-5.14.0-x86_64.config kernel-5.14.0-x86_64.config.tmp
+ ./merge.pl /home/stan/rpmbuild/SOURCES/kernel-local kernel-5.14.0-x86_64.config.tmp
+ rm kernel-5.14.0-x86_64.config.tmp
+ cp /home/stan/rpmbuild/SOURCES/process_configs.sh .
+ OPTS=
+ ./process_configs.sh kernel 5.14.0
/home/stan/rpmbuild/BUILD/kernel-5.14-rc3-38-g4010a528219e/linux-5.14.0-0.rc3.20210728git4010a528219e.32.20210731.fc35.x86_64/configs/kernel-5.14.0-x86_64.config.orig:4950:warning:
override: PSTORE_LZ4HC_COMPRESS_DEFAULT changes choice state
+ cp /home/stan/rpmbuild/SOURCES/update_scripts.sh .
+ RPM_SOURCE_DIR=/home/stan/rpmbuild/SOURCES
+ ./update_scripts.sh fedora
+ cd ..
+ find . '(' -name '*.orig' -o -name '*~' ')' -delete
Here is your error output, as you also posted, but here unwrapped
because replying wrapped it.
+ cp /home/fcc/rpmbuild/SOURCES/generate_all_configs.sh .
+ cp /home/fcc/rpmbuild/SOURCES/merge.pl .
+ cp /home/fcc/rpmbuild/SOURCES/kernel-local .
+ VERSION=5.14.0
+ ./generate_all_configs.sh fedora 1
+ for i in kernel-5.14.0-x86_64*.config
+ mv kernel-5.14.0-x86_64-debug.config kernel-5.14.0-x86_64-debug.config.tmp
+ ./merge.pl /home/fcc/rpmbuild/SOURCES/kernel-local
kernel-5.14.0-x86_64-debug.config.tmp
+ rm kernel-5.14.0-x86_64-debug.config.tmp
+ for i in kernel-5.14.0-x86_64*.config
+ mv kernel-5.14.0-x86_64.config kernel-5.14.0-x86_64.config.tmp
+ ./merge.pl /home/fcc/rpmbuild/SOURCES/kernel-local kernel-5.14.0-x86_64.config.tmp
+ rm kernel-5.14.0-x86_64.config.tmp
+ cp /home/fcc/rpmbuild/SOURCES/process_configs.sh .
+ OPTS=
+ OPTS=' -w -n -c'
+ ./process_configs.sh -w -n -c kernel 5.14.0
error: Bad exit status from /var/tmp/rpm-tmp.yeTFEV (%prep)
Your output has an extra for loop. I'm not sure where that comes from.
The OPTS line is also different when you run process_configs.sh
I ran a diff between your spec file and mine, and I found that there
were setting changes that I have that you do not have. That first one
looks like the culprit.
%define with_configchecks %{?_without_configchecks: 0} %{?!_without_configchecks:
0}
%define with_headers 1
%define with_perf 1
%define with_tools 1
# bpftool btf dump file vmlinux format c > $RPM_BUILD_ROOT/$DevelDir/vmlinux.h
#config(noreplace) /etc/modprobe.d/*-blacklist.conf\
Try these, and see if they work for you. If they don't, I can post the
spec file and the kernel-local I use. The kernel-local is tuned to my
hardware, so won't build a system you want, but they can show if what
works here works there. I don't think it will be necessary, I think it
is the configchecks setting above that is causing the problem. I
should have thought of it, but I have been setting it for years, so
it's on autopilot.
11:56 a.m.
Thank you very much!
This is the kernel.spec file after modification. http://cwillu.com:8080/112.119.240.206/5
Then I got build dependencies errors:
$ rpmbuild -bb kernel.spec
setting SOURCE_DATE_EPOCH=1627084800
error: Failed build dependencies:
asciidoc is needed by kernel-5.14.0-0.rc3.29.20210803.fc34.x86_64
audit-libs-devel is needed by kernel-5.14.0-0.rc3.29.20210803.fc34.x86_64
libbabeltrace-devel is needed by kernel-5.14.0-0.rc3.29.20210803.fc34.x86_64
libbpf-devel is needed by kernel-5.14.0-0.rc3.29.20210803.fc34.x86_64
libcap-ng-devel is needed by kernel-5.14.0-0.rc3.29.20210803.fc34.x86_64
libtraceevent-devel is needed by kernel-5.14.0-0.rc3.29.20210803.fc34.x86_64
newt-devel is needed by kernel-5.14.0-0.rc3.29.20210803.fc34.x86_64
numactl-devel is needed by kernel-5.14.0-0.rc3.29.20210803.fc34.x86_64
perl(ExtUtils::Embed) is needed by kernel-5.14.0-0.rc3.29.20210803.fc34.x86_64
xmlto is needed by kernel-5.14.0-0.rc3.29.20210803.fc34.x86_64
I will try to install all of them then try again.
12:02 p.m.
After installation of the reported dependency issues, building can proceed without the
previous error.
A million thanks!
8:24 p.m.
The compile stopped with error. But I did not capture it.
When I rerun the command rpmbuild -bb kernel.spec, will it continue (so that all built .o
modules do not need to recompile) or it will start fresh?
9:18 p.m.
The second run is much faster.
build_output:
http://cwillu.com:8080/112.119.240.206/7
error_output:
http://cwillu.com:8080/112.119.240.206/8
kernel.spec:
http://cwillu.com:8080/112.119.240.206/9
9:25 a.m.
On Wed, 04 Aug 2021 02:18:55 -0000
"Sampson Fung" <sampsonfung(a)gmail.com> wrote:
The second run is much faster.
build_output:
http://cwillu.com:8080/112.119.240.206/7
error_output:
http://cwillu.com:8080/112.119.240.206/8
kernel.spec:
http://cwillu.com:8080/112.119.240.206/9
My builds choke if I have this uncommented, but yours obviously need it.
#config(noreplace) /etc/modprobe.d/*-blacklist.conf\
Change it to:
%config(noreplace) /etc/modprobe.d/*-blacklist.conf\
On the plus side, you are almost there. The file checking only occurs
as the rpms are being created. The compile successfully completed.
2:35 p.m.
Finally!
I started with a fresh install of Fedora-34 and kernel-5.13.6-200.fc34.src.rpm
Before the previous build, I did not done `sudo rpmbuild builddep kernel.spec`, so some
builddep is not installed before build starts.
The critical change to kernel.spec to allow the build to go ahead:
%define with_configchecks %{?_without_configchecks: 0} %{?!_without_configchecks:
0}
With this :
# We only build kernel-headers on the following...
%if 0%{?fedora}
%define nobuildarches i386 i686 ppc64 s390x %{arm} %{power64} aarch64 ppc64le
%else
%define nobuildarches i386 i686 %{arm}
%endif
# kernel PAE (only valid for ARM (lpae))
%define with_pae %{?_without_pae: 0} %{?!_without_pae: 0}
# kernel-debug
%define with_debug %{?_without_debug: 0} %{?!_without_debug: 0}
# kernel-debuginfo
%define with_debuginfo %{?_without_debuginfo: 0} %{?!_without_debuginfo: 0}
I got:
$ ls -lsh
total 97M
68K -rw-rw-r--. 1 fcc fcc 66K Aug 5 03:00 kernel-5.13.6-200.0805.fc34.x86_64.rpm
38M -rw-rw-r--. 1 fcc fcc 38M Aug 5 03:00 kernel-core-5.13.6-200.0805.fc34.x86_64.rpm
15M -rw-rw-r--. 1 fcc fcc 15M Aug 5 03:00 kernel-devel-5.13.6-200.0805.fc34.x86_64.rpm
42M -rw-rw-r--. 1 fcc fcc 42M Aug 5 03:00
kernel-modules-5.13.6-200.0805.fc34.x86_64.rpm
2.3M -rw-rw-r--. 1 fcc fcc 2.3M Aug 5 03:00
kernel-modules-extra-5.13.6-200.0805.fc34.x86_64.rpm
272K -rw-rw-r--. 1 fcc fcc 272K Aug 5 03:00
kernel-modules-internal-5.13.6-200.0805.fc34.x86_64.rpm
After doing `rpm -ivh kernel-5* kernel-core-5* kernel-modules-5* kernel-devel-5*`, it
booted OK.
6:15 p.m.
On Wed, 04 Aug 2021 19:35:20 -0000
"Sampson Fung" <sampsonfung(a)gmail.com> wrote:
Finally!
[snip]
I got:
$ ls -lsh
total 97M
68K -rw-rw-r--. 1 fcc fcc 66K Aug 5 03:00
kernel-5.13.6-200.0805.fc34.x86_64.rpm 38M -rw-rw-r--. 1 fcc fcc 38M
Aug 5 03:00 kernel-core-5.13.6-200.0805.fc34.x86_64.rpm 15M
-rw-rw-r--. 1 fcc fcc 15M Aug 5 03:00
kernel-devel-5.13.6-200.0805.fc34.x86_64.rpm 42M -rw-rw-r--. 1 fcc
fcc 42M Aug 5 03:00 kernel-modules-5.13.6-200.0805.fc34.x86_64.rpm
2.3M -rw-rw-r--. 1 fcc fcc 2.3M Aug 5 03:00
kernel-modules-extra-5.13.6-200.0805.fc34.x86_64.rpm 272K -rw-rw-r--.
1 fcc fcc 272K Aug 5 03:00
kernel-modules-internal-5.13.6-200.0805.fc34.x86_64.rpm
After doing `rpm -ivh kernel-5* kernel-core-5* kernel-modules-5*
kernel-devel-5*`, it booted OK.
Good job.
I think it would be better to use dnf -C install so that the package
manager knows about the packages in its database. It is possible that
it will refresh its database from the rpm database, though it didn't in
the past. If you do a dnf list installed kernel\* , are your new
packages in the list.
Anyway, all's well that ends well.
9:33 p.m.
rpm -qa and dnf list installed return the same result.
$ rpm -qa kernel\*
kernel-core-5.11.12-300.fc34.x86_64
kernel-modules-5.11.12-300.fc34.x86_64
kernel-5.11.12-300.fc34.x86_64
kernel-modules-extra-5.11.12-300.fc34.x86_64
kernel-core-5.13.6-200.fc34.x86_64
kernel-modules-5.13.6-200.fc34.x86_64
kernel-5.13.6-200.fc34.x86_64
kernel-headers-5.13.3-200.fc34.x86_64
kernel-modules-extra-5.13.6-200.fc34.x86_64
kernel-srpm-macros-1.0-4.fc34.noarch
kernel-core-5.13.6-200.0805.fc34.x86_64
kernel-modules-5.13.6-200.0805.fc34.x86_64
kernel-5.13.6-200.0805.fc34.x86_64
kernel-devel-5.13.6-200.0805.fc34.x86_64
$ dnf list intalled kernel\*
Fedora 34 - x86_64 - Updates 6.6
kB/s | 6.0 kB 00:00
Fedora 34 - x86_64 - Updates 382
kB/s | 444 kB 00:01
Fedora Modular 34 - x86_64 - Updates 22
kB/s | 5.9 kB 00:00
Installed Packages
kernel.x86_64 5.11.12-300.fc34
@anaconda
kernel.x86_64 5.13.6-200.fc34
@updates
kernel.x86_64 5.13.6-200.0805.fc34
@System
kernel-core.x86_64 5.11.12-300.fc34
@anaconda
kernel-core.x86_64 5.13.6-200.fc34
@updates
kernel-core.x86_64 5.13.6-200.0805.fc34
@System
kernel-devel.x86_64 5.13.6-200.0805.fc34
@System
kernel-headers.x86_64 5.13.3-200.fc34
@updates
kernel-modules.x86_64 5.11.12-300.fc34
@anaconda
kernel-modules.x86_64 5.13.6-200.fc34
@updates
kernel-modules.x86_64 5.13.6-200.0805.fc34
@System
kernel-modules-extra.x86_64 5.11.12-300.fc34
@anaconda
kernel-modules-extra.x86_64 5.13.6-200.fc34
@updates
kernel-srpm-macros.noarch 1.0-4.fc34
@fedora
Available Packages
Regarding the kernel.spec issue, I reported it as
https://bugzilla.redhat.com/show_bug.cgi?id=1990129
Change the below from 1 to 0 allow rpmbuild to finish building the kernel RPM packages.
diff kernel.spec.dist kernel.spec.works
202c202
< %define with_configchecks %{?_without_configchecks: 0}
%{?!_without_configchecks: 1}
---
%define with_configchecks %{?_without_configchecks: 0}
%{?!_without_configchecks: 0}
If I want to learn how to read kernel.spec, where should I start?
10:43 a.m.
On Thu, 05 Aug 2021 02:33:57 -0000
"Sampson Fung" <sampsonfung(a)gmail.com> wrote:
rpm -qa and dnf list installed return the same result.
Thanks for the info, looks like you are in business.
Regarding the kernel.spec issue, I reported it as
https://bugzilla.redhat.com/show_bug.cgi?id=1990129
Change the below from 1 to 0 allow rpmbuild to finish building the
kernel RPM packages.
diff kernel.spec.dist kernel.spec.works
202c202
< %define with_configchecks %{?_without_configchecks: 0}
%{?!_without_configchecks: 1} ---
> %define with_configchecks %{?_without_configchecks: 0}
> %{?!_without_configchecks: 0}
It might get accepted, though the policy of the fedora kernel team has
been that anyone who builds their own kernels is on their own. It
makes sense because there are so many combinatorial possibilities.
But maybe it has changed.
If I want to learn how to read kernel.spec, where should I start?
Well, the first thing is to understand the spec file organization.
https://docs.fedoraproject.org/en-US/Fedora_Draft_Documentation/0.1/html/...
I'm not aware of any spec file documentation specific to the kernel. I
think it is institutional awareness within the fedora kernel team. You
can create a new thread here on the kernel list with something like
"can you point me to documentation of the kernel spec file" as the
subject, and maybe someone with more knowledge than me will give you
links to such documentation, if it exists.
785
days inactive
794
days old
kernel@lists.fedoraproject.org
27 comments
3 participants
participants (3)
-
PGNet Dev -
Sampson Fung -
stan