kernel compiling in woof-ce

Under development: PCMCIA, wireless, etc.
Message
Author
User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

#521 Post by peebee »

Adding to stemsee's excellent explanation....

@gyro has a project which is progressing very successfully to replace aufs with overlayfs - http://www.murga-linux.com/puppy/viewtopic.php?t=110636 - as a fallback if the Japanese guy "Junjiro. R. Okajima" ever stops developing aufs - my kernels (and others) have overlayfs configured so they can be used with @gyro's experiments.....
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

stemsee

#522 Post by stemsee »

I have been testing this on BionicDog, the devx of which is empty in terms of kernel compiling deps, luckily the script installs fakeroot, kernel-package, headers, etc but, unlike previous debiandog, does not compile as make-kpkg not found!

Well, a few fixes in place but more to do! Good for building single package at a time.
Attachments
nubuild.sh.gz
nubuild script
(21.26 KiB) Downloaded 213 times

Dry Falls
Posts: 616
Joined: Tue 16 Dec 2014, 23:37
Location: Upper Columbia

#523 Post by Dry Falls »

does not compile as make-kpkg not found!
These newer scripts put the kernel headers in the kernel sources module. I miss having it in the kernel modules sfs. Put it there manually. Probably a good idea NOT to put it in devx, but why doesn't woofCE place it in the zdrive?

This new script continues with some errors (mostly typos) from the previous, although both work. Here are some changes I made you might be interested. Removed "carriage returns" (unwrapped lines) and fixed some tar options. Also removed a hyphen so that md5sum works on huge package. One tar still returns an error message during the aufs build:
Creating the Aufs sources tarball
tar: Cowardly refusing to create an empty archive
Try 'tar --help' or 'tar --usage' for more information.
Extracting the Aufs sources
and later
Failed to patch the aufs-util sources.
tar: ../aufs-util: Cannot open: Is a directory
tar: Error is not recoverable: exiting now
aufs-util is in dist
Attachments
diffing.txt.gz
real gz. click to unzip
(702 Bytes) Downloaded 190 times

stemsee

#524 Post by stemsee »

I will check out your scipt Dry Falls. The headers are supposed to go in the devx! I opted for the kernel-modules.sfs, against 01micko's advice, having no automatic way to put them in any given devx (wherever it resides on the hdd). So this time, I put them in the sources.sfs, in error, mixing up sources for devx!

Jamesbond had clarified that there are two types of header files, one of which is for development, those that are in the package with kernel sources. Probably should build their own headers.sfs package.

Dry Falls
Posts: 616
Joined: Tue 16 Dec 2014, 23:37
Location: Upper Columbia

#525 Post by Dry Falls »

stemsee wrote:The headers are supposed to go in the devx! I opted for the kernel-modules.sfs, against 01micko's advice, having no automatic way to put them in any given devx
My opinion: you were right in the first place. If in the zdrive or initrd, they take precedence during bootup (>switchroot) so you've got the right modules loaded no matter what is in the devx which loads later. (As you've discovered, you can use the devx from another distro to access some programs). If they are located in the devx, you will have to remaster that file for every kernel change. If they are in the kernel sources sfs, you will have to load it with the devx every time you want to compile. We're only talking 1 megabite (compressed) so there isn't really a "keep the size down" argument available. It's not just an issue of remastering the devx but eliminating all that bandwidth usage uploading the devx over and over for every kernel change. I appreciate that speculations on bandwidth/cloud usage are the only thing keeping wall street afloat (and therefore, the general economy), but that's their problem, not mine. When you think about it, all so-called security issues boil down to moving money. It's for the greater good (but never mine!)

df

stemsee

#526 Post by stemsee »

Sharing a folder with 4.17.4-x86_64 huge,sources,vmlinuz,kernel-modules.sfs, md5

https://drive.google.com/open?id=1qFWJC ... VZEY5PP9vY

stemsee

#527 Post by stemsee »

Corrected typos nubuild.sh
Attachments
nubuild.sh.gz
(21.56 KiB) Downloaded 438 times

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

Fixed.

#528 Post by peebee »

Fixed - see below

Anybody managed to compile a 32-bit 4.14 series kernel after 4.14.56 using gcc-7.3.0 or later?

I get:

Code: Select all

ld: fs/aufs/xino.o: in function `au_xino_read':
xino.c:(.text+0xc49): undefined reference to `__divmoddi4'
ld: fs/aufs/xino.o: in function `au_xino_write':
xino.c:(.text+0xe6b): undefined reference to `__divmoddi4'
ld: fs/aufs/xino.o: in function `au_xino_do_set_br':
xino.c:(.text+0x18fd): undefined reference to `__divmoddi4'
ld: fs/aufs/xino.o: in function `au_xino_delete_inode':
xino.c:(.text+0x24bb): undefined reference to `__divmoddi4'
make: *** [Makefile:1016: vmlinux] Error 1
Error: failed to compile the kernel sources.
I was trying to build a 32-bit k4.14.67 with aufs-4.14.56+ when I first encountered this problem.

Thanks!
Last edited by peebee on Tue 04 Sep 2018, 05:35, edited 1 time in total.
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

User avatar
rockedge
Posts: 1864
Joined: Wed 11 Apr 2012, 13:32
Location: Connecticut, United States
Contact:

#529 Post by rockedge »

I am compiling 32 bit 4.14.67 with gcc 7.3.0 on a new Bionic 18.05 kernel 4.17.9 32 bit built with woof-CE

I will report when it finishes one way or another

build.conf

Code: Select all

kernel_ver=4.14.67

#x86_disable_pae=yes
x86_enable_pae=yes
#x86_set_i486=yes
x86_set_i686=yes

custom_suffix=

package_name_suffix=

##-----------------------------------------------------------------------

remove_sublevel=no

aufsv=4.14

LIBRE=0

### squashfs compression ###
## leave unset for the default of your mksquashfs binary
## run "mksquashfs --help" to find out options from compression
## for extra compression "-comp xz -Xbcj ia64" or "-comp xz -Xbcj x86" etc
## Consult the mksquashfs manual for more info.
## 'xz' / 'gzip' ..
COMP="-comp xz"

## Firmware tarballs repository
FW_URL=http://ftp.nluug.nl/ftp/pub/os/Linux/distr/puppylinux/firmware

## Kernel download mirrors
kernel_mirrors='https://www.kernel.org/pub/linux/kernel
ftp://ftp.ntu.edu.tw/linux/kernel
ftp://ftp.heanet.ie/pub/kernel.org/pub/linux/kernel
ftp://ftp.yandex.ru/pub/linux/kernel/
https://mirror.aarnet.edu.au/pub/ftp.kernel.org/linux/kernel
ftp://ftp.jaist.ac.jp/pub/Linux/kernel.org/linux/kernel
ftp://www.mirrorservice.org/pub/linux/kernel
ftp://ftp.be.debian.org/pub/linux/kernel'
Update
so far so good. 30 minutes into compiling

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

#530 Post by peebee »

Sorry - should have reported - a patch has been found:
https://github.com/sfjro/aufs4-standalo ... aaf094c60f

There is an aufs branch 4.14.56+
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

ozsouth
Posts: 858
Joined: Fri 01 Jan 2010, 22:08
Location: S.E Australia

#531 Post by ozsouth »

Peebee - should the aufsv= entry in build.sh read 4.14.56+
?

User avatar
rockedge
Posts: 1864
Joined: Wed 11 Apr 2012, 13:32
Location: Connecticut, United States
Contact:

#532 Post by rockedge »

should the aufsv= entry in build.sh read 4.14.56+
when I try to use the full version number for the aufsv= entry the build fails. It will work if I use aufsv=4.14

maybe I am formatting it wrong?

to report the compiling of the kernel 4.14.67 pae was successful!
using aufs=4.14

link to the finished kernel https://drive.google.com/open?id=1pWgnI ... JF9sD2nefR

md5 -> 43304d281e2052abb9ca38bbd565ee97 huge-4.14.67-upupbb.tar.bz2

sha256 -> 6a99cddfe906d0775a0d6a6d4223c5b61779ac931fea79aab0b9a1ae71ba0432 huge-4.14.67-upupbb.tar.bz2
Last edited by rockedge on Wed 05 Sep 2018, 00:18, edited 4 times in total.

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

#533 Post by peebee »

ozsouth wrote:Peebee - should the aufsv= entry in build.sh read 4.14.56+
?
Yes think so....
It has to be the name of one of the branches at
https://github.com/sfjro/aufs4-standalone
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

User avatar
rockedge
Posts: 1864
Joined: Wed 11 Apr 2012, 13:32
Location: Connecticut, United States
Contact:

#534 Post by rockedge »

I have the kernel 4.14.67 compiling with aufs=4.14.56+ set in the build.conf


seems to be working so far

User avatar
rockedge
Posts: 1864
Joined: Wed 11 Apr 2012, 13:32
Location: Connecticut, United States
Contact:

#535 Post by rockedge »

here is a link for kernel 4.14.67 built with aufs=4.14.56+ PAE enabled
if anyone would like to use it. I have not tested it yet.

https://drive.google.com/open?id=1zkoNr ... btKrp3mn9a

md5 -> 52abc3b0d3b1f8f93d73835707fa6d9e huge-4.14.67-upupbb.tar.bz2

sha256 -> 6a99cddfe906d0775a0d6a6d4223c5b61779ac931fea79aab0b9a1ae71ba0432 huge-4.14.67-upupbb.tar.bz2
Last edited by rockedge on Sat 08 Sep 2018, 14:15, edited 1 time in total.

User avatar
festus
Posts: 235
Joined: Wed 14 Jan 2015, 19:10

huge-4.14.67-upupbb

#536 Post by festus »

@rockedge

Thanks for the new kernel.

I am using it right now in upupbb-18.05+12 successfully, and it suspends and idles nicely. Everything I've tried works as intended. I will continue to use/test this kernel.

The MD5 checksum that you gave is correct with my download, but your sha256 checksum did NOT match with my dl'd kernel.
Here is my dl'd sha256: 6a99cddfe906d0775a0d6a6d4223c5b61779ac931fea79aab0b9a1ae71ba0432

btw, here is "Mainboard>CPU" from pupsysinfo:

Code: Select all

l1tf	: Mitigation	: PTE Inversion
meltdown	: Vulnerable
spec_store_bypass	: Vulnerable
spectre_v1	: Mitigation	: __user pointer sanitization
spectre_v2	: Mitigation	: Full generic retpoline

Thank you for the kernels you compile

bliss,
festus

User avatar
rockedge
Posts: 1864
Joined: Wed 11 Apr 2012, 13:32
Location: Connecticut, United States
Contact:

#537 Post by rockedge »

The MD5 checksum that you gave is correct with my download, but your sha256 checksum did NOT match with my dl'd kernel.
Here is my dl'd sha256: 6a99cddfe906d0775a0d6a6d4223c5b61779ac931fea79aab0b9a1ae71ba0432

my mistake !! I mixed up the version : the correct one is
6a99cddfe906d0775a0d6a6d4223c5b61779ac931fea79aab0b9a1ae71ba0432 huge-4.14.67-upupbb.tar.bz2

the one I posted belongs to another kernel! Sorry about that mistake.

User avatar
rockedge
Posts: 1864
Joined: Wed 11 Apr 2012, 13:32
Location: Connecticut, United States
Contact:

#538 Post by rockedge »

Here is a freshly compiled Real Time kernel 4.14.63-rt37
I used woof-CE to build a Tahr 6.0.6 using this real time low latency kernel

here is the link to download the kernel by itself or the Tahr-RT puppy ISO
http://rockedge.org/kernels/

Download huge-4.14.63-upupbb.tar.bz2
tahr-rt-6.0.6-uefi.iso
http://rockedge.org/kernels/

further information -> http://murga-linux.com/puppy/viewtopic. ... 33#1004033

stemsee

#539 Post by stemsee »

I am running 4.18.9-rt5 64bit kernel. rt patch is from 4.18.7 but is working fine. I used the config from BionicDog-64 *-34-generic, with a few minor tweeks. This has been compiled on FD-721 for atom cpu. Now running on my cherrytrail x5 hp x2 tablet, touch enabled. Seems faster!

During compile there was a power cut, but I manually completed compile and packaging, as sukk does not yet have a function to restart a compile from where it left off, but it should have. Compilation completed with full debug symbols @3+ GB ... stripped down to 200MB before compression, with big firmware bundle on-board..

I will post with sources later on!

Also managed some improvements in SUKK/nubuild.sh

stemsee

#540 Post by stemsee »

Sharing packages directory containing, huge, kernel-modules, vmlinuz, sources, md5s, for kernel-4.18.9-rt5-x86_64
https://drive.google.com/open?id=1ThHkC ... yr-ZqaSf6u
Attachments
2018-09-26-110504_774x150_scrot.png
(18.09 KiB) Downloaded 758 times

Post Reply