SFS-Combiner - merge some squashfs addons

Stuff that has yet to be sorted into a category.
Message
Author
User avatar
MU
Posts: 13649
Joined: Wed 24 Aug 2005, 16:52
Location: Karlsruhe, Germany
Contact:

SFS-Combiner - merge some squashfs addons

#1 Post by MU »

Puppy allows to use huge programs like OpenOffice without "installation".
You just download openoffice_301.sfs to the "/" folder of your harddrive (that where your pup_save is located).
Then you choose this sfs in the bootmanager and reboot - now you can use OpenOffice.
Very simple.

You also add Acrobat_301.sfs.
And devx_301.sfs.
And KDE_301.sfs.

You do?
No.

Because Puppy supports to load only 3 of them.

The solution:
You build one new, big personal sfs from them.

Sounds complicated?
Well, this is what I wrote this utility for.

Lets start:
First, be shure the files you want to use, are not mounted yet.
If they are mounted, uncheck them first in the bootmanager, and reboot.

Now start SFS-Combiner, and your favourite filemanager, like Rox.
Drag the desired files on the file-list:

screenshot:
Image

Then click on the button below.
Now it will check, if all files can be mounted, and if you have enough temporary diskspace.

If so, then it copies the files from your .sfs files to a temporary folder, and builds a new sfs.
Then the temporary files are deleted again.
Important: then remove or rename new_xxx.sfs, or it will be overwritten next time!
(Fixme: should add a warning).

Screenshot: SFS-Combiner copies files:

Image

Screenshot: SFS-Combiner builds the new sfs::

Image


IMPORTANT:
To store temporary files, you must have a drive with a LINUX filesystem.
Windows drives do not work.

If you do not want to create a Linux-partition, try to format a USB-Stick with a Linux filesystem.
Use gparted or the comandline to do that.

This will do it for sda1 (WARNING: all files on that drive are DELETED!)
mkfs.ext3 /dev/sda1


Download:
http://dotpups.de/puppy3/dotpups/System ... mbiner.pup
Mirror:
http://puppyfiles.ca/dotpupsde/puppy3/d ... mbiner.pup

Requires Gtkbasic:
http://dotpups.de/puppy3/dotpups/Progra ... ic-003.pup
Mirror:
http://puppyfiles.ca/dotpupsde/puppy3/d ... ic-003.pup

I just tested it in Muppy 008.2 (Puppy 301), but it should work in the "2" and "4" series, too.

UPDATE:
Here is a DotPET for Puppy 4 (Dingo).
It includes SFS-Combiner and GtkBasic003.
http://puppyfiles.ca/dotpupsde/puppy4/d ... sic003.pet
mirror:
http://dotpups.de/puppy4/dotpups/System ... sic003.pet


Tip for advanced users:
To add files manually:
edit:
/usr/local/SFS-Combiner/resource/buildsfs

Add after "#!/bin/bash":

Code: Select all

xmessage -center "You now could add some more files to $1/tempfiles/
click ok to build the sfs."
So now there will be a message before the final sfs is built.
Before you click on "ok", you could add some files.

And here is a small tool to add PETs to a SFS:
http://www.murga-linux.com/puppy/viewto ... 076#198076


Mark
Last edited by MU on Fri 16 May 2008, 15:12, edited 6 times in total.

Matu
Posts: 48
Joined: Thu 08 Feb 2007, 11:42
Location: Europe, Hungary

#2 Post by Matu »

Thanks for this great tool. I will test it under 3.00 and give you a feedback here about its functionality.

Matu

User avatar
HairyWill
Posts: 2928
Joined: Fri 26 May 2006, 23:29
Location: Southampton, UK

#3 Post by HairyWill »

cool, nice idea

because I always ask for more :-)
how does it handle collisions, might want to make it clear whether the first or the last gets priority

How about a mysquash builder that converts your pup_save into a sfs. Sometimes I just merge my pup_save into the pup_xx.sfs. I'm not sure that many people would use this I'm just trying to establish as many software patents as I can :-) . Maybe I'd better move out of the EU first.
Will
contribute: [url=http://www.puppylinux.org]community website[/url], [url=http://tinyurl.com/6c3nm6]screenshots[/url], [url=http://tinyurl.com/6j2gbz]puplets[/url], [url=http://tinyurl.com/57gykn]wiki[/url], [url=http://tinyurl.com/5dgr83]rss[/url]

User avatar
MU
Posts: 13649
Joined: Wed 24 Aug 2005, 16:52
Location: Karlsruhe, Germany
Contact:

#4 Post by MU »

how does it handle collisions, might want to make it clear whether the first or the last gets priority
Files from the upper sfs will be overwritten by files from the lower ones in the filelist.
How about a mysquash builder that converts your pup_save into a sfs
Sounds reasonable.
I'll add it this week.

We have Carniaval here in southern germany.
In northern germany (where I come from), it is not celebrated, so I will go to have a look, it is the first time I see it "live" :)


Thanks for the good suggestion :)
Mark

User avatar
HairyWill
Posts: 2928
Joined: Fri 26 May 2006, 23:29
Location: Southampton, UK

#5 Post by HairyWill »

MU wrote:We have Carniaval here in southern germany.
In northern germany (where I come from), it is not celebrated, so I will go to have a look, it is the first time I see it "live" :)
I have friends in the swartzwald, though I've never been there during carnival myself. Will you be wearing a dress and make-up? :wink:
Will
contribute: [url=http://www.puppylinux.org]community website[/url], [url=http://tinyurl.com/6c3nm6]screenshots[/url], [url=http://tinyurl.com/6j2gbz]puplets[/url], [url=http://tinyurl.com/57gykn]wiki[/url], [url=http://tinyurl.com/5dgr83]rss[/url]

User avatar
Béèm
Posts: 11763
Joined: Wed 22 Nov 2006, 00:47
Location: Brussels IBM Thinkpad R40, 256MB, 20GB, WiFi ipw2100. Frugal Lin'N'Win

#6 Post by Béèm »

Maybe he is on this picture. :wink:
Attachments
karneval-1926218-carnival_parade-Karlsruhe.jpg
(48.28 KiB) Downloaded 12132 times
Time savers:
Find packages in a snap and install using Puppy Package Manager (Menu).
[url=http://puppylinux.org/wikka/HomePage]Consult Wikka[/url]
Use peppyy's [url=http://wellminded.com/puppy/pupsearch.html]puppysearch[/url]

User avatar
cb88
Posts: 1165
Joined: Mon 29 Jan 2007, 03:12
Location: USA
Contact:

#7 Post by cb88 »

Right on target MU keep up the good work :-) ... Take care at carnaval... at least in Brazil a lot of people get hurt/killed during carnaval....
Taking Puppy Linux to the limit of perfection. meanwhile try "puppy pfix=duct_tape" kernel parem eater.
X86: Sager NP6110 3630QM 16GB ram, Tyan Thunder 2 2x 300Mhz
Sun: SS2 , LX , SS5 , SS10 , SS20 ,Ultra 1, Ultra 10 , T2000
Mac: Platinum Plus, SE/30

Leachim
Posts: 229
Joined: Sun 27 May 2007, 23:04

#8 Post by Leachim »

Merging the base-file (squashfs) and the save-file (ext2) works really nice. I do this every few weeks and start again with the new (merged) base file and an empty save-file. To date my base-file has grown to 1.8 GB (compressed - without compression it would be 5GB) and my save-file is 2 GB.

I want to rewrite the save-script to create new sfs-files instead of updating a save file. This will lead to many sfs-files mounted one above the other. So the sfs-files will have to be merged occasionally.

The big advantage of this new approach will be the possibility to "backtrack" to any save-point if things went wrong.

ICPUG
Posts: 1308
Joined: Mon 25 Jul 2005, 00:09
Location: UK

#9 Post by ICPUG »

MU - Brilliant Idea!!

Now we don't need all these versions of Puppy around - some with Opera, some with SeaMonkey, some with Firefox, ...

Just a base version of Puppy and lots of SFS files:

Pick one or more from each group:

Browser: SeaMonkey; Opera; Firefox
Office: OpenOffice ; AbiWord+Gnumeric
Media Player: Gxine; MPlayer; VNC
Developer Environment: TCL; Puppy BASIC; ...
Game Pack: ??; ??
...

Use your SFS Combiner and, voila, your own preference of Puppy!

Great - Great - Great

ICPUG

User avatar
MU
Posts: 13649
Joined: Wed 24 Aug 2005, 16:52
Location: Karlsruhe, Germany
Contact:

#10 Post by MU »

Yes, the flexibility of sfs files is one of the advantages of Puppy.

You also could add an option/info to show how to add own files.
So you could use it to create highly-compressed archives of your Photo-collections or such.
Different to normal packagers, these archives need not to be extracted with an external program like Xarchive or winzip.
You just select your archive in the bootmanager, and can use all files in it.
Or you click on it in Rox to mount it (what would be ok for Photos, as they don't need to be merged in the unionfs-filesystemstructure).

There just was the limit of 3 files, which now is no more issue.
At least if you have a Linux-partition for the temporary files.
SFS-Combiner just lists Linux-drives, so that permissions and symlinks are preserved.
I should add an option to select Windows-drives.

I could then create a .2fs file there with own ext filesystem to store the temporary files (similar to pup_save.2fs, but just temporary).
It would be deleted again after the squashfs was built.

I will have a look at that in some days, I first want to finish the KDE-3.5.8.sfs.
Mark

Ps: Carniaval was kind of boring. And no, I was not painted. Just the people on the trucks/waggons had costumes and such.
I'd really like to see the ones in Venice and Rio somewhen, they are much different :)

User avatar
HairyWill
Posts: 2928
Joined: Fri 26 May 2006, 23:29
Location: Southampton, UK

#11 Post by HairyWill »

Leachim wrote:Merging the base-file (squashfs) and the save-file (ext2) works really nice. I do this every few weeks and start again with the new (merged) base file and an empty save-file.
It is important to note there is a cost to this, for the benefit of others (I am sure that you are aware of it already):
either your base squash will no longer load into RAM
or if you have enough RAM you have to wait on boot for the entire squash to load into RAM.
Will
contribute: [url=http://www.puppylinux.org]community website[/url], [url=http://tinyurl.com/6c3nm6]screenshots[/url], [url=http://tinyurl.com/6j2gbz]puplets[/url], [url=http://tinyurl.com/57gykn]wiki[/url], [url=http://tinyurl.com/5dgr83]rss[/url]

User avatar
MU
Posts: 13649
Joined: Wed 24 Aug 2005, 16:52
Location: Karlsruhe, Germany
Contact:

#12 Post by MU »

Yes HairyWill, that is important.
For Muppy, we have 2 versions.
One "standard", that has a 400 MB main.sfs and a Mini, where huge apps are put in an addon.sfs, so that main.sfs remains small (<200 MB).
The Mini is faster, as this solution is better concerning memory-management.
We just offer the "standard" version as "appetizer", because it can run directly from CD.
I encourage Muppy-users, to switch to the Mini, if they want a frugal installation.

So for personal files I would not merge with main.sfs, but use a personal.sfs.
This also should make it easier to upgrade later to newer versions of Puppy.

Mark

NathanO
Posts: 210
Joined: Fri 23 Feb 2007, 00:03
Location: San Antonio, TX

#13 Post by NathanO »

MU,

I like the idea of the 'personal.sfs'. Could you present this to Barry for future Puppy's?

NathanO

User avatar
MU
Posts: 13649
Joined: Wed 24 Aug 2005, 16:52
Location: Karlsruhe, Germany
Contact:

#14 Post by MU »

Barry certainly will have a look, once he is back from holiday.
Until then I'd like to add some refinements.

E.g. a tool could be added, that scans your pup_save.2fs for large folders like /root/Mail (if you use the sylpheed EMail client, that can be huge).
Then it could offer in a dialog, to store these folders in a personal.sfs and delete them in pup_save.2fs.

I just have re-combined my devx.sfs, and copied by hand /root/Mail/ to the tempfolder, before the final sfs was built.
I then renamed /root/Mail and deleted it after a reboot (I think you must not delete immedeatly, because then unionfs would mark it with .wh -files, but I must test that in detail).
Now my old Mails are together with the devx in this new personal.sfs and I even could access them with a fresh Puppy-setup.
I have gained 120 MB of free space in my pup_save.2fs like this.
If you installed a lot of huge dotpups, this might bring you back even more space.
It has to be tested carefully though, before I will add this as a grafical option to the SFS-Combiner.
Unionfs can be somewhat tricky, and I also want to keep the grafical interface simple.
I might add a "neewbee" and "advanced" option for this.

Mark

big_bass
Posts: 1740
Joined: Mon 13 Aug 2007, 12:21

#15 Post by big_bass »

ICPUG wrote:MU - Brilliant Idea!!

Now we don't need all these versions of Puppy around - some with Opera, some with SeaMonkey, some with Firefox, ...

Just a base version of Puppy and lots of SFS files:

Pick one or more from each group:

Browser: SeaMonkey; Opera; Firefox
Office: OpenOffice ; AbiWord+Gnumeric
Media Player: Gxine; MPlayer; VNC
Developer Environment: TCL; Puppy BASIC; ...
Game Pack: ??; ??
...

Use your SFS Combiner and, voila, your own preference of Puppy!

Great - Great - Great

ICPUG
:D :D :D :D :D :D :D :D :D :D :D :D :D :D :D :D :D :D :D :D

Thank you !

....and thank you for all the wonderful dot pups too
I use them frequently

big_bass

User avatar
Béèm
Posts: 11763
Joined: Wed 22 Nov 2006, 00:47
Location: Brussels IBM Thinkpad R40, 256MB, 20GB, WiFi ipw2100. Frugal Lin'N'Win

#16 Post by Béèm »

My biggest problem is still to convert a .pup to a .pet.
Attempts I made failed miserably.
If I understand well a gettxt package is missing, no?
Time savers:
Find packages in a snap and install using Puppy Package Manager (Menu).
[url=http://puppylinux.org/wikka/HomePage]Consult Wikka[/url]
Use peppyy's [url=http://wellminded.com/puppy/pupsearch.html]puppysearch[/url]

big_bass
Posts: 1740
Joined: Mon 13 Aug 2007, 12:21

#17 Post by big_bass »

Béèm wrote:My biggest problem is still to convert a .pup to a .pet.
The Puppy Master made a page to explain how

http://puppylinux.com/development/createpet.htm


the easy way to do it
download this
http://dotpups.de/dotpups/System_Utilit ... tor-MU.pet

what I do is first install the dotpup then run the app I linked you to above Dotpet-creator-MU
Last edited by big_bass on Thu 07 Feb 2008, 01:31, edited 1 time in total.

User avatar
Béèm
Posts: 11763
Joined: Wed 22 Nov 2006, 00:47
Location: Brussels IBM Thinkpad R40, 256MB, 20GB, WiFi ipw2100. Frugal Lin'N'Win

#18 Post by Béèm »

Well yes, I followed that explanation and used pup2pet.
But somehow the .pet created isn't installable.
I do this in dingo, maybe that's why.
Time savers:
Find packages in a snap and install using Puppy Package Manager (Menu).
[url=http://puppylinux.org/wikka/HomePage]Consult Wikka[/url]
Use peppyy's [url=http://wellminded.com/puppy/pupsearch.html]puppysearch[/url]

big_bass
Posts: 1740
Joined: Mon 13 Aug 2007, 12:21

#19 Post by big_bass »

Béèm wrote:But somehow the .pet created isn't installable.
I do this in dingo, maybe that's why.

reported problem
http://www.murga-linux.com/puppy/viewto ... 15&t=26040


ftp://ibiblio.org/pub/linux/distributio ... 0.14.5.pet

big_bass
Attachments
gettext-0.14.5.tar.gz
(20.79 KiB) Downloaded 1295 times

User avatar
Béèm
Posts: 11763
Joined: Wed 22 Nov 2006, 00:47
Location: Brussels IBM Thinkpad R40, 256MB, 20GB, WiFi ipw2100. Frugal Lin'N'Win

#20 Post by Béèm »

Thank you for the gettext package.
I gave it a try altho Barry announced that gettext would be in his next release.

I still have no joy.

I converted two packages, but on installation of the created pet, I get the message "not enough free diskspace you have MB you need"

One of them was only 14K so that can't be a problem.

Maybe a problem still in the pup2get script?
Time savers:
Find packages in a snap and install using Puppy Package Manager (Menu).
[url=http://puppylinux.org/wikka/HomePage]Consult Wikka[/url]
Use peppyy's [url=http://wellminded.com/puppy/pupsearch.html]puppysearch[/url]

Post Reply