Ibiblio not synching with nluug? (Solved?)

Puppy related raves and general interest that doesn't fit anywhere else
Message
Author
User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

Ibiblio not synching with nluug? (Solved?)

#1 Post by peebee »

16-mar-17 - hopefully fixed

13-feb-17 - another problem?

8-jan-2017 - marked solved

31-dec-2016 - reopened

21-oct-2015 - now solved

19-oct-2015

Changes on ibiblio do not seem to be propagating down to the nluug mirror??

e.g.
http://distro.ibiblio.org/puppylinux/pu ... 4-6.0.3.9/

has not appeared on nluug

Does it still need BK to fix things like this??
Last edited by peebee on Thu 16 Mar 2017, 17:58, edited 6 times in total.
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

User avatar
01micko
Posts: 8741
Joined: Sat 11 Oct 2008, 13:39
Location: qld
Contact:

#2 Post by 01micko »

Servers often go down for maintenance, especially on Sundays. I always have trouble with Aarnet on Sundays!

Besides, Ibiblio is as fast as its ever been. I got a whopping 330 KB/s (massive eh? :lol: - and MAX). Why Oz is ranked 54th in the world.

Try UOC.
Puppy Linux Blog - contact me for access

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

#3 Post by peebee »

nluug is up - but is still not synching with ibiblio - so all "new stuff" is not there....
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

User avatar
01micko
Posts: 8741
Joined: Sat 11 Oct 2008, 13:39
Location: qld
Contact:

#4 Post by 01micko »

Send the Web master at NLUUG an email - unlikely, but she/he may not know.

EDIT: Send that email! It is up at Aarnet and that is always the last one to propagate, so there is a problem at NLUUG.
Puppy Linux Blog - contact me for access

User avatar
666philb
Posts: 3615
Joined: Sun 07 Feb 2010, 12:27
Location: wales ... by the sea

#5 Post by 666philb »

i noticed this when uploading tahr64.pets .... it took almost a week to go through to nluug
Bionicpup64 built with bionic beaver packages http://murga-linux.com/puppy/viewtopic.php?t=114311
Xenialpup64, built with xenial xerus packages http://murga-linux.com/puppy/viewtopic.php?t=107331

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

#6 Post by peebee »

email sent:
Subject: nluug not synching with ibiblio?
Date: Tue, 20 Oct 2015 09:44:03 +0100
From: PeeBee
To: info@nluug.nl


Good Morning

I am contacting you on behalf of the Puppy Linux community.

We have noticed that Puppy Linux changes on ibiblio.org are not propagating to the nluug mirror.

See: http://www.murga-linux.com/puppy/viewtopic.php?p=868385
for the discussion on the Puppy Linux forum.

We would be very grateful if you could investigate and resolve if possible?

Many thanks
Peter (peebee)
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

#7 Post by peebee »

Reply received from Mike Hulsman - thanks sent....
Quoting PeeBee:

> Good Morning
Morning.
>
> I am contacting you on behalf of the Puppy Linux community.
>
> We have noticed that Puppy Linux changes on ibiblio.org are not propagating to the nluug mirror.
Thanks for noticing, I missed that
>
> See: http://www.murga-linux.com/puppy/viewtopic.php?p=868385
> for the discussion on the Puppy Linux forum.
>
> We would be very grateful if you could investigate and resolve if possible?
It is resolved now, status is syncing right now.
The problem was a "hang" rsync process.
Not sure why the monitoring did not detected that. I will dig into that.
>
> Many thanks
> Peter (peebee)
Mike Hulsman
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

User avatar
01micko
Posts: 8741
Joined: Sat 11 Oct 2008, 13:39
Location: qld
Contact:

#8 Post by 01micko »

Hah! See?

It's not BK! I was the one who emailed Alex Dodson at Aarnet to get them to mirror Barry's Quirky (back when it first started) and later on FatDog. And you can thank mavrothal for the UOC mirror too.

:P
Puppy Linux Blog - contact me for access

User avatar
mavrothal
Posts: 3096
Joined: Mon 24 Aug 2009, 18:23

#9 Post by mavrothal »

01micko wrote: And you can thank mavrothal for the UOC mirror too.
I did not do anything other than asking someone down there a couple of years back.
Was it any problem with the UOC mirror, other than updates once a day so is usually a day late?
== [url=http://www.catb.org/esr/faqs/smart-questions.html]Here is how to solve your[/url] [url=https://www.chiark.greenend.org.uk/~sgtatham/bugs.html]Linux problems fast[/url] ==

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

Solved

#10 Post by peebee »

Problem has now been solved - 01micko has corrected some permissions on ibiblio and Mike Hulsman from nluug has restarted the synch mechanism.

Thanks to both.
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

User avatar
01micko
Posts: 8741
Joined: Sat 11 Oct 2008, 13:39
Location: qld
Contact:

#11 Post by 01micko »

mavrothal wrote:
01micko wrote: And you can thank mavrothal for the UOC mirror too.
I did not do anything other than asking someone down there a couple of years back.
Ah, but if you don't ask, you don't get. :wink: Thanks anyway. :)

mavrothal wrote:Was it any problem with the UOC mirror, other than updates once a day so is usually a day late?
No problem that I noticed.
Puppy Linux Blog - contact me for access

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

Re=opened

#12 Post by peebee »

Re-opened 31-dec-2016.....

All of the mirrors are failing to get updates since 22-dec-2016....

This has been discussed with the nluug sysop and a fault report sent to ibiblio - hopefully it will be sorted shortly....
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

#13 Post by peebee »

ibiblio has replied - see below....

I have sent the reply to nluug.nl....

BUT how do we contact the other mirror ops????
A new answer to the question ibiblio not synching with mirrors was posted by cmpalmer on ibiblio Answers:

Try switching from ibiblio.org to distro.ibiblio.org for that target.
$ rsync distro.ibiblio.org::

Welcome to the distro.ibiblio.org public rsync server.

You may download any of our distributions by using the appropriate module name. For example:

rsync -av distro.ibiblio.org::ubuntu/ /local/path/

If you are mirroring part or all of our distributions, please consider subscribing to our mirror announcement list: http://lists.ibiblio.org/mailman/listin ... io-mirrors

If you have problems or questions, please visit http://www.ibiblio.org/help/

Thanks!

blackarch blackarch cdlinux cdlinux epidemic epidemic fatdog fatdog fedora-enchilada Fedora the whole enchilada fedora-epel Extra Packages for Enterprise Linux fedora-linux-development Fedora Linux Core Development fedora-linux-releases Fedora Linux Core fedora-linux-updates Fedora Linux Updates hanthana hanthana mageia mageia manjaro manjaro openmandriva openmandriva pclinuxos pclinuxos puppylinux puppylinux puppyrus puppyrus quirky quirky smeserver smeserver tinycorelinux tinycorelinux tinyme tinyme unity unity
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

#14 Post by peebee »

May be fixed.....just in:
Answer by cmpalmer on ibiblio answers · 28 minutes ago
So it turns out there were two problems. One is that some indeterminate time in the past we switched to needing to use distro.ibiblio.org instead of ibiblio.org, and the second is that one of the backend rsync hosts was pulling the wrong puppet classes for its role. It was trying to be a fedora-only mirror server, but was in the load balancer as a distros host. I believe that both problems are now fixed. I hope folks will let me know if there are other problems (or if I'm wrong).
Contact has been achieved with the Greek mirror sysop - messages have been sent to the 2 Australian mirrors.....
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

#15 Post by peebee »

Last edited by peebee on Wed 04 Jan 2017, 11:59, edited 2 times in total.
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

User avatar
01micko
Posts: 8741
Joined: Sat 11 Oct 2008, 13:39
Location: qld
Contact:

#16 Post by 01micko »

I emailed Alex Dodson at Aarnet (also cc'd 'help' as it is the holiday period here). It has been out of sync for a month now.

I notice mirror.csclub.uwaterloo.ca and http://mirror.vcu.edu/ seem to have synced. Others should catch up soon.
Puppy Linux Blog - contact me for access

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

#17 Post by peebee »

01micko wrote:I emailed Alex Dodson at Aarnet (also cc'd 'help' as it is the holiday period here). It has been out of sync for a month now.

I notice mirror.csclub.uwaterloo.ca and http://mirror.vcu.edu/ seem to have synced. Others should catch up soon.
Thanks Mick

I've put a small test file in http://distro.ibiblio.org/puppylinux/test/ which I'll update for a few days to monitor how the mirrors are doing.....

They may not catch-up if they're not using rsync distro.ibiblio.org::
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

User avatar
01micko
Posts: 8741
Joined: Sat 11 Oct 2008, 13:39
Location: qld
Contact:

#18 Post by 01micko »

peebee wrote:They may not catch-up if they're not using rsync distro.ibiblio.org::
They should have been using that for a while now (2 years at least?).

You can back up the repo yourself if you like; if you have a spare +100GB partition. I'll be doing it myself one day.

Here is the disk usage at ibiblio.

Code: Select all

$ du -m .
279	./Lucid_Puppy
618	./Puppeee/Puppeee1.0
618	./Puppeee
262	./gecko-edubook-laptop
648	./pet_packages-2
4898	./pet_packages-slacko
458	./pet_packages-3
5949	./pet_packages-slacko14
892	./pet_packages-4
384	./pet_packages-5
305	./pupget_packages-1
61	./puppy-4.3.1/delta-files
105	./puppy-4.3.1/inside-iso
508	./puppy-4.3.1/special-puppies
883	./puppy-4.3.1
498	./puppy-4.3/special-puppies
91	./puppy-4.3/split-devx
106	./puppy-4.3/split-pup
900	./puppy-4.3
501	./puppy-5.0
2	./puppy-5.1.1/Updates
516	./puppy-5.1.1
249	./sfs4_modules-4
349	./sfs_modules-2
360	./sfs_modules-3
663	./sfs_modules-4
149	./sfs_modules-5
1023	./t2-dingo
229	./test/puppy-4.3.2-experimental1
145	./test/temp
345	./test/slacko/6081
358	./test/slacko/6101/woof-output-slacko-6.1.0.1
358	./test/slacko/6101
212	./test/slacko/6301
355	./test/slacko/6306
1613	./test/slacko
502	./test/slacko64/6060
414	./test/slacko64/6074
415	./test/slacko64/6081
390	./test/slacko64/6101
240	./test/slacko64/6301
247	./test/slacko64/6306
2553	./test/slacko64
3007	./test/xenialpup
1060	./test/tahrpup
8605	./test
268	./puppy-5.2.5
265	./puppy-5.2
611	./puppy-5.6
569	./puppy-5.2.8
471	./puppy-5.3.1
470	./puppy-5.3
337	./puppy-5.3.3
579	./puppy-5.4
436	./puppy-5.5
768	./pet_packages-common
155	./pet_packages-noarch
31	./pet_packages-drake
5818	./pet_packages-precise
949	./pet_packages-raring
90	./pet_packages-spup14
1	./pet_packages-squeeze
2306	./pet_packages-wary5
148	./pet_packages-wheezy
99	./arm/pet_packages-armv6
43	./arm/pet_packages-armv7
8	./arm/pet_packages-gap6
1	./arm/pet_packages-lucid
5	./arm/pet_packages-squeeze
203	./arm/releases/alpha
203	./arm/releases
34	./arm/sd-skeleton-images
758	./arm/test/tempdir1
204	./arm/test/raspi-sap-5.95-alpha1
205	./arm/test/raspi-sap6-5.96-alpha2
208	./arm/test/raspi-sap6-5.102-alpha3
208	./arm/test/raspi-sap6-5.105-alpha4
1582	./arm/test
1	./arm/pet_packages-jessie
1971	./arm
1	./sources/o
1	./sources/p
1	./sources/g
2	./sources/d
1	./sources/a
2	./sources/l
1	./sources/k
1	./sources/m
1	./sources/v
1	./sources/t
1	./sources/c
4	./sources/n
5	./sources/f
8	./sources/x
1	./sources/h
1	./sources/j
3	./sources/i
6	./sources/s
1	./sources/z
7	./sources/u
1	./sources/b
2	./sources/r
1	./sources/q
1	./sources/w
1	./sources/y
1	./sources/e
1	./sources/0
39	./sources
2028	./pet_packages-slacko6414
605	./puppy-slacko-5.7
945	./huge_kernels
1	./puppy-extra/slackware-14.1/puppy
1	./puppy-extra/slackware-14.1
1	./puppy-extra/dists/puppy/main/binary-i386
1	./puppy-extra/dists/puppy/main/binary-amd64
1	./puppy-extra/dists/puppy/main
1	./puppy-extra/dists/puppy
1	./puppy-extra/dists
1	./puppy-extra/pool/main
1	./puppy-extra/pool
1	./puppy-extra
101	./firmware
10724	./pet-packages-lucid
488	./puppy-tahr/iso/tahrpup64-6.0.3.9
394	./puppy-tahr/iso/tahrpup64-6.0.5
1	./puppy-tahr/iso/testing
2152	./puppy-tahr/iso/tahrpup -6.0-CE
3033	./puppy-tahr/iso
27	./puppy-tahr/quickpet
397	./puppy-tahr/kernels
4	./puppy-tahr/testing
3459	./puppy-tahr
6397	./pet_packages-tahr
3142	./pet_packages-tahr64
351	./puppy-slacko-6.3.0/32
385	./puppy-slacko-6.3.0/64
736	./puppy-slacko-6.3.0
115	./pet_packages-xenial
354	./puppy-slacko-6.3.2/32
391	./puppy-slacko-6.3.2/64
744	./puppy-slacko-6.3.2
64	./pet_packages-xenial64
76183	.
In megabytes, total at the bottom.

Cheers!
Puppy Linux Blog - contact me for access

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

#19 Post by peebee »

Marking this [SOLVED]
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

#20 Post by peebee »

Mirrors are not synching again....

Email from ibiblio:

Hi peebee,

A new comment on a ibiblio not synching with mirrors was posted by cmpalmer on ibiblio Answers:

TCP mirrors.ibiblio.org:rsync wlc
-> 172.27.205.17:rsync Masq 1 0 0
-> 172.27.205.18:rsync Masq 1 0 0

The view from our load balancer for this service shows the backend hosts up (and the backend hosts look fine), but zero clients. I think something is wrong on the load balancer and will be forcing a manual failover shortly.
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

Post Reply