Fedora Linux Support Community & Resources Center

Go Back   FedoraForum.org > Fedora 17/18 > Using Fedora
FedoraForum Search

Forgot Password? Join Us!

Using Fedora General support for current versions. Ask questions about Fedora and it's software that do not belong in any other forum.

Reply
 
Thread Tools Search this Thread Display Modes
  #1  
Old 31st May 2008, 06:17 PM
bingoUV Offline
Registered User
 
Join Date: May 2007
Posts: 245
download fedora 9 using rsync (to fix corrupted download)

Some mirrors of fedora listed here http://mirrors.fedoraproject.org/publiclist/Fedora/9/ specify rsync as a supported protocol in addition to http and ftp. How do I use it? Simply rsync -avrt <location> is asking for a password that I do not know.

I am looking for rsync because I have an almost completely downloaded DVD iso, but checksum is failing. I tried to fix it using bittorrent, and it seemed to work for a moment, but when I tried checksumming it again, it failed. Subsequently when I asked my bittorrent client(transmission) to "verify local data", one block had an error. Now that block is failing repeatedly for 2 hours.

Any other ideas are also welcome.

Last edited by bingoUV; 31st May 2008 at 06:19 PM.
Reply With Quote
  #2  
Old 31st May 2008, 06:36 PM
Seve's Avatar
Seve Offline
Retired Community Manager
 
Join Date: Oct 2004
Location: The GTA, Ontario, Canada
Age: 54
Posts: 12,376
Hello:

Never used rsync for a Fedora ISO download before, so I just tested it on a boot.iso image.

This what worked for me

rsync -av rsync://www.muug.mb.ca/pub/fedora/linux/releases/9/Fedora/i386/os/images/boot.iso /home/seve/Download
PHP Code:
Welcome to MUUG Online Network Accesscourtesy of the
Manitoba Unix User Group
.

For 
any questionsproblems, or concerns about this site,
please send e-mail to: <ftp@muug.mb.ca>.

Look under the /pub directory and subdirectories for files to download.

We are now also maintaining a mirror of selected sites (or a subset
thereof
), in the /mirror directory.  Look at the README file there
for details on what is being mirrored.

receiving file list ... done
boot
.iso

sent 150 bytes  received 119249695 bytes  942686.52 bytes
/sec
total size is 119234560  speedup is 1.00 
I can test it on another image if you like ?

Seve
__________________
Registered Linux User: #384977
.................................................. ............
See the Links below for more Help and those much wanted extras ... :)
Reply With Quote
  #3  
Old 31st May 2008, 06:57 PM
bingoUV Offline
Registered User
 
Join Date: May 2007
Posts: 245
I did this, where . is the directory containing the corrupted file. It is waiting for a long time doing a lot of IO, and slight network uploads. Hope it fixes the file
Code:
rsync -av rsync://www.muug.mb.ca/pub/fedora/linux/releases/9/Fedora/i386/iso/Fedora-9-i386-DVD.iso .
thanks
Reply With Quote
  #4  
Old 31st May 2008, 07:01 PM
Seve's Avatar
Seve Offline
Retired Community Manager
 
Join Date: Oct 2004
Location: The GTA, Ontario, Canada
Age: 54
Posts: 12,376
Hello:
It should work as I went ahead and downloaded a live image to test it again.

PHP Code:
time rsync -av rsync://www.muug.mb.ca/pub/fedora/linux/releases/9/Live/i686/Fedora-9-i686-Live.iso /home/seve/Download
Welcome to MUUG Online Network Accesscourtesy of the
Manitoba Unix User Group
.

For 
any questionsproblems, or concerns about this site,
please send e-mail to: <ftp@muug.mb.ca>.

Look under the /pub directory and subdirectories for files to download.

We are now also maintaining a mirror of selected sites (or a subset
thereof
), in the /mirror directory.  Look at the README file there
for details on what is being mirrored.

receiving file list ... done
Fedora
-9-i686-Live.iso

sent 152 bytes  received 724210589 bytes  1023619.42 bytes
/sec
total size is 724121600  speedup is 1.00

real    11m47.791s
user    0m3.176s
sys    0m5.165s

sha1sum Fedora-9-i686-Live.iso
3ea129ebce5fd55499a813aaa8a042735f2aad6d  Fedora
-9-i686-Live.iso 
Which agrees with http://www.muug.mb.ca/pub/fedora/lin...e/i686/SHA1SUM

Seve
__________________
Registered Linux User: #384977
.................................................. ............
See the Links below for more Help and those much wanted extras ... :)
Reply With Quote
  #5  
Old 31st May 2008, 07:05 PM
bingoUV Offline
Registered User
 
Join Date: May 2007
Posts: 245
can you corrupt the file a few bytes and run it again? Did you do such a thing ? I got the following message, and it is not downloading anything. Just slight uploads
Code:
Welcome to MUUG Online Network Access, courtesy of the
Manitoba Unix User Group.

For any questions, problems, or concerns about this site,
please send e-mail to: <ftp@muug.mb.ca>.

Look under the /pub directory and subdirectories for files to download.

We are now also maintaining a mirror of selected sites (or a subset
thereof), in the /mirror directory.  Look at the README file there
for details on what is being mirrored.

receiving file list ... done
Fedora-9-i386-DVD.iso
WARNING: Fedora-9-i386-DVD.iso failed verification -- update discarded (will try again).
Reply With Quote
  #6  
Old 31st May 2008, 07:17 PM
bingoUV Offline
Registered User
 
Join Date: May 2007
Posts: 245
No luck. The latest updates are :
Code:
receiving file list ... done
Fedora-9-i386-DVD.iso
WARNING: Fedora-9-i386-DVD.iso failed verification -- update discarded (will try again).
Fedora-9-i386-DVD.iso
ERROR: Fedora-9-i386-DVD.iso failed verification -- update discarded.

sent 1675861 bytes  received 718754 bytes  2383.89 bytes/sec
total size is 3580680192  speedup is 1495.31
rsync error: some files could not be transferred (code 23) at main.c(1385) [generator=2.6.9]
Seems to be a global Fedora 9 crisis. Is there any way I can figure out which part is corrupt, and download that segment it using wget?
Reply With Quote
  #7  
Old 31st May 2008, 07:25 PM
Seve's Avatar
Seve Offline
Retired Community Manager
 
Join Date: Oct 2004
Location: The GTA, Ontario, Canada
Age: 54
Posts: 12,376
Hello:
I had a copy of Fedora-9-i686-Live-KDE.iso that failed the sha1sum (originally downloaded with Ktorrent)
I placed that iso in the same directory and then kicked off
PHP Code:
rsync -av rsync://www.muug.mb.ca/pub/fedora/linux/releases/9/Live/i686/Fedora-9-i686-Live-KDE.iso /home/seve/Download
Welcome to MUUG Online Network Accesscourtesy of the
Manitoba Unix User Group
.

For 
any questionsproblems, or concerns about this site,
please send e-mail to: <ftp@muug.mb.ca>.

Look under the /pub directory and subdirectories for files to download.

We are now also maintaining a mirror of selected sites (or a subset
thereof
), in the /mirror directory.  Look at the README file there
for details on what is being mirrored.

receiving file list ... done
Fedora
-9-i686-Live-KDE.iso

sent 188673 bytes  received 673003241 bytes  922812.77 bytes
/sec
total size is 724975616  speedup is 1.08

real    12m9.034s
user    0m6.291s
sys    0m5.425s 
PHP Code:
[seve@fedora9 Download]$ sha1sum Fedora-9-i686-Live-KDE.iso
53e7a022f9f6bb8fc160f4785bddf1c10f317adb  Fedora
-9-i686-Live-KDE.iso 
And now the image passes the sha1sum test as it agrees to http://www.muug.mb.ca/pub/fedora/lin...e/i686/SHA1SUM.

This is the old version's
PHP Code:
[seve@fedora9 Fedora-9-i686-Live-KDE]$ sha1sum Fedora-9-i686-Live-KDE.iso
76875c18c8bb163e5e7667be6f974d24f25510af  Fedora
-9-i686-Live-KDE.iso 
Seve
__________________
Registered Linux User: #384977
.................................................. ............
See the Links below for more Help and those much wanted extras ... :)
Reply With Quote
  #8  
Old 31st May 2008, 07:30 PM
bingoUV Offline
Registered User
 
Join Date: May 2007
Posts: 245
cool. I'll try other servers then. Anyway Canada is far away for me.
Reply With Quote
  #9  
Old 31st May 2008, 07:34 PM
bingoUV Offline
Registered User
 
Join Date: May 2007
Posts: 245
How did you figure out the rsync URL rsync://www.muug.mb.ca/pub/fedora/linux/releases/9/Live/i686/Fedora-9-i686-Live-KDE.iso ? The mirrors list says rsync://rsync.muug.mb.ca/fedora-enchilada/linux is the URL ?
Reply With Quote
  #10  
Old 31st May 2008, 07:56 PM
Seve's Avatar
Seve Offline
Retired Community Manager
 
Join Date: Oct 2004
Location: The GTA, Ontario, Canada
Age: 54
Posts: 12,376
Hello:
I just picked the first mirror I saw with rsync, then I just replaced the http with rsync ... maybe just lucky but it seemed to work fine ?

Seve

Edit:
I also found this one works as well

rsync -av rsync://anonymous@ftp.pbone.net/fedora/linux/releases/9/Live/x86_64/Fedora-9-x86_64-Live.iso
__________________
Registered Linux User: #384977
.................................................. ............
See the Links below for more Help and those much wanted extras ... :)

Last edited by Seve; 31st May 2008 at 08:22 PM.
Reply With Quote
  #11  
Old 1st June 2008, 09:47 AM
bingoUV Offline
Registered User
 
Join Date: May 2007
Posts: 245
The problem is with my sha1sum. Maybe torrent clients also call the same library/executable, so they are also helpless. In quick succession, sha1sum gives different values for the same file. File is not being modified in the meantime , torrent clients are closed, rsync has finished.
Code:
$ sha1sum Fedora-9-i386-DVD.iso                         290473d13c8be0cec9fe11aaeec283b036ae7a91  Fedora-9-i386-DVD.iso
$ vim SHA1SUM
$ sha1sum Fedora-9-i386-DVD.iso
4846eb3769ca81830aeec1e93a1881113f0bca46  Fedora-9-i386-DVD.iso
$ sha1sum Fedora-9-i386-DVD.iso
05b947c7ff7ee5068589bd46374353bff8e5a9fc  Fedora-9-i386-DVD.iso
sha1sum is supposed to be constant for a file, right?
Reply With Quote
  #12  
Old 1st June 2008, 10:00 AM
bingoUV Offline
Registered User
 
Join Date: May 2007
Posts: 245
same thing happens when I boot up a knoppix live CD. Hardware problem? Everything is working fine otherwise.
Code:
knoppix@Knoppix:/media/sdb5/images/linux/fixed$ sha1sum Fedora-9-i386-DVD.iso
89b2a7d9dc6d6d828e5455884801179c337fc888  Fedora-9-i386-DVD.iso
knoppix@Knoppix:/media/sdb5/images/linux/fixed$ sha1sum Fedora-9-i386-DVD.iso
466d3f39b8371f2112da38a0a1c71d7d3ee14f4b  Fedora-9-i386-DVD.iso
knoppix@Knoppix:/media/sdb5/images/linux/fixed$ sha1sum Fedora-9-i386-DVD.iso
a6d18b07ab323f0e1e1c77bfc9587e49e289fb2c  Fedora-9-i386-DVD.iso
Reply With Quote
Reply

Tags
corrupted, download, fedora, fix, rsync

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
http Download site, instead of FTP Download Bone Servers & Networking 3 23rd May 2006 05:03 PM
how to download only newer updates with rsync? shams Servers & Networking 1 19th May 2006 10:53 PM
Corrupted Download Someguy222 Installation and Live Media 2 13th November 2005 06:13 AM


Current GMT-time: 08:23 (Friday, 24-05-2013)

TopSubscribe to XML RSS for all Threads in all ForumsFedoraForumDotOrg Archive
logo

All trademarks, and forum posts in this site are property of their respective owner(s).
FedoraForum.org is privately owned and is not directly sponsored by the Fedora Project or Red Hat, Inc.

Privacy Policy | Term of Use | Posting Guidelines | Archive | Contact Us | Founding Members

Powered by vBulletin® Copyright ©2000 - 2012, vBulletin Solutions, Inc.

FedoraForum is Powered by RedHat