I'm still having problems downloading from liberty.edu . Ex, installing kdenlive:
Total download size: 13 M Is this ok [y/N]: y Downloading Packages: (1/15): GraphicsMagick-1.1.14-4.fc11.x86_64.rpm | 2.4 MB 00:05 (2/15): dvdauthor-0.6.14-8.fc11.x86_64.rpm | 187 kB 00:00 (3/15): dvgrab-3.4-2.fc11.x86_64.rpm | 133 kB 00:01 (4/15): ffmpeg-0.5-2.fc11.x86_64.rpm | 160 kB 00:01 (5/15): ffmpeg-libs-0.5-2.fc11.x86_64.rpm | 2.5 MB 00:15 (6/15): imlib2-1.4.2-4.fc11.x86_64.rpm | 228 kB 00:01 (7/15): jack-audio-connection-kit-0.116.1-5.fc11.x86_64. | 203 kB 00:01 (8/15): jack-audio-connection-kit-example-clients-0.116. | 42 kB 00:00 (9/15): kdenlive-0.7.4-2.fc11.x86_64.rpm | 2.6 MB 00:15 (10/15): libfreebob-1.0.11-5.fc11.x86_64.rpm | 160 kB 00:01 (11/15): mlt-0.4.2-1.fc11.x86_64.rpm | 144 kB 00:30 ... http://mirror.liberty.edu/pub/rpmfusion/free/fedora/updates/11/x86_64/mlt-0....: [Errno 4] Socket Error: timed out Trying other mirror. (11/15): mlt-0.4.2-1.fc11.x86_64.rpm | 3.4 MB 00:09 (12/15): openjpeg-libs-1.3-4.fc11.x86_64.rpm | 66 kB 00:00 (13/15): recordmydesktop-0.3.8.1-1.fc11.x86_64.rpm | 65 kB 00:00 (14/15): schroedinger-1.0.6-1.fc11.x86_64.rpm | 233 kB 00:01 (15/15): sox-14.2.0-2.fc11.x86_64.rpm | 458 kB 00:02 ---------------------------------------------------------------------------------------- Total 137 kB/s | 13 MB 01:35
I very often get those "Socket Error: timed out" interruptions. How do I switch mirror for rpmfusion?
On Fri, Jul 10, 2009 at 10:10 PM, gilpel@altern.org wrote:
I'm still having problems downloading from liberty.edu . Ex, installing kdenlive:
Total download size: 13 M Is this ok [y/N]: y Downloading Packages: (1/15): GraphicsMagick-1.1.14-4.fc11.x86_64.rpm | 2.4 MB 00:05 (2/15): dvdauthor-0.6.14-8.fc11.x86_64.rpm | 187 kB 00:00 (3/15): dvgrab-3.4-2.fc11.x86_64.rpm | 133 kB 00:01 (4/15): ffmpeg-0.5-2.fc11.x86_64.rpm | 160 kB 00:01 (5/15): ffmpeg-libs-0.5-2.fc11.x86_64.rpm | 2.5 MB 00:15 (6/15): imlib2-1.4.2-4.fc11.x86_64.rpm | 228 kB 00:01 (7/15): jack-audio-connection-kit-0.116.1-5.fc11.x86_64. | 203 kB 00:01 (8/15): jack-audio-connection-kit-example-clients-0.116. | 42 kB 00:00 (9/15): kdenlive-0.7.4-2.fc11.x86_64.rpm | 2.6 MB 00:15 (10/15): libfreebob-1.0.11-5.fc11.x86_64.rpm | 160 kB 00:01 (11/15): mlt-0.4.2-1.fc11.x86_64.rpm | 144 kB 00:30 ... http://mirror.liberty.edu/pub/rpmfusion/free/fedora/updates/11/x86_64/mlt-0....: [Errno 4] Socket Error: timed out Trying other mirror. (11/15): mlt-0.4.2-1.fc11.x86_64.rpm | 3.4 MB 00:09 (12/15): openjpeg-libs-1.3-4.fc11.x86_64.rpm | 66 kB 00:00 (13/15): recordmydesktop-0.3.8.1-1.fc11.x86_64.rpm | 65 kB 00:00 (14/15): schroedinger-1.0.6-1.fc11.x86_64.rpm | 233 kB 00:01 (15/15): sox-14.2.0-2.fc11.x86_64.rpm | 458 kB 00:02
Total 137 kB/s | 13 MB 01:35
I very often get those "Socket Error: timed out" interruptions. How do I switch mirror for rpmfusion?
Go to http://mirrors.rpmfusion.org/mm/publiclist/ and select another mirror. Then edit rpmfusion repo files (free, non-free, free-updates, etc.), comment out mirrorlist in the repo files; uncomment and plug the url of your favorite mirror into baseurl.
On Sat, 2009-07-11 at 01:10 -0400, gilpel@altern.org wrote:
I'm still having problems downloading from liberty.edu . Ex, installing kdenlive:
Check that you have the mirrorlist enabled in the /etc/yum.repos.d/rpmfusion*.repo files and install yum-fastestmirror.
Jussi Lehtola wrote:
On Sat, 2009-07-11 at 01:10 -0400, gilpel@altern.org wrote:
I'm still having problems downloading from liberty.edu . Ex, installing
kdenlive:
Check that you have the mirrorlist enabled in the /etc/yum.repos.d/rpmfusion*.repo files and install yum-fastestmirror.
You and Leo provide together a very complete answer, but yours would be the easiest for newbies, mainly that once installed yum-fastestmirror is enabled by default in
less /etc/yum/pluginconf.d/fastestmirror.conf
[main] enabled=1 verbose=0 always_print_best_host = true socket_timeout=3 hostfilepath=/var/cache/yum/timedhosts.txt maxhostfileage=10 maxthreads=15
Why isn't this the default?
Thanks for your outstanding support, folks! It's really appreciated.
On Sat, Jul 11, 2009 at 10:14 AM, gilpel@altern.org wrote:
Jussi Lehtola wrote:
On Sat, 2009-07-11 at 01:10 -0400, gilpel@altern.org wrote:
I'm still having problems downloading from liberty.edu . Ex, installing
kdenlive:
Check that you have the mirrorlist enabled in the /etc/yum.repos.d/rpmfusion*.repo files and install yum-fastestmirror.
You and Leo provide together a very complete answer, but yours would be the easiest for newbies, mainly that once installed yum-fastestmirror is enabled by default in
less /etc/yum/pluginconf.d/fastestmirror.conf
[main] enabled=1 verbose=0 always_print_best_host = true socket_timeout=3 hostfilepath=/var/cache/yum/timedhosts.txt maxhostfileage=10 maxthreads=15
Why isn't this the default?
From http://fedoraproject.org/wiki/Docs/Drafts/SoftwareManagementGuide/Customizin...
" Fastest Mirror Plugin
Yum in Fedora uses a dynamic server side mirror management infrastructure that distributes the bandwidth consumptions on each of these mirrors by automatically directing the update to one of the geographically closest mirrors. This mirror is automatically checked against the master server for consistency.
The fastest mirror plugin enhances the speed of updates by maintaining a local offline hostfile cache of the speed of the mirrors. It sorts the mirror list by speed and prioritizes the faster ones for package downloads. This plugin is not installed by default. For installing it, use the following command or from the Applications menu use Add/Remove Software".
Let us know if liberty.edu is picked by fastestmirror. I'm betting that it does. (There are only 21 public mirrors listed for rpmfusion and mirrors.liberty.edu is the fastest and closest geographically to you.)
Kam Leom wrote:
Let us know if liberty.edu is picked by fastestmirror. I'm betting that it does. (There are only 21 public mirrors listed for rpmfusion and mirrors.liberty.edu is the fastest and closest geographically to you.)
I scraped Totem and installed MPlayer this afternoon and, as I noted in my yet unanswered message concerning using gedit as root, it took an awfully long time. (That's after installing fastestmirror.) Unfortunately, since I used the graphic interface, I don't know where it downloaded from.
If I remember well, I wouldn't have known either using yum at the command line: I got a mention of liberty.edu only when I had a socket error. Maybe the verbose mode will change this.
I'll try to keep you updated.
gilpel@altern.org wrote:
Why isn't this the default?
Probably because it doesn't work too well. The way it works is by pinging the IPs of all mirrors to see which one has the smallest latency. In a perfect world, that would be the source you want to use, but in reality all it tells you is which mirror's firewall/etc. responds to ping fastest. What happens is the server is either lagging or becomes overloaded fast (possibly because many users are trying to update from it) so the speed goes down the drain. End result: I have 3mb download on my DSL line, but using the "fastest mirror" often gives me 50K (or even lower) download speed. Sometimes I end up editing the timedhosts.txt file and faking a long timeout value for the slow host.
On Sat, 11 Jul 2009 11:22:51 -0700 Konstantin Svist fry.kun@gmail.com wrote:
gilpel@altern.org wrote:
Why isn't this the default?
Probably because it doesn't work too well. The way it works is by pinging the IPs of all mirrors to see which one has the smallest latency. In a perfect world, that would be the source you want to use, but in reality all it tells you is which mirror's firewall/etc. responds to ping fastest. What happens is the server is either lagging or becomes overloaded fast (possibly because many users are trying to update from it) so the speed goes down the drain. End result: I have 3mb download on my DSL line, but using the "fastest mirror" often gives me 50K (or even lower) download speed. Sometimes I end up editing the timedhosts.txt file and faking a long timeout value for the slow host.
I turned it off for exactly the reason you cite above. This isn't a measure of a fastest mirror. I think it would be really great if yum would keep track of the mirrors used and the actual download rate obtained over time with each mirror. It would have to be a weighted update of speed averaging past total at past speed and current total and current speed. Then instead of always using the fastest mirror, take the top N (20?, user selectable?) fastest mirrors and share the load among them. Set a size threshold so that only files above a certain size (2 MB?, 1MB?, 500K?) are taken from the fastest mirrors, let any other files come from anywhere. If a file is 20K in size, the speed of the download isn't really relevant. This shares the load and ensures that certain servers don't get hit by everyone, thus degrading their performance and stressing them unfairly.
I've thought about writing a plugin to do this, but haven't made it yet. The fastest mirror plugin would be a good template.
Mostly, I have just decided to run yum manually at slack times when it doesn't matter how fast it is, and it just does its thing.
On a related note, it would be nice if at some level of logging, yum printed the url of the mirror used for the download with the download rate. Then I could create my own crude version of the above algorithm just by parsing the log output and creating my own database or file with the information.
stan wrote:
I turned it off for exactly the reason you cite above. This isn't a measure of a fastest mirror. I think it would be really great if yum would keep track of the mirrors used and the actual download rate obtained over time with each mirror. It would have to be a weighted update of speed averaging past total at past speed and current total and current speed. Then instead of always using the fastest mirror, take the top N (20?, user selectable?) fastest mirrors and share the load among them. Set a size threshold so that only files above a certain size (2 MB?, 1MB?, 500K?) are taken from the fastest mirrors, let any other files come from anywhere. If a file is 20K in size, the speed of the download isn't really relevant. This shares the load and ensures that certain servers don't get hit by everyone, thus degrading their performance and stressing them unfairly.
I've thought about writing a plugin to do this, but haven't made it yet. The fastest mirror plugin would be a good template.
I'd prefer a system based on existing proven technology, e.g. bittorrent. It already does all this and more -- and works great for high loads, e.g. when a new version comes out. It doesn't matter where the packages are downloaded from, as long as they're signed (which is already the case). Some users may take issue with using their upload bandwidth or downloading from other users -- so upload-while-downloading and download-from-peers should probably be disabled by default, but it can be an option for the more adventurous. The biggest difference from BT is that the list of files to be downloaded is different for each user, and also that new files are being added all the time.
On Sun, 12 Jul 2009 12:03:47 -0700 Konstantin Svist fry.kun@gmail.com wrote:
I'd prefer a system based on existing proven technology, e.g. bittorrent. It already does all this and more -- and works great for high loads, e.g. when a new version comes out. It doesn't matter where the packages are downloaded from, as long as they're signed (which is already the case). Some users may take issue with using their upload bandwidth or downloading from other users -- so upload-while-downloading and download-from-peers should probably be disabled by default, but it can be an option for the more adventurous. The biggest difference from BT is that the list of files to be downloaded is different for each user, and also that new files are being added all the time.
Seems like this idea has potential.
What are the problems? Besides ISPs purposely slowing torrent traffic. Security? Complexity for users? Confusion when new files become available while old ones are downloading (as you mention)?
On Sun, Jul 12, 2009 at 1:04 PM, stangryt2@q.com wrote:
On Sun, 12 Jul 2009 12:03:47 -0700 Konstantin Svist fry.kun@gmail.com wrote:
I'd prefer a system based on existing proven technology, e.g. bittorrent. It already does all this and more -- and works great for high loads, e.g. when a new version comes out. It doesn't matter where the packages are downloaded from, as long as they're signed (which is already the case). Some users may take issue with using their upload bandwidth or downloading from other users -- so upload-while-downloading and download-from-peers should probably be disabled by default, but it can be an option for the more adventurous. The biggest difference from BT is that the list of files to be downloaded is different for each user, and also that new files are being added all the time.
Seems like this idea has potential.
What are the problems? Besides ISPs purposely slowing torrent traffic. Security? Complexity for users? Confusion when new files become available while old ones are downloading (as you mention)?
Torrent speed depends upon the combined donated bandwidth of participants. Works great when you have a large pool of peers and seeders. Too few participants and you might be downloading at 3K-4K bit/sec or waiting forever to get the last piece of a file. Speed also drops off dramatically after the initial availability/offering of a file.
On Sun, 12 Jul 2009 16:04:52 -0700 Kam Leo kam.leo@gmail.com wrote:
Torrent speed depends upon the combined donated bandwidth of participants. Works great when you have a large pool of peers and seeders. Too few participants and you might be downloading at 3K-4K bit/sec or waiting forever to get the last piece of a file. Speed also drops off dramatically after the initial availability/offering of a file.
This shouldn't be a problem if all Fedora repositories are acting as seeders. But of course that requires them to convert their file handling methods (anonymous ftp(?) to torrent). I don't know how big a task that is but it could be a show stopper. The load on the servers would be shared more equally though. And if even some peers keep seeding for up to 24 hours after initial availability, they would carry a lot of the load for updates during the high demand of initial availability.
And everyone would be familiar with the method when getting new releases.
It has to have enough benefit to overcome the inertia of sticking with the currently working system, though, and the delta has to be clear. Why do a lot of work, introducing bugs and chaos, for no gain?
I'm trying to install OOo at the present time with Pirut. I started downloading at about 21:45h. It's now midnight, I have 203 MB downloaded and it's not finished, Results from iftop:
192.168.7.XXX => btr0x2.rz.uni-bayreuth.de 9.73Kb 8.77Kb 8.09Kb <= 360Kb 265Kb 230Kb
___________________________________________________________________
TX: cumm:275KB peak:12.8Kb rates:9.73Kb 8.77Kb 8.09Kb RX: 7.57MB 421Kb 360Kb 265Kb 230Kb TOTAL: 7.84MB 434Kb 370Kb 273Kb 238Kb
As you can see, my dl is not from liberty.edu anymore. I also removed fastestmirror. In Germany, everybody is asleep at this time and their mirror usually have enough bandwidth.
I tried to download Knoppix from uni-bayreuth, then from tu-chemnitz with wget, and I had the same speeds. Soon thereafter, I saw the Pirut transfer had switched to... tu-chemnitz :) but it soon went back to uni-bayreuth.
My ISP has enough bandwidth. I usually easily get 500 kB/sec.
The problem I have is not a "regular" problem. I'm sure nobody has such difficulty downloading from uni-bayreuth *and* tu-chemnitz at this time of day. I sometimes dowloaded Knoppix ISOs either from tu-chemnitz or Kaiserlautern in about 20 minutes.
So, Stan, as far as I am concerned, I do agree that it's better not to turn the world upside down to implement bittorrent downloads :)
Date: Mon, 13 Jul 2009 09:14:30 +0400 From: gilpel@altern.org To: fedora-list@redhat.com Subject: Re: How do I switch mirror for rpmfusion?
I'm trying to install OOo at the present time with Pirut. I started downloading at about 21:45h. It's now midnight, I have 203 MB downloaded and it's not finished, Results from iftop:
192.168.7.XXX => btr0x2.rz.uni-bayreuth.de 9.73Kb 8.77Kb 8.09Kb <= 360Kb 265Kb 230Kb
TX: cumm:275KB peak:12.8Kb rates:9.73Kb 8.77Kb 8.09Kb RX: 7.57MB 421Kb 360Kb 265Kb 230Kb TOTAL: 7.84MB 434Kb 370Kb 273Kb 238Kb
As you can see, my dl is not from liberty.edu anymore. I also removed fastestmirror. In Germany, everybody is asleep at this time and their mirror usually have enough bandwidth.
I tried to download Knoppix from uni-bayreuth, then from tu-chemnitz with wget, and I had the same speeds. Soon thereafter, I saw the Pirut transfer had switched to... tu-chemnitz :) but it soon went back to uni-bayreuth.
My ISP has enough bandwidth. I usually easily get 500 kB/sec.
The problem I have is not a "regular" problem. I'm sure nobody has such difficulty downloading from uni-bayreuth *and* tu-chemnitz at this time of day. I sometimes dowloaded Knoppix ISOs either from tu-chemnitz or Kaiserlautern in about 20 minutes.
So, Stan, as far as I am concerned, I do agree that it's better not to turn the world upside down to implement bittorrent downloads :)
-- fedora-list mailing list fedora-list@redhat.com To unsubscribe: https://www.redhat.com/mailman/listinfo/fedora-list Guidelines: http://fedoraproject.org/wiki/Communicate/MailingListGuidelines
Have a look at:
A list of available public RPM Fusion mirrors can be found at: http://mirrors.rpmfusion.org/mm/publiclist/
_________________________________________________________________ Insert movie times and more without leaving Hotmail®. http://windowslive.com/Tutorial/Hotmail/QuickAdd?ocid=TXT_TAGLM_WL_HM_Tutori...
On Mon, 2009-07-13 at 09:14 +0400, gilpel@altern.org wrote:
I'm trying to install OOo at the present time with Pirut. I started downloading at about 21:45h. It's now midnight, I have 203 MB downloaded and it's not finished,
Are you downloading from local mirrors, or mirrors world-wide?
I've noticed that when I do yum updates, that it tends to select local ones more likely than further away ones. I'm receiving an Australianised mirror list, and it *usually* serves me fine, but not always.
Perhaps, you get supplied with a less than optimal set of mirrors, and you want to hand select one or more good ones, and stick to just them. Visit their websites, and directly download a large file, or two, to get a feel for their responsiveness (starting to download promptly, and whether downloads continue at a rapid rate).
Tim Wrote:
Are you downloading from local mirrors, or mirrors world-wide?
ifcfg said I was downloading from btr0x2.rz.uni-bayreuth.de .
I also tried to download Knoppix from tu-chemnitz with wget and got the same type of speed.
Do you really believe that <B>both</B> uni-bayreuth and tu-chemnitz were at less than 1/10 their normal speed in the middle of the night in Germany?
I called my provider yesterday to see if they had any problem. I was told there is none. I downloaded a file from their site at 575 kB/s ! They say they're not responsible for whatever happens beyond. I suppose that's a given fact.
Speaking network problems... Does anyone know the reason why Red Hat's site was offline twice in the last few days with only a page with worldwide support phone numbers?
Altern doesn't fare very well either. Yesterday, I tried to save a draft but was advised that the imap server had lost connection. Then, I couldn't log in, receiving the message "Utilisateur inconnu ou mot de passe incorrect. Retourner à la page d'accès." (Unknow user or incorrect password. Go back to login page.) Then, the site was completely offline. Today, it's back. This happened too often recently. I wasn't a regular of Red Hat's site, but I would think that being offline twice in maybe three days is also very peculiar for Red Hat.
Konstantin Svist wrote:
gilpel@altern.org wrote:
Why isn't this the default?
Probably because it doesn't work too well. The way it works is by pinging the IPs of all mirrors to see which one has the smallest latency. In a perfect world, that would be the source you want to use, but in reality all it tells you is which mirror's firewall/etc. responds to ping fastest. What happens is the server is either lagging or becomes overloaded fast (possibly because many users are trying to update from it) so the speed goes down the drain. End result: I have 3mb download on my DSL line, but using the "fastest mirror" often gives me 50K (or even lower) download speed. Sometimes I end up editing the timedhosts.txt file and faking a long timeout value for the slow host.
I suppose pirut will use fastestmirror too if it is enabled? If so, it would expalin my sloooow install of MPlayer. I'll see how things turn out. I might have to edit the files. I often try to update when it's getting really late here and the mirror I'm downloading from is in the wee small hours.
I then get excellent speeds.
Thanks for sharing your experience!
On Sat, 2009-07-11 at 01:10 -0400, gilpel@altern.org wrote:
I very often get those "Socket Error: timed out" interruptions. How do I switch mirror for rpmfusion?
You can try "yum clean metadata" and stand a good chance that a different mirror will be picked at random, for your next "yum update" or "yum install". This is what I do when I get stuck with a slow mirror, though first doing a CTRL+C during the downloading is often enough to get onto a different mirror that might be better.
For a more permanent solution, if you can find a mirror that you're happy with, you can edit the various rpmfusion repo files (*), to use just that mirror. Comment out the mirrorlist line, and put your preferred mirror address into the baseurl line.
* /etc/yum.repos.d/rpmfusion*.repo
If there were a collection of different mirrors that suited you, you could probably just change the mirrorlist line to point to a local file listing your preferred mirrors.
Tim wrote:
On Sat, 2009-07-11 at 01:10 -0400, gilpel@altern.org wrote:
I very often get those "Socket Error: timed out" interruptions. How do I switch mirror for rpmfusion?
You can try "yum clean metadata"
Noted.
For a more permanent solution, if you can find a mirror that you're happy with, you can edit the various rpmfusion repo files (*), to use just that mirror.
That's what Leo suggested, I believe, but Fedora makes me lazy. Things work usually so well without editing files. Hey, listen to this: after scrapping Totem and installing Mplayer, I could even watch Radio-Canada's wmv without a glitch!!!
I was late on one program (decouverte, in case you want to practice your french :) and watched TV online for part of the afternoon, but I might get back to editing files later.
Thanks!