Ubuntu QA:
BlogBrainstormPackage status
Log in
Ubuntu QA
The Ubuntu community has contributed 21986 ideas, 135057 comments, 2615221 votes
Idea sandbox Idea sandbox
Popular ideas Popular ideas
Ideas in development Ideas in development
Implemented ideas Implemented ideas
Idea #7390: Servers are overwhelmed during each release

bug This idea was marked as implemented the 7 July 11. Available starting Ubuntu 9.04 Jaunty Jackalope.
Written by FranciscoPadillaGarcia the 22 Apr 08 at 08:00. Related project: ubuntu.com. Status: Implemented
Rationale
When Hardy Heron was released, the Ubuntu servers became overloaded with thousands of people trying to download it. Downloading rates of repositories and updates were so slow that some people had to leave the computer on at night only to find connection errors the next morning.


Developer comments
We do actually have a BitTorrent tracker and support BitTorrent downloads; you can see the .torrent files on releases.ubuntu.com, and every release features people eager to provide seeding.

I think the reason the torrents aren't prominent on getubuntu/download is that there are a lot of problems with the server-side tracker software; particularly around release time, it has to be restarted manually rather a lot as new files are made available, taking ages to reinitialise each time, and this makes our sysadmins unhappy. Our webmaster also wants the download page to be as simple as possible, and each option does add a level of complexity to the process.

That said, BitTorrent certainly can help to scale back server load (although so can using mirrors other than Canonical's - there's a reason there's a period before release when the images are available on our servers but we ask people to restrain themselves from posting links to them, and that's to give mirrors a chance to fetch the images first).

On 3 June, our webmaster added a note to the bottom of http://www.ubuntu.com/getubuntu/download on how to retrieve images by BitTorrent, which I believe was in response to this item. This ultimately takes you through to the releases.ubuntu.com page from which you can get the .torrent files.

Bearing in mind some of the constraints involved that lead to something of a compromise, I'm interested in whether that resolves this item.

1726
votes
implemented
Selected solution (#1): Auto-generated solution of idea #7390
Written by FranciscoPadillaGarcia the 22 Apr 08 at 08:00.
Ubuntu Brainstorm was updated in January 2009. Since the idea #7390 was submitted before this update, its rationale and solution are not separated. Please vote accordingly, and if you have the necessary rights, please separate the rationale from the solution. Thanks!
186
votes
implemented
Selected solution (#2): Use BitTorrent
Written by CRAY4 the 19 Oct 09 at 17:29.
Users should have the option of using BitTorrent for distribution updates since thousands if not more people will be seeding plus the Ubuntu server which would result in an incredibly fast Download, and if you have less than x seeders then it can download the conventional way
63
votes
implemented
Selected solution (#3): Propose to use a different "source"
Written by Rodrigo the 19 Oct 09 at 21:20.
When the system "fells" that it has to download a large amount of data, it should propose to look for the best server. It takes a little bit of time, but it can be good in the long run, specially if the update is a big one.
46
votes
implemented
Selected solution (#4): similar to #1 but extendet
Written by Tellur the 24 Oct 09 at 20:09.
The used system should be similar to the Blizzard Downloader used by Blizzard to fast distribute updates and videos.
It essentially builds upon BitTorrent but integrated into a lightweight standalone application which also makes use of traditional server downloads which now act as one of many peers. This way you have always both options on and get the benefits of both. Plus since the classic server still communicates via port 80 (or something like it) you evade possibly fatal port restrictions altogether.

It should furthermore be selectable if someone wants to contribute as a seeder or as an active peer in general, since some users have limited bandwidth and/or data limits.
43
votes
implemented
Selected solution (#5): Use MetaLink
Written by Shnatsel the 25 Oct 09 at 07:54.
Use several download sources (and maybe BitTorrent) in parallel. See http://en.wikipedia.org/wiki/Metalink
24
votes
implemented
Selected solution (#6): aptitude install debtorrent apt-transport-debtorrent
Written by z3non the 27 Oct 09 at 11:07.
solution exists (BitTorrent protocol slightly modified). make it configurable via the software sources tool. warn users about risks (upstream bandwidth, disk consumption), inform about advantages (higher speeds at peak times). allow to configure a different debtorrent-client than localhost for LANs.

http://debtorrent.alioth.debian.org/

http://wiki.debian.org/DebTorrent
13
votes
implemented
Selected solution (#7): Distribute Packages via RRD Pools.
Written by xeniac the 27 Oct 09 at 18:32.
Still many People have Download/Upload Limits and P2P is no option for those.

Today Ubuntu uses country based APT-Mirrors. (at.archive.ubuntu.com for example), but country borders do not exist for the internet. Many times a Czech Server is
faster for me, then an Server in Austria

Canonical could setup a DNS based load balancing system for their APT-Repositories with different pools for every continent.This solution could distribute the demand more equally to all mirrors, which results in better performance for users.

It also raises the availability. For example: Sometimes my old Debian Mirror was simply not reachable, this can not happen with load balancing.

This solution is also total transparent and needs no modification on the client side.
-23
votes
implemented
Selected solution (#8): Use Ubuntu One as mirror
Written by afunix the 4 Nov 09 at 08:50.
DebTorrent and Apt-Torrent are good but still completely unstable, so can we use Ubuntu One as ubuntu mirror?
Maybe there should be some system user for Ubuntu One if user does not have account.
And, of course, this feature should be configurable, as user should have good internet connection to use Ubuntu One.

Pros:
Lots of peers, so downloading should be really fast.
Easy configuration for sources.list.

Cons:
User should have good internet connection (all solutions require that).
Needs some fixes for apt to make it ignore unreachable mirrors and try another configured mirror.
-9
votes
implemented
Selected solution (#9): Use a CDN (Content Delivery Network)
Written by bvidulich the 7 Nov 09 at 23:39.
Content delivery networks such as Akamai have inter-connected servers right across the world and can deliver content quickly to users. They also take care of distributing their content to all of their servers.

If a CDN is added to the list of package sources or Ubuntu mirrors then users would be dynamically redirected to a server that can deliver the packages a fast as possible for that user.

This may be expensive for Canonical, however, since CDN's charge to distribute content and Ubuntu is free.
12
votes
implemented
Selected solution (#10): Have Graphical Option for Upgrading Via ISO
Written by bgrohe the 2 May 10 at 22:35.
If there was a Graphical option to update most of parts from an ISO file (and other components could be updated from the central servers) then people could download from a torrent or the could download once and use it on many computers. This would lesson the demand on the servers, making a better upgrade experience.
18
votes
implemented
Selected solution (#11): Integrate bittorrent protocol support into the updater
Written by genbattle the 3 May 10 at 01:38.
One way to speed up the updating process, especially during rushes is to use the Bittorrent protocol. Even having users seed a portion of what they download will make a huge difference in server loading, and will reduce the load on the central servers.

Blizzard Entertainment have implemented a dual HTTP-Bittorrent downloading system to great effect, and it serves to lessen the load on central servers when there is a large spike in traffic on game patch days.
2
votes
implemented
Selected solution (#12): Software repositories: auto-select best mirror at the first run of Synaptic
Written by barinov2000 the 3 May 10 at 09:25.
It would be great to have Synaptic check for the best server automatically at the time of OS installation/configuration, or at it's initial run(it can do it now but only if you ask) so more computers pint to different repository mirrors, therefore taking the load off the Main Server mirror.

Note: some people have custom settings for that and it would be nice not to overwrite their settings silently but ask something like "would you like your computer to find the fastest server for upstates and downloads" or something of that sort; and if the click yes remind them that if they have custom repositories then they will be saved so users can go back to their settings if they wish.

Does this make sense?

Peace =)
10
votes
implemented
Selected solution (#13): More Canonical Servers
Written by artir the 26 Apr 08 at 11:57.
To solve this one solution is to purchase more servers

Attachments


Duplicates


Comments
brunovecchi wrote on the 22 Apr 08 at 11:25
Agreed. This is stressed enough in the forums, but not in the official page. +1

loveandequalityforall wrote on the 22 Apr 08 at 12:31
this is so true!

glotz wrote on the 22 Apr 08 at 12:47
A very Ubuntu idea!

wolfwitch wrote on the 22 Apr 08 at 13:12
I have to agree. I've always wondered why Ubuntu doesn't have a BT tracker. Downloading ISO's the "old fashioned" way is so inefficient. There is a lot of hype surrounding Hardy's release- and I suspect downloading it will be painful at best. I'm glad I already have the RC installed and will just need to deal with slow update times when the final packages hit the repositories.

Wikzo wrote on the 22 Apr 08 at 15:24
Agree!

Mystakill wrote on the 22 Apr 08 at 16:28
My download manager splits the load amongst multiple mirror servers, so it's sort of like BitTorrent, without the delays. Even if I can theoretically download more pieces with BitTorrent, it's nowhere near as fast as splitting an ISO download between multiple FTP and HTTP servers.

FranciscoPadillaGarcia wrote on the 22 Apr 08 at 20:04
With BitTorrent, you take, but you also give. That goes more with the "humanity towards others" philosophy.

unimatrix wrote on the 22 Apr 08 at 20:42
This idea is a must!

SchwarzeKrause wrote on the 22 Apr 08 at 22:05
Great! You could also implement dist-upgrade through BitTorrent, since there are already some implementations for apt on torrents

Auzy wrote on the 23 Apr 08 at 07:28
Mystakill.. What your download manager wont do, is validate every piece of the download.

Bittorrent will validate per block so you dont end up with a 700mb corrupt iso with dodgy data in it.

So in that sense at least, bittorrent reduces redownloaded data.

FranciscoPadillaGarcia wrote on the 23 Apr 08 at 19:56
That's another advantage: security and reliability.

The BitTorrent protocol uses hash functions to ensure file integrity; thus, files cannot be corrupted (modified). Not to mention that files can be resumed if the connection is broken.

Truly, BitTorrent is the next generation technology in file distribution.

loki wrote on the 23 Apr 08 at 20:59
agreed...

spocky wrote on the 24 Apr 08 at 12:04
it is out!
here is the link to the - i guess - mostly used one:

http://releases.ubuntu.com/releases/8.04/ubuntu-8.04-alternate-amd64.iso.torren t

fordplay wrote on the 24 Apr 08 at 14:06
Now that 8.04 is released.
Why wasn't the torrent link available on the main download page! I had to hunt for it!

myle wrote on the 24 Apr 08 at 15:13
The new version. You can download it using torrents:

http://releases.ubuntu.com/hardy/

http://torrent.ubuntu.com:6969/
http://cdimage.ubuntu.com/dvd/


Folk_Theory wrote on the 30 Apr 08 at 00:39
this should be the first option offered not hidden away!

larryfroot wrote on the 1 May 08 at 23:49
Absolutely agree!

FranciscoPadillaGarcia wrote on the 2 May 08 at 03:36
This clearly shows that Canonical decision-makers DO NOT WANT to implement this idea. The worst thing is that they aren't giving an explanation. I hope good ideas in this site don't come to die in a puzzle of bureaucracy :(

The reason Ubuntu is the most popular Linux distribution is because developers listen to people. Let's keep that humanity towards others alive.

toesterdahl wrote on the 3 May 08 at 08:52
From what I can see most users will prefer to do their upgrades using the upgrade functionality of the package manager. I do not see mainstream users downloading an iso to manually add it to the sources list. Besides that - wouldn't many large packages be outdated rather quickly because of security updates so the bandwith consumption on the mirrors wouldn't be reduced much anyway? I also do not see most users doing a new install every six month to upgrade their system. I did it now for the Hoary release after doing sequential upgrades of Ubuntu since 5.04. I give it that it worked without data loss, but it still took me some hours afterwards to add the packages that I needed for DVD support and other things that I am used to. Ubuntu should take care to stay a distribution that mainstream users can use without too much hassle.

For first time users I agree - they can download their image using bittorrent pretty much as easily as they can download it using HTTP.

FranciscoPadillaGarcia wrote on the 6 May 08 at 04:39
I tried to use the upgrade functionality of the package manager and that resulted in my system being corrupted. I had to download an .iso and install as a first time user.

Anyway, the point here is that the webmasters of Ubuntu website aren't promoting the torrent files or making the accessible and visible.

mlapaglia wrote on the 10 May 08 at 23:01
The best part of torrents is, when you have a ton of seeds, you can download at *your* capped speed, not the server. My school caps each computer at 1500 kb/s, but there are only a few mirrors that can match it.

Woudln't using torrents also relieve the stress on the servers during the release of the next version (every 6 months?) Using torrents would theoretically mean one full copy would have to be uploaded, and through the torrent style, it gets progressively faster the larger the swarm is.

Basically, using torrents during a major release would actually increase your download speed, because everyone else would be doing the same.

+1

Sand Lee wrote on the 20 Jun 08 at 04:13
We should take a couple hints from openSUSE's download page, http://software.opensuse.org/ . We could give a radio for each option, Standard and BitTorrent (default); if the user selects standard then the location dialog appears - if not a single BitTorrent link is provided.

I'd be great to get a response on this. I'm wondering whether or not I should post this as a new idea - extending it to almost mimicking the way openSUSE's page works...

FranciscoPadillaGarcia wrote on the 21 Jun 08 at 08:05
Thanks for the reference. I hope this gets done soon.

AleRi8 wrote on the 3 Aug 08 at 11:29
-1 bcoz some uk isp's block torrent ports

Auzy wrote on the 3 Aug 08 at 12:32
There are ways around it AleRi8. Top level encryption can. And it can always detect if bittorrent is being blocked, and return to http

Endolith wrote on the 15 Oct 08 at 04:38
A little link at the bottom of the download page is not really good enough in my opinion...

gaspard.leon wrote on the 30 Oct 08 at 03:29
get over "making it dumb and simple"

of the 0.1% of computer users that do download ubuntu, i think at least some of them will be smart enough to not click the torrent link if they don't want to use torrent.

lol

neomenlo wrote on the 30 Oct 08 at 15:30
This has been fixed!

In the very new (as of right now, 1 hour old) version of GetUbuntu, there are now links on the front page for:

* Text based “alternate installer” installation disk
* Bit Torrent
* The Windows based “Wubi” installer
* DVD images containing additional languages

Endolith wrote on the 30 Oct 08 at 21:17
Look at OpenOffice's download page for another example:

Download OpenOffice.org

Click to start downloading OpenOffice.org 3.0.0 for Windows (US English)

Get more platforms and languages, order CD-ROM or P2P downloads


"P2P downloads" goes to their BitTorrent page.

matsonfamily wrote on the 21 Dec 08 at 07:09
I agree that the torrents should be more visible, more used, and more preferred, but I may have a different motive: I think that torrent is currently viewed [incorrectly] by much of the corporate world, entertainment industry, and political world as a tool of use only to crackers, pirates, and thieves. I would like to see more valid/legal uses of P2P protocols (torrent being my personal favourite) implemented.

yaroman86 wrote on the 2 Jan 09 at 04:47
Blech. Torrents. No thanks. I prefer something that isn't dependent on OTHER people for speed. Give me a direct download and I'll be happy.

borsook wrote on the 2 Jan 09 at 12:54
@yaroman86 - actually with big releases is the other way around. With a traditional ftp solution, the more people downloading the file the slower the speed you get. With bit torrent the more people the faster the download. Plus with Ubuntu getting more and more popular relying on the direct download solution will force Canonical to spend more and more money on servers.

Endolith wrote on the 4 Jan 09 at 23:01
@yaroman86:

Have you ever actually used a torrent? It's much faster than a direct download.

ACanuck wrote on the 2 Dec 09 at 23:21
Using Mininova Content Distribution (http://www.mininova.org/apply) could simplify it. They even seed the torrents for you.

cheesehead (Brainstorm admin) wrote on the 7 Jul 11 at 04:23
Marking 'Implemented' - Solutions #2 and #6 have been available since early 2009.


Post your comment