Ubuntu QA:
BlogBrainstormPackage status
Log in
Ubuntu QA
The Ubuntu community has contributed 17459 ideas, 107690 comments, 2263278 votes
Idea sandbox Idea sandbox
Popular ideas Popular ideas
Ideas in development Ideas in development
Implemented ideas Implemented ideas
Idea #3475: CPU sharing (Clustering) over home networks should be seemless

Written by Auzy the 6 Mar 08 at 05:18. Category: System. Related project: Nothing/Others. Status: New
Rationale
We should make it take only 3 or 4 clicks to enable CPU clustering over a network. Every home user these days often have 3 or 4 computers in their household when half the time are simply sitting there browsing the web.

Users should be able to configure clustering in GCC (switch to DistCC), enable openmosix, maybe even set up programs like blender properly in a centralised location, and just need to click a button. That way everyone can use their computing resources more efficiently, and easily.

At the very least we should make it easier (not neccessarily include it in the main distribution). And small polish like this may not benefit many people, but the people who notice (your graphics and developer crowd for instance), will be eternally greatful. And, lets be honest, its a great sales pitch for many businesses :D

OSX already ships with a solution known as Xgrid which people can use, in its clients and servers. Xgrid has only failed because even Apple does not integrate it into their programs. OpenMosix for instance though is ready to go and can be made into an "out of the box" solution.
Tags: (none)

278
votes
up equal down
Solution #1: Auto-generated solution of idea #3475
Written by Auzy the 6 Mar 08 at 05:18.
Ubuntu Brainstorm was updated in January 2009. Since the idea #3475 was submitted before this update, its rationale and solution are not separated. Please vote accordingly, and if you have the necessary rights, please separate the rationale from the solution. Thanks!
3
votes
up equal down
Solution #2: should work like...
Written by nloewen the 14 Feb 09 at 09:20.
In my opinion, I should be able to open a utility and click on add this computer to cluster and I'm done. If a computer is missing from the cluster, a notification pops up, no big deal It's probably turn off right now anyway. I turn on the other computer, the icon on my panel changes to notify me that theres other computers connected.

I should also be able to install a small version of ubuntu that turns my old computers that are lying around into cluster nodes.
2
votes
up equal down
Solution #3: Allow to make Ubuntu think client installation
Written by Lachu the 13 Nov 09 at 18:00.
Ships on Ubuntu's Live CD think client installation option, so I can install Ubuntu only on one computer and on others only think client version. The idea is not similar to solution 1, it seems to repair other matters, but some of use cases are common. My idea is also simpler.

Propose your solution

Attachments
No attachments.


Duplicates


Comments
kiddyfurby wrote on the 6 Mar 08 at 06:20
nice idea, not sure if it would draw too much developer resources though

ka2 wrote on the 6 Mar 08 at 07:16
yikes thats hard. icecream not distcc. but i like the idea i just think it should be a seperate project.

farkarich wrote on the 6 Mar 08 at 09:14
I'm sorry to tell you, that openmosix is "dead" it will not be developed any more

Auzy wrote on the 6 Mar 08 at 09:26
Nooooooooo.

Oh well, theres always alternatives, (can you tell I haven't used it for ages?)

zoubidoo wrote on the 6 Mar 08 at 13:55
Ambitious, but I love it.

aldoo wrote on the 7 Mar 08 at 13:13
Of course, that would not be a "bad" idea.
But is that kind of feature really useful for Ubuntu's targeted audience ?

Only spend time on this if you have nothing else to do !
(Or if you just like to develop in that field anyway, but then there is no point in that brainstorm !)

jeffa wrote on the 7 Mar 08 at 18:03
I think it's a perfect feature for ubuntu's target audience. I've been looking into a way to easily clusture multiple systems. This would be beneficial to many home users, as well as business users.

This would be an awesome new feature. I really hope to see it some day soon. Two thumbs up!


Prodeous wrote on the 19 Mar 08 at 11:49
I to think this feature would be welcomed by a lot of people from wide range of communities.

As a Blender user (3d modeling/animation open source package) having the possibility to create a cluster with simple clicks would be a dream come true.

Currently available tutorials are somewhat difficult to follow (especially since all of them require internet access which I dont' possess outside of work).

But having this integrated into the package (distro CD) along with one to ten clicks is definitely a welcomed feature.

computoman wrote on the 14 Apr 08 at 19:11
I am for the clustering idea also. I could see the tremendous benefits to businesses for high availability and high performance clusters, High availability and a business version
of ubuntu with ltsp could be a giant killer of mswindows servers. We need to get away from the single computer mentality if we want to really get into the business world and succeed. I would love to have a clustered nas for my business so that I know data will be dependable 24/7.

brunovecchi wrote on the 29 Apr 08 at 13:49
I think this is a GREAT idea. Most of the time my proccessor is idle, waiting for me to tell it to do something. Once a month, however, I require a large amount of processing power to run some simulations. How about averaging my processor demand by lending it to people while I don't use it and borrowing from others when I most need it? That would bring super-processor capabilities for everyone! I'd love to see this happening. +1

nazgand wrote on the 6 May 08 at 23:56
I want A home supercomputer too.

layla_1 wrote on the 7 May 08 at 01:30
One of the best ideas I've seen for recently.
A glaring Vista-beating opportunity for those who crave such media soundbytes too.

Explaining to an older guy (60? years old) I share a daily bus trip last month about computer clusters, he actually said "oh, that sound like "dynabolic" (sic). My grandson uses it for his band"

I was astounded.....he has no home computer and hadn't heard of M$ :)

drinkypoo wrote on the 9 May 08 at 17:33
distcc is easy. the people who need it can install it. MOSIX is over. We need a new single-system-image cluster, because anything else is too hard to use. applications have to be specifically coded to take advantage of other clustering packages.

nazgand wrote on the 10 May 08 at 00:42
here is a link to dynebolic.... http://dynebolic.org/

Auzy wrote on the 10 May 08 at 02:27
still, Distcc on OSX is even easier, for them its just a checkbox.

Even if developers are capable, we'd prefer to be able to just click a checkbox to do it then screwing with config files

ssam wrote on the 11 May 08 at 14:53
there are only a few places where this would be helpfull. big jobs that split up into well separated tasks. (at uni i do fairly big simulations. when a simulation takes 10 hours, and i want to run 10 of them with different parameters, having a cluster is great. it means it only takes 10 hours instead of 100).

latency between processors is a big factor. for serious clustering even gigabit ethernet is not good enough, so a standard home setup with 100mbit or wireless will have problems.

most programs, can't take advantage of dual-core CPUs yet, so they have no chance at clustering.

it might be usefull for compiling, big multiframe rendering, batch multimedia conversion, maybe some of the slower gimp filters. although some framework, and options (choosing hosts you trust) could be centralised, each application would need modifications.

crhylove wrote on the 2 Aug 08 at 12:37
There are almost constantly 3-4 computers running in this house, and there is rarely a time when they are all simultaneously being used. It would be nice if I could naturally use all of them for EVERY task, even just getting a few more FPS in a game, or an emulator.

Auzy wrote on the 3 Aug 08 at 04:09
crhylove, not sure if it would help much for gaming in most cases, unless the games are programmed properly. Ie:
1) No sync points
2) properly multithreaded.
3) Not frame rate oriented really.. Turn based games may work ok, but first person shooters may require faster updates then what the network latency can offer.


The main places this would help as mentioned, are for operations which can be completely seperated, and aren't as dependent on time, like rendering movie frames, compiling, or processing that needs a large amount of processing for a small dataset. But it would just be nice if in such applications, they were automatically using the resources of the network, without even needing to know its happening.

Craig73 wrote on the 3 Oct 08 at 18:34
I think that's the challenge with this idea Auzy... identifying what the use cases are that would justify the effort.

1) Multimedia processing
2) Rendering
3) Compiling

the majority of users would see no benefit. But perhaps adapting an existing clustering infrastructure project to be more generic or easy to install might benefit these users and perhaps someone will come up with a new creative use...

Games - you could likely run the AI and server on another box... the same as any networked game setup. But this would imply more being able to distribute and remotely execute that engine on another computer and kick it off, all without introducing stability or security issues.

In face those issues are present for the above cases as well if you are assuming this is a spontaneous activity.

Perhaps exploring that model and how it might be implemented and managed might be an interesting space to explore (as a personal/academic project rather than a distribution vendor project)


Azeem wrote on the 13 Nov 09 at 11:33
Yes to this.. Everyone wants a supercomputer at home!

And my ONE Ubuntu machine is always doing all the grunt work for the family.. it's just not fair.. we need to share the load to get things done faster

Lachu wrote on the 13 Nov 09 at 18:01
@Solution #1 : To realize this idea, we need only kernel module(I don't remember name, but it exist).


Post your comment