 |
|
02-11-2009
|
#11 (permalink)
|
|
Understanding
Location:
The sorry-@$$ state(s) of "America"
|
Not Ranked
:
+0 / -0
0 score
Re: Building an HPC Cluster...
Wow, you are building a cluster using linux? I tried to build a cluster usning a couple of really old computers at school, I kept running into soo many problems. I was using Windows Active directory on windows 2000 OS.
How many years of experience have you had with Linux? Ive played around with it but I never thought once about switching cause I could never figure out the entire OS (ugh commands!).
Keep us updated :-)
----------------
Living in Providence, RI at Johnson & Whales University!
“Capitalism is a way to keep working men from thinking too much.” -- Leon Trotsky
"with modern methods of education and propaganda it has become possible to indoctrinate a whole population with a philosophy which there is no rational ground to suppose true" - Bertrand Russel |
|
|
02-11-2009
|
#12 (permalink)
|
|
Dedicated Smart-ass
Location:
Just before 0xAA55
|
Not Ranked
:
+0 / -0
0 score
Re: Building an HPC Cluster...
been using linux on and off since 2005 actually, but i had good teachers, well, they helped me set up my first gentoo box, then i started reading, working with it, in 5 months i was managing a linux lab and i've stuck with unix-like OSes since then (in techno speak nix, implying BSD, linux, minix, os x), I can't say that i have a main OS, i run a lot of different distros, and OSes. I run various flavors of linux, generally Gentoo, Ubuntu or BackTrack, but i have done others; SuSe, CentOS, Slackware, RedHat, Fedora, Yellow Dog, some small Linux distros, embedded linux, and others. I use OS X as my main platform for doing graphics and audio work, and i am once again rebuilding my OpenBSD router (its running on dual ultra spark III machine with 768 megs of ram and a quad interface nic on top of that, isa naas 1u).
I cant see why anyone would want to build a cluster on windows, and its not that i am against windows, its bang for the buck thing, performance, cost and stability, 3 things that Linux excels in, i will just say this, most clusters and supercomputers today run Linux.
It's not as hard as it may seem. If you want an advise for starting up, take a system that you are no longer using, and throw ubuntu on it, its easier to install then windows, and there is no need of command line managing it. Also ubuntu has a great community, and a lot of "howto"s and beginner guides are available. Just one thing, you have to do your own research to find how to do things, its an integral part of working with linux, the solution is out there, you just need to find the answers....
other then that, ask, there are a couple of people here i know that know linux fairly well, and we will help. Use Ubuntu for a bit, once you feel acquainted with the interface, try getting to know it better, learn some command line, eventually, anyone can be a pro 
----------------
Microsoft, the leader in using innovative tactics to promote irksome experience, coupled with antiquated technology that's held together by a pyramid of makeshift afterthoughts.
Apple, the leader in using irksome tactics to promote innovative experience, coupled with an antiquated core that's enhanced by state-of-the-art afterthoughts.
Linux, the leader in not using any tactics to promote user-defined experience, coupled with state-of-the-art core enhanced by innovative afterthoughts.
 |
|
|
|
02-11-2009
|
#13 (permalink)
|
|
Understanding
Location:
The sorry-@$$ state(s) of "America"
|
Not Ranked
:
+0 / -0
0 score
Re: Building an HPC Cluster...
Well, considering that my main computer is the only computer that can handle anything, I have three others, two are 12 year old dell's and the third is a dell optiplex 270 with so little memory (256mb) that it cant handle installing Sun's operating system Solaris 10 (it does run XP but poorly). If I get more memory for it and a couple more of them then I might consider building a cluster. I would like a linux box to mess around with and study. Know of anyplace I can get a linux box or no-OS box for $50-$100?
How are you building that router and is it working out? I tried to use windows because that was the one I am most familier with and the only linux they had was a really old version of ubuntu and puppy linux as well as one that supposedly acts like windows.
Windows Will always be my main operating system for better or for worse until WINE can run games, :-)
----------------
Living in Providence, RI at Johnson & Whales University!
“Capitalism is a way to keep working men from thinking too much.” -- Leon Trotsky
"with modern methods of education and propaganda it has become possible to indoctrinate a whole population with a philosophy which there is no rational ground to suppose true" - Bertrand Russel
Last edited by Theory5; 02-11-2009 at 02:10 PM..
|
|
|
|
02-11-2009
|
#14 (permalink)
|
|
Dedicated Smart-ass
Location:
Just before 0xAA55
|
Not Ranked
:
+0 / -0
0 score
Re: Building an HPC Cluster...
you wont get any cheaper and cooler looking then this: ZaReason, Inc. :: Desktops :: Shuttle KPC
----------------
Microsoft, the leader in using innovative tactics to promote irksome experience, coupled with antiquated technology that's held together by a pyramid of makeshift afterthoughts.
Apple, the leader in using irksome tactics to promote innovative experience, coupled with an antiquated core that's enhanced by state-of-the-art afterthoughts.
Linux, the leader in not using any tactics to promote user-defined experience, coupled with state-of-the-art core enhanced by innovative afterthoughts.
|
|
|
|
02-11-2009
|
#15 (permalink)
|
|
Dedicated Smart-ass
Location:
Just before 0xAA55
|
Not Ranked
:
+0 / -0
0 score
Re: Building an HPC Cluster...
btw those old boxes will run linux no probs....
by the way, a cluster is not what you think, it does not start magically using other computers and make it seem like one big computer... the parallel cluster i am building will run programs that are written specifically for parallel processing with a specific set of libraries to manage the nodes, etc, it's not like you will get a giant supercomputer by doing this that you can play crysis at 1000fps on, very specific use, not something you can build without knowing a thing or two about systems, not something you can build without planning a purpose for it...
----------------
Microsoft, the leader in using innovative tactics to promote irksome experience, coupled with antiquated technology that's held together by a pyramid of makeshift afterthoughts.
Apple, the leader in using irksome tactics to promote innovative experience, coupled with an antiquated core that's enhanced by state-of-the-art afterthoughts.
Linux, the leader in not using any tactics to promote user-defined experience, coupled with state-of-the-art core enhanced by innovative afterthoughts.
|
|
|
|
02-12-2009
|
#16 (permalink)
|
|
Understanding
Location:
The sorry-@$$ state(s) of "America"
|
Not Ranked
:
+0 / -0
0 score
Re: Building an HPC Cluster...
Quote:
Originally Posted by alexander
btw those old boxes will run linux no probs....
|
Yea but what can I do with them? If they dont have adaquite speed and processing power what good are they?
Quote:
|
it's not like you will get a giant supercomputer by doing this that you can play crysis at 1000fps on, very specific use, not something you can build without knowing a thing or two about systems, not something you can build without planning a purpose for it...
|
Lol, I am well aware of that :-)
I just wanted to see what building a cluster was like. How will you be able to get a command to all the computers does the gentoo OS allow you to control them using its GUI or is it all command based? I read that there was some software for windows computers that linked them as a cluster but it was command based.
----------------
Living in Providence, RI at Johnson & Whales University!
“Capitalism is a way to keep working men from thinking too much.” -- Leon Trotsky
"with modern methods of education and propaganda it has become possible to indoctrinate a whole population with a philosophy which there is no rational ground to suppose true" - Bertrand Russel |
|
|
|
02-12-2009
|
#17 (permalink)
|
|
Dedicated Smart-ass
Location:
Just before 0xAA55
|
Not Ranked
:
+0 / -0
0 score
Re: Building an HPC Cluster...
to answer your question, please read: OpenMPI
----------------
Microsoft, the leader in using innovative tactics to promote irksome experience, coupled with antiquated technology that's held together by a pyramid of makeshift afterthoughts.
Apple, the leader in using irksome tactics to promote innovative experience, coupled with an antiquated core that's enhanced by state-of-the-art afterthoughts.
Linux, the leader in not using any tactics to promote user-defined experience, coupled with state-of-the-art core enhanced by innovative afterthoughts.
|
|
|
|
02-12-2009
|
#18 (permalink)
|
|
Dedicated Smart-ass
Location:
Just before 0xAA55
|
Not Ranked
:
+0 / -0
0 score
Re: Building an HPC Cluster...
configured torque, and i just got 3 more systems... they are nothing special but 3 more nodes is like wow
----------------
Microsoft, the leader in using innovative tactics to promote irksome experience, coupled with antiquated technology that's held together by a pyramid of makeshift afterthoughts.
Apple, the leader in using irksome tactics to promote innovative experience, coupled with an antiquated core that's enhanced by state-of-the-art afterthoughts.
Linux, the leader in not using any tactics to promote user-defined experience, coupled with state-of-the-art core enhanced by innovative afterthoughts.
|
|
|
|
02-13-2009
|
#19 (permalink)
|
|
Dedicated Smart-ass
Location:
Just before 0xAA55
|
Not Ranked
:
+0 / -0
0 score
Re: Building an HPC Cluster...
testing distcc with 3 nodes, what a better way to do this then compile a kernel?
base, machine by itself: 12m0.469s
after, using 2 more nodes (4 more logical processors): 3m30.277s
compiling kernel is so much fun now ^_^
----------------
Microsoft, the leader in using innovative tactics to promote irksome experience, coupled with antiquated technology that's held together by a pyramid of makeshift afterthoughts.
Apple, the leader in using irksome tactics to promote innovative experience, coupled with an antiquated core that's enhanced by state-of-the-art afterthoughts.
Linux, the leader in not using any tactics to promote user-defined experience, coupled with state-of-the-art core enhanced by innovative afterthoughts.
|
|
|
|
02-13-2009
|
#20 (permalink)
|
|
Dedicated Smart-ass
Location:
Just before 0xAA55
|
Not Ranked
:
+0 / -0
0 score
Re: Building an HPC Cluster...
ahhhaha...
master.hpc.home
state = free
np = 2
ntype = cluster
status = opsys=linux,uname=Linux master 2.6.27-gentoo-r8 #2 SMP Sun Feb 8 21:23:42 EST 2009 i686,sessions=3883,nsessions=1,nusers=1,idletime=2 1396,totmem=5085372kb,availmem=5007092kb,physmem=2 587276kb,ncpus=2,loadave=0.00,netload=1571268234,s tate=free,jobs=,varattr=,rectime=1234579221
node1.hpc.home
state = free
np = 2
ntype = cluster
status = opsys=linux,uname=Linux node1 2.6.27-gentoo-r8 #1 SMP Sun Feb 8 21:25:13 EST 2009 i686,sessions=27107,nsessions=1,nusers=1,idletime= 87770,totmem=3524448kb,availmem=3456368kb,physmem= 1026352kb,ncpus=2,loadave=0.00,netload=1376810905, state=free,jobs=,varattr=,rectime=1234579222
node2.hpc.home
state = free
np = 2
ntype = cluster
status = opsys=linux,uname=Linux node2 2.6.27-gentoo-r8 #2 SMP Fri Feb 13 13:01:41 EST 2009 i686,sessions=? 0,nsessions=? 0,nusers=0,idletime=3734,totmem=4564832kb,availmem =4523840kb,physmem=2066736kb,ncpus=2,loadave=0.00, netload=5057030,state=free,jobs=,varattr=,rectime= 1234579252
----------------
Microsoft, the leader in using innovative tactics to promote irksome experience, coupled with antiquated technology that's held together by a pyramid of makeshift afterthoughts.
Apple, the leader in using irksome tactics to promote innovative experience, coupled with an antiquated core that's enhanced by state-of-the-art afterthoughts.
Linux, the leader in not using any tactics to promote user-defined experience, coupled with state-of-the-art core enhanced by innovative afterthoughts.
Last edited by alexander; 02-13-2009 at 06:41 PM..
|
|
|
|
|
|
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
|
|
|
|
» Advertisement |
|
|
|
