climateprediction.net (CPDN) home page
Thread 'Linux performance'

Thread 'Linux performance'

Message boards : Number crunching : Linux performance
Message board moderation

To post messages, you must log in.

AuthorMessage
old_user202664

Send message
Joined: 13 Oct 06
Posts: 60
Credit: 7,893
RAC: 0
Message 25337 - Posted: 29 Nov 2006, 1:07:30 UTC
Last modified: 29 Nov 2006, 1:08:04 UTC

Hi guys,

just wondering... I recently installed Debian Linux on my Laptop and now I\'d like to know if someone has experience with how slower machines do under Linux. I tried to run BBC CPDN on that machine when I was running XP and that was not really nice (had a few odd crashes then gave it up; probably just too little performance) but Linux should be a bit less demanding on the poor little thing ;-) so maybe there is a chance I\'ll get CPDN to work on it after all? With 1,3 GHz and 496 MB of memory I\'m only slightly below the suggestions on the CPDN homepage...
As I said, just wondering, so don\'t beat me up if there is no way this will work. It just occured to me that it might. XP almost halved my memory, so if part of that would be left for BOINC... I\'d appreciate comments from more experienced users here.
ID: 25337 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 25339 - Posted: 29 Nov 2006, 2:10:37 UTC
Last modified: 29 Nov 2006, 2:16:56 UTC

Laptops have enough handicaps, e.g., HD less capable than Desktop\'s (in addition to heavy floating point demands, CPDN has heavy HD demands [though less now than earlier implementations of CPDN]), without introducing low-end liabilities.

If you try it, be aware of the relatively poor cooling of laptops and keep the thing elevated. Two or three years ago, a participant cracked a wood desktop when a laptop was running flat on it overnight.

Edit: The current version of CPDN is more efficient on Windoze than on Linux. Consequently, none of my machines now run Linux whereas, before, all but one did so.
"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 25339 · Report as offensive     Reply Quote
old_user170894
Avatar

Send message
Joined: 3 Mar 06
Posts: 96
Credit: 353,185
RAC: 0
Message 25347 - Posted: 29 Nov 2006, 12:09:52 UTC - in response to Message 25337.  
Last modified: 29 Nov 2006, 12:14:07 UTC

I have yet to finish a CPDN work unit so really, what do I know about CPDN? I might be wrong but my thinking is that low performance does not directly increase your chances of having a CPDN crash. Does the data/evidence indicate otherwise?

Mind you I said directly. It can indirectly increase the chance of a crash if you don\'t take precautions. My thinking is that the longer a WU runs, any WU from any project, the more chance it has of crashing due to voltage spikes and noise on the mains power. Power outages are another killer. I have all my crunch boxes attached to UPS, quality spike protection and EMI filter. If you\'re crunching CPDN then you should too, if not UPS then at least quality spike protection, EMI filter and a proper ground on a 3rd prong on the mains receptacle. Spike protection and filter don\'t work optimally when the ground is poor.

I\'m trying Annika\'s strategy on my 1.2 MHz P3 with 512 RAM, ATA 66 HD, probably simlar to Annika\'s laptop wrt resources. I\'m using Fedora Core, no desktop, just CLI. I find my Linus config saves just enough additional RAM compared to XP to significantly reduce paging on other projects. I think I\'m probably doing a lot less paging on CPDN too though I have never crunched CPDN on that machine under XP to give me a solid standard for comparison.

Annika, my question to you is this.... Did you install X and other luxuries that gobble up RAM? Maybe KDE or Gnome? Or are you running a leaner CLI Linux?

Here is a link courtesy of Trog Dog and team BOINC@Australia that explains how to install BOINC on Damn Small Linux aka DSL, one of the smallest distros you\'re likely to find. Never tried it myself but Trog Dog says it\'s good.

I\'ve been thinking of signing up at LinuxQuestions.org and picking a few brains there for ideas on stripping down Linux to the absolute minimum required to run BOINC and crunch CPDN. No frills, no thrills, just the smallest possible install to squeeze the most out of a RAM starved box. I have heard of heavily kernel hacked Linux configurations small enough to live on and boot from a 1.44 meg floppy that has TCP/IP and http. What more would one need to crunch CPDN?

---
ID: 25347 · Report as offensive     Reply Quote
Arnaud

Send message
Joined: 3 Sep 04
Posts: 268
Credit: 256,045
RAC: 0
Message 25349 - Posted: 29 Nov 2006, 15:00:36 UTC
Last modified: 29 Nov 2006, 15:02:02 UTC

I\'m running a CPDN coupled model with only 256 MB of Ram on a Mandriva distro (X and KDE installed, using the Boinc GUI) and have no problem (Desktop P4 2Ghz with 256 MB of Ram)
Arnaud
ID: 25349 · Report as offensive     Reply Quote
old_user202664

Send message
Joined: 13 Oct 06
Posts: 60
Credit: 7,893
RAC: 0
Message 25360 - Posted: 30 Nov 2006, 0:11:50 UTC

As for cooling-no problem there, except maybe in a really hot summer. My lappi has been crunching (SETI, Einstein and HashClash) overnight more than just a few times and never showed the slightest hint at problems (not when I was gaming, doing Inet-Radio streaming, making MP3s or whatever CPU-intensive tasks came to my mind). It does get quite warm, but from my and other peoples\' experience (and the type sheet... is that word right? the CPU\'s description from the manufacturer) this kind of Banias CPUs can take the heat. I do take care of decent air circulation, of course.
Disk speed might be an issue. Sucky IDE HDD, unfortunately.
@astro: Maybe the Windoze version does crunch more efficiently but I couldn\'t get that to run decently on my lappi. So that\'s not really an option. Besides, I need the Linux functionality for other reasons, just as much as the opportunity to collect experience with it. I should have mentioned that BOINC is not the single or even most important purpose of that laptop. Can\'t afford anything like that; I mainly need it for university and for server administration.
For that reason, I also installed GNOME. Normally, I\'m a command-line kind of person, but some of the things I need for uni need a graphical interface. It doesn\'t run all the time, though.
@Dargorath: My first WU definitely didn\'t crash (repeatedly) just because I had bad luck and ran it a long time. Firstly, my Windoze installation at that time was about as stable as that OS can get. So it wasn\'t software failure. Nothing else crashed apart from the climate model. Of course, power outages are not that much concern on a laptop. Besides, furthest I ever got into the model was around 8 hours. So, while your explanation is of course completely correct and helpful if people want to increase stability on their systems, my problems were quite certainly due to memory/CPU problems- or maybe the HDD, good point astro, didn\'t think of that...
ID: 25360 · Report as offensive     Reply Quote
old_user170894
Avatar

Send message
Joined: 3 Mar 06
Posts: 96
Credit: 353,185
RAC: 0
Message 25373 - Posted: 30 Nov 2006, 12:40:21 UTC - in response to Message 25360.  
Last modified: 30 Nov 2006, 12:48:23 UTC

(and the type sheet... is that word right? the CPU\'s description from the manufacturer)


I think you mean data sheet.

Disk speed might be an issue. Sucky IDE HDD, unfortunately.


I don\'t see how slow disk speed can contribute to a model crashing but I\'ve been wrong before.

Of course, power outages are not that much concern on a laptop.


Doh! I don\'t know what I was thinking there. I do standby my suggestion that good spike protection and EMI filter will decrease the chance of a model crashing. OK, maybe not so much the EMI but spikes will get around the battery and possibly cause a few bits to go awry. That\'s all it takes.

@ [AF>Est>Linux]Arnaud... Glad to hear you\'re doing well with less than recommended RAM. It gives me hope. I\'ve been thinking that starting a CPDN on my resource starved system was a mistake that I should reverse before I get too far into the model. But if you can do it then... what the heck... so can I, it\'ll just take me a little longer.


ID: 25373 · Report as offensive     Reply Quote
old_user170894
Avatar

Send message
Joined: 3 Mar 06
Posts: 96
Credit: 353,185
RAC: 0
Message 25376 - Posted: 30 Nov 2006, 16:35:12 UTC - in response to Message 25373.  
Last modified: 30 Nov 2006, 16:36:27 UTC

In this thread at the BOINC site, Mike Mars mentions the coupled models (the type being sent now) need only 90 MB RAM. The suggested minimum RAM is outdated and applys to the old SAP models which are not being sent anymore. So breath easy as far as RAM goes, Annika, I know I will be.


ID: 25376 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 25378 - Posted: 30 Nov 2006, 18:13:14 UTC - in response to Message 25373.  
Last modified: 30 Nov 2006, 18:14:59 UTC

I don\'t see how slow disk speed can contribute to a model crashing but I\'ve been wrong before.


Not exactly on topic -- but not far removed; suggestive:
http://www.climateprediction.net/board/viewtopic.php?p=53422#53422

[Edited to make the link hot.]
"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 25378 · Report as offensive     Reply Quote
ProfileMikeMarsUK
Volunteer moderator
Avatar

Send message
Joined: 13 Jan 06
Posts: 1498
Credit: 15,613,038
RAC: 0
Message 25383 - Posted: 30 Nov 2006, 20:24:16 UTC - in response to Message 25376.  

In this thread at the BOINC site, Mike Mars mentions the coupled models (the type being sent now) need only 90 MB RAM. The suggested minimum RAM is outdated and applys to the old SAP models which are not being sent anymore. So breath easy as far as RAM goes, Annika, I know I will be.



The difference between the recommended RAM and the actual memory used by the model is due to other stuff which may be running and using up memory. For example...

Microsoft XP - 100-200MB
Antivirus - 80MB
Firewall - 20MB
MS word, outlook, etc...

Linux is much leaner and running in 256MB is much more practical.
I'm a volunteer and my views are my own.
News and Announcements and FAQ
ID: 25383 · Report as offensive     Reply Quote
Helmer Bryd

Send message
Joined: 16 Aug 04
Posts: 156
Credit: 9,035,872
RAC: 2,928
Message 25385 - Posted: 30 Nov 2006, 22:29:47 UTC

Linux is better in handling memory and disks.
I had no problem when running SAP that uses 430 mb memory on a box with 512 mb memory installed.
No defrag required either
ID: 25385 · Report as offensive     Reply Quote
old_user170894
Avatar

Send message
Joined: 3 Mar 06
Posts: 96
Credit: 353,185
RAC: 0
Message 25388 - Posted: 30 Nov 2006, 22:42:57 UTC - in response to Message 25378.  


AstroWX, thanks for the link with the answer to my question. The access timeouts explanation makes good sense.

Sorry if my question was off topic. It seemed on topic to me at the time because you mentioned \"HD less capable\" in your first post in this thread. I thought you were saying \"slow HD access can cause a model to crash\" but it appears I was mistaken. Did I miss your point?

ID: 25388 · Report as offensive     Reply Quote
ProfileMikeMarsUK
Volunteer moderator
Avatar

Send message
Joined: 13 Jan 06
Posts: 1498
Credit: 15,613,038
RAC: 0
Message 25390 - Posted: 30 Nov 2006, 23:20:53 UTC


It\'s more that they\'re not designed to run 24/7, get hotter, and are quicker to wear out than larger disk drivers.

I'm a volunteer and my views are my own.
News and Announcements and FAQ
ID: 25390 · Report as offensive     Reply Quote
old_user170894
Avatar

Send message
Joined: 3 Mar 06
Posts: 96
Credit: 353,185
RAC: 0
Message 25391 - Posted: 1 Dec 2006, 0:31:01 UTC - in response to Message 25390.  
Last modified: 1 Dec 2006, 0:54:20 UTC


Yep, I was not quite on topic. Thanks for the patience and info.



ID: 25391 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 25392 - Posted: 1 Dec 2006, 1:13:38 UTC - in response to Message 25388.  


AstroWX, thanks for the link with the answer to my question. The access timeouts explanation makes good sense.

Sorry if my question was off topic. It seemed on topic to me at the time because you mentioned \"HD less capable\" in your first post in this thread. I thought you were saying \"slow HD access can cause a model to crash\" but it appears I was mistaken. Did I miss your point?


It was my answer, not your question, that I thought might be a bit off topic. Sorry about any confusion.
"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 25392 · Report as offensive     Reply Quote
Profileold_user116389
Avatar

Send message
Joined: 25 Nov 05
Posts: 11
Credit: 870,090
RAC: 0
Message 25413 - Posted: 2 Dec 2006, 7:23:22 UTC - in response to Message 25347.  



Here is a link courtesy of Trog Dog and team BOINC@Australia that explains how to install BOINC on Damn Small Linux aka DSL, one of the smallest distros you\'re likely to find. Never tried it myself but Trog Dog says it\'s good.



Thanks for promo, unfortunately, I wasn\'t able to get CPDN to run on DSL and couldn\'t find out why. I can run plenty of other projects on this distro - just not CPDN.
ID: 25413 · Report as offensive     Reply Quote
Profileold_user215584
Avatar

Send message
Joined: 26 Dec 06
Posts: 23
Credit: 11,431
RAC: 0
Message 25740 - Posted: 26 Dec 2006, 17:58:41 UTC
Last modified: 26 Dec 2006, 18:01:43 UTC

I just joined up today and run all Linux machines except for one my little sister uses (it doesn\'t crunch all that much either as its not full time on like my other machines). I did post a how to on setting up a Kubuntu Linux boinc cruncher in the seti forums. Im still waiting to hear back if it worked or not for people new to Linux. One thing i have found is that if you install it this way you can setup your projects and then reboot your machine. As its starts before you log in it crunches away as if it were CLI only (low to no overhead) yet has a nice GUI for easy setup. I haven\'t gone into how to strip back the Install but its a fairly small install anyways. My smallest hard disk is 3.2Gb and has it installed on it with over 1.5Gb (1.7Gb if i remember correctly) to spare and a 500Mb swap drive so it can be stripped back fairly heavily if someone is comfortable doing this.

Anyways heres the link if anyone wants to give Kubuntu a try http://setiathome.berkeley.edu/forum_thread.php?id=36333&nowrap=true#486018
Add to the end of this how to - reboot your computer and do not log back in.
ID: 25740 · Report as offensive     Reply Quote

Message boards : Number crunching : Linux performance

©2024 cpdn.org