climateprediction.net (CPDN) home page
Thread 'Waiting for Memory'

Thread 'Waiting for Memory'

Message boards : Number crunching : Waiting for Memory
Message board moderation

To post messages, you must log in.

AuthorMessage
ProfileRick B

Send message
Joined: 17 Feb 09
Posts: 31
Credit: 1,502,582
RAC: 514
Message 38262 - Posted: 5 Nov 2009, 12:33:58 UTC

Ive recently added 2 New Computers and one of them has only 495 MB RAM. This Computer got 2 hadsm3mh and one hadam3p work units to crunch. The hadam3p work unit got to 81% completed then gave me the status message that it was waiting for memory. I\'ve reassigned this computer and its preferences to only ask for the other models as I see on the preferences pages that Hadm3p\'s require 1.5G memory. The model is currently running again with everything else suspended but I guess Im wondering if it will finish? Approximately 23 hrs remain to completion so time will tell ... or should I abort?

Thanks for the help

Rick
Rick





ID: 38262 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 38263 - Posted: 5 Nov 2009, 15:11:31 UTC

It\'s hadam3 that supposedly needs 1.5 GB of RAM, not hadam3p. But hadam3p is the 2nd most memory intensive of all the models, and I could see troubles with running out of memory with it, especially if running in tandem with any other model. With only 500 MB of RAM, running even 2 hadsm3/hadsm3mh models at the same time might get kind of iffy if that PC does anything else.

But you should be able to finish the hadam3p, just maybe not when running another model type as well.
ID: 38263 · Report as offensive     Reply Quote
ProfileRick B

Send message
Joined: 17 Feb 09
Posts: 31
Credit: 1,502,582
RAC: 514
Message 38264 - Posted: 5 Nov 2009, 16:34:27 UTC - in response to Message 38263.  

It\'s hadam3 that supposedly needs 1.5 GB of RAM, not hadam3p. But hadam3p is the 2nd most memory intensive of all the models, and I could see troubles with running out of memory with it, especially if running in tandem with any other model. With only 500 MB of RAM, running even 2 hadsm3/hadsm3mh models at the same time might get kind of iffy if that PC does anything else.

But you should be able to finish the hadam3p, just maybe not when running another model type as well.


Thanks. Ive suspended all other tasks and that one will hopefully finish by tomorrow morning. In the mean time, I\'m looking into adding more RAM to that computer. Is it as simple as matching up the existing RAM and adding it to the remaining 3 slots?
Rick





ID: 38264 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 38265 - Posted: 5 Nov 2009, 16:40:22 UTC - in response to Message 38264.  
Last modified: 5 Nov 2009, 16:41:38 UTC

I\'m looking into adding more RAM to that computer. Is it as simple as matching up the existing RAM and adding it to the remaining 3 slots?

That should work. But check to make sure it\'s not cheaper just to get 2 one GB sticks and using just those instead of getting 3 more identical 512 MB sticks. Either way, your performance should improve, not just due to more memory, but because you\'ll be running the memory in dual channel mode which greatly helps memory bandwidth.
ID: 38265 · Report as offensive     Reply Quote
DJStarfox

Send message
Joined: 27 Jan 07
Posts: 300
Credit: 3,288,263
RAC: 26,370
Message 38266 - Posted: 5 Nov 2009, 16:41:02 UTC - in response to Message 38264.  

Is it as simple as matching up the existing RAM and adding it to the remaining 3 slots?


Actually, that\'s the simplest way I\'ve heard it said. Yes, that approach will work.
ID: 38266 · Report as offensive     Reply Quote
ProfileRick B

Send message
Joined: 17 Feb 09
Posts: 31
Credit: 1,502,582
RAC: 514
Message 38271 - Posted: 5 Nov 2009, 22:02:06 UTC - in response to Message 38265.  

check to make sure it\'s not cheaper just to get 2 one GB sticks and using just those instead of getting 3 more identical 512 MB sticks.


It was actually cheapest to get a 2GB stick ($40) vs 2*1GB sticks at $40 each. Ended up getting 2 and upgraded the home pc from 2 to 4 G and will add the 2 * 1GB sticks from the home computer to the work computer to take it to 2.5G

Thanks for the help


Rick





ID: 38271 · Report as offensive     Reply Quote
ProfileRick B

Send message
Joined: 17 Feb 09
Posts: 31
Credit: 1,502,582
RAC: 514
Message 38280 - Posted: 6 Nov 2009, 13:28:36 UTC - in response to Message 38271.  

To follow up with this thread the HADAM3P did finish and uploaded this morning with the 500 MB RAM. I successfully upgraded the RAM and all is back up and running. Thanks again for the help.


Rick





ID: 38280 · Report as offensive     Reply Quote
Profilemo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 38283 - Posted: 7 Nov 2009, 3:08:49 UTC

If the computer that now has extra memory processes another HadAM in future it will be interesting to see whether the crunching is faster.
Cpdn news
ID: 38283 · Report as offensive     Reply Quote
ProfileRick B

Send message
Joined: 17 Feb 09
Posts: 31
Credit: 1,502,582
RAC: 514
Message 38284 - Posted: 7 Nov 2009, 10:11:19 UTC - in response to Message 38283.  
Last modified: 7 Nov 2009, 10:27:48 UTC

If the computer that now has extra memory processes another HadAM in future it will be interesting to see whether the crunching is faster.


I\'ve designated that computer as \"School\" for its location and selected the HadAM3P as the prefered model to run that test. Will follow up in this thread with the results.

I also added 2G RAM to my home computer at the same time which is currently running HadSM models. It had 2G and now has 4G but Vista only uses 3.4G. Any of the models it runs in the future can be compared to past models to check the comparison to.

This Computer went from 2G Ram to 3.4G RAM Nov 5

This Computer went from 500M RAM to 2.5G RAM Nov 6
Rick





ID: 38284 · Report as offensive     Reply Quote
ProfileRick B

Send message
Joined: 17 Feb 09
Posts: 31
Credit: 1,502,582
RAC: 514
Message 38404 - Posted: 27 Nov 2009, 11:51:24 UTC - in response to Message 38283.  
Last modified: 27 Nov 2009, 12:08:51 UTC

If the computer that now has extra memory processes another HadAM in future it will be interesting to see whether the crunching is faster.


Well the results are in. Well not really.

Im not sure we can say that the increased RAM had any effect on the time to process.

This Computer has only done 2 hadam3p\'s. The first with 500 Meg RAM it did in 405,934.5 seconds (112.8 hrs). The second with 2.5 Gig of RAM it did in 386,609.0 seconds (108.2 hrs).

Comparitively This Computer, which has the exact same CPU and has 2 Gig of RAM, has also done 2 hadam3p models with times of 353,031.8 and 355,470.3 seconds. (98.1 & 98.7 hrs)

A third Computer of mine which has a slightly slower CPU, 2.0 GHz vs 2.2 GHz, has done 24 of these hadam3p\'s. Processing times of these range from 364,930.1 to 427,558.5 seconds (101.4 to 118.8 hrs) with an average of 395,992 seconds (110.0 hrs).

The fourth Computer I have crunching has a 3.4 GHz CPU and 2 Gig of RAM and has completed 10 hadam3p work units. Its average is 373,959.2 seconds (103.9 hrs). The range is tighter on this computer though with a low of 356268.2 and a high of 387300.3 seconds. (99 to 107.6 hrs)

So the question of faster processing speed, in my opinion, is still unanswered. I dont believe I have enough data to answer that with only one work unit being crunched with 500 Meg of RAM and one at 2 Gig of RAM. To get a difinitive answer I think a work unit would have to be crunched twice with both 500 Meg and 2 Gig of Ram on the same CPU.
Rick





ID: 38404 · Report as offensive     Reply Quote
old_user602601

Send message
Joined: 21 Nov 09
Posts: 1
Credit: 41,673
RAC: 0
Message 38405 - Posted: 27 Nov 2009, 19:41:50 UTC



Very interesting.

I\'ve always wondered if more RAM would help the crunch times.

Thanks for taking the time to investigate.

ID: 38405 · Report as offensive     Reply Quote

Message boards : Number crunching : Waiting for Memory

©2024 cpdn.org