climateprediction.net (CPDN) home page
Thread 'New work Discussion'

Thread 'New work Discussion'

Message boards : Number crunching : New work Discussion
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 60 · 61 · 62 · 63 · 64 · 65 · 66 . . . 91 · Next

AuthorMessage
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 63632 - Posted: 9 Mar 2021, 18:28:38 UTC - in response to Message 63631.  

897 and 898 are N216 type, so they like lots of L3 cache.
ID: 63632 · Report as offensive
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 63633 - Posted: 9 Mar 2021, 18:32:53 UTC - in response to Message 63631.  

This is longer than the previous batch (891), which ran for 9 1/2 days under comparable conditions.
So either they are bigger work units, or else take up more cache are are slowing down the processing.

Do you know which?

Batches 891 and 895 were both faster. All previous and now later N216 batches are slower. I don't know what the special case was with 891 and 895 but they seem to be the exception.
ID: 63633 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,022,240
RAC: 20,762
Message 63634 - Posted: 9 Mar 2021, 18:50:16 UTC

Estimated times for 895 and 898 are the same on my box. My #898s are waiting to run. I have suspended one of my 895s to compare but it will be a while till I know what happens on my machine. Also running 8 hadcm3s tasks alongside my N216 tasks my affect the answer.
Please do not private message myself or other moderators for help. This limits the number of people who are able to help and deprives others who may benefit from the answer.
ID: 63634 · Report as offensive
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 63637 - Posted: 9 Mar 2021, 20:44:09 UTC - in response to Message 63634.  

Sorry, my bad, the fast ones were 889, 891 and 895, basically the CDDHDD N216 tasks. All the others were slower. So, when the 889 tasks were released in mid Dec, my i7 4790K grabbed 8 of them (all 5 month models) and finished them in a bit less than 930000 CPU seconds, running 4 at a time. That averages out to about 21.35 sec/TS. After those were through, the i7 grabbed 2 from batch 883 and 2 from 863 and those averaged about 22 sec/TS. So for running them over a week and a half, a 5 month run was about 8 hours faster in those batches. Not a big deal but noticeable when looking at sec/TS since it was consistent.

On my 3600X, running 5 N216 5 month models at a time, they averaged about 658000 CPU secs to complete. The older runs when they got thrown into the mix averaged about 680000 CPU secs. So a difference of 15.1 sec/TS to 15.6 sec/TS. Not a big deal, but consistent across batches.

Now that the hadcm3s are getting thrown into the mix, it makes the comparison harder.
ID: 63637 · Report as offensive
ProfileAlan K

Send message
Joined: 22 Feb 06
Posts: 491
Credit: 30,994,950
RAC: 14,359
Message 63640 - Posted: 9 Mar 2021, 23:27:57 UTC - in response to Message 63637.  

The one hadcm3 that I have currently running is going at about 2.1sec/ts whereas the two N216s are about 50sec/ts if that is a guide.
ID: 63640 · Report as offensive
Bryn Mawr

Send message
Joined: 28 Jul 19
Posts: 150
Credit: 12,830,559
RAC: 228
Message 63645 - Posted: 10 Mar 2021, 5:44:28 UTC - in response to Message 63640.  
Last modified: 10 Mar 2021, 5:48:26 UTC

The one hadcm3 that I have currently running is going at about 2.1sec/ts whereas the two N216s are about 50sec/ts if that is a guide.


What cpu are you using?

Both my Ryzen 7 3700x (3 cp + 4 Rosetta + 9 WCG/tn-grid) and my Ryzen 9 3900 (4 cp + 6 Rosetta + 14 WCG/tn-grid) are running at about 20 sec/TS for the 216s and about 0.7 sec/TS for the hadcm3s.
ID: 63645 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,022,240
RAC: 20,762
Message 63646 - Posted: 10 Mar 2021, 7:17:05 UTC - in response to Message 63645.  

Interesting,
On my Ryzen3700X the 216s are all going between 16 and 19S/TS and the HADCM3'S AT 1.2S/TS. That is running 4x 216 tasks and 8 of the hadcm3s ones. Some of that is I suspect due to only having 32GB of RAM.
Please do not private message myself or other moderators for help. This limits the number of people who are able to help and deprives others who may benefit from the answer.
ID: 63646 · Report as offensive
Bryn Mawr

Send message
Joined: 28 Jul 19
Posts: 150
Credit: 12,830,559
RAC: 228
Message 63647 - Posted: 10 Mar 2021, 7:25:03 UTC - in response to Message 63646.  

Interesting,
On my Ryzen3700X the 216s are all going between 16 and 19S/TS and the HADCM3'S AT 1.2S/TS. That is running 4x 216 tasks and 8 of the hadcm3s ones. Some of that is I suspect due to only having 32GB of RAM.


Woops, I’m still getting away with 16gb on each machine. I keep meaning to upgrade but I still have free memory with my mix of tasks.
ID: 63647 · Report as offensive
[SG]Felix

Send message
Joined: 4 Oct 15
Posts: 34
Credit: 9,075,151
RAC: 374
Message 63648 - Posted: 10 Mar 2021, 7:42:53 UTC

I am also impressed, which amount some people need to run CPDN.
Right now i am running 3 N216 hadam4h wus in a vm, and they need together with the os 4,9-5gb of ram. all three together!
By looking per task, the need around 1,3-1,4gb/task.

Greets from Germany
Felix
ID: 63648 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,022,240
RAC: 20,762
Message 63649 - Posted: 10 Mar 2021, 17:51:11 UTC
Last modified: 10 Mar 2021, 17:55:07 UTC

Out of 8 hadcm3 tasks one of them has failed with, "invalid theta" which usually means in impossible climate has been produced e.g. a -ve pressure is one that has occurred in the past.

This one failed shortly before the 9th zip was created.
ID: 63649 · Report as offensive
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 63650 - Posted: 10 Mar 2021, 18:06:53 UTC - in response to Message 63649.  

Out of 8 hadcm3 tasks one of them has failed with, "invalid theta" which usually means in impossible climate has been produced e.g. a -ve pressure is one that has occurred in the past.

This one failed shortly before the 9th zip was created.
That did make me laugh, "an impossible climate". Or.... have you discovered a new law of physics? Who's to say we can't have negative pressures? Contact James Dyson now!
ID: 63650 · Report as offensive
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 63655 - Posted: 10 Mar 2021, 19:26:16 UTC - in response to Message 63650.  

You have'n' a clue about the subject matter, have you?
ID: 63655 · Report as offensive
Jim1348

Send message
Joined: 15 Jan 06
Posts: 637
Credit: 26,751,529
RAC: 653
Message 63657 - Posted: 10 Mar 2021, 20:14:34 UTC
Last modified: 10 Mar 2021, 20:14:58 UTC

I now have four trickles, for my hadam4h (three 897 and one 898), and they are all 29 sec/TS.
It took three days for the first ones though on a Ryzen 3600.
ID: 63657 · Report as offensive
ProfileAlan K

Send message
Joined: 22 Feb 06
Posts: 491
Credit: 30,994,950
RAC: 14,359
Message 63658 - Posted: 10 Mar 2021, 23:31:10 UTC - in response to Message 63645.  

i5-4690 @ 3.5GHz running Ubuntu20.04 in a Virtualbox VM. I think that VB has a high overhead somewhere as the N216 tasks run faster in a VMware VM.
ID: 63658 · Report as offensive
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 63659 - Posted: 11 Mar 2021, 3:16:21 UTC - in response to Message 63658.  

i5-4690 @ 3.5GHz running Ubuntu20.04 in a Virtualbox VM. I think that VB has a high overhead somewhere as the N216 tasks run faster in a VMware VM.

That's what I found as well. I have not idea why.
ID: 63659 · Report as offensive
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 63671 - Posted: 11 Mar 2021, 18:56:01 UTC - in response to Message 63655.  

You have'n' a clue about the subject matter, have you?
I have an honours degree in Physics, so yes I do. I also have a sense of humour and an open mind.
ID: 63671 · Report as offensive
Bryn Mawr

Send message
Joined: 28 Jul 19
Posts: 150
Credit: 12,830,559
RAC: 228
Message 63673 - Posted: 11 Mar 2021, 19:52:26 UTC - in response to Message 63671.  

You have'n' a clue about the subject matter, have you?
I have an honours degree in Physics, so yes I do. I also have a sense of humour and an open mind.


OK, care to describe how a negative pressure (as an absolute value rather than a relative value) would work or is that an example of your humour?
ID: 63673 · Report as offensive
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 63688 - Posted: 13 Mar 2021, 19:40:00 UTC - in response to Message 63673.  

You have'n' a clue about the subject matter, have you?
I have an honours degree in Physics, so yes I do. I also have a sense of humour and an open mind.


OK, care to describe how a negative pressure (as an absolute value rather than a relative value) would work or is that an example of your humour?
Same way as electron holes in semiconductors, antimatter, etc, etc. Just because we haven't discovered it yet doesn't mean it doesn't exist.
ID: 63688 · Report as offensive
Bryn Mawr

Send message
Joined: 28 Jul 19
Posts: 150
Credit: 12,830,559
RAC: 228
Message 63690 - Posted: 13 Mar 2021, 20:40:26 UTC - in response to Message 63688.  
Last modified: 13 Mar 2021, 20:42:03 UTC

You have'n' a clue about the subject matter, have you?
I have an honours degree in Physics, so yes I do. I also have a sense of humour and an open mind.


OK, care to describe how a negative pressure (as an absolute value rather than a relative value) would work or is that an example of your humour?
Same way as electron holes in semiconductors, antimatter, etc, etc. Just because we haven't discovered it yet doesn't mean it doesn't exist.


You cannot have a lower pressure than an absolute vacuum in the same way that you cannot have a temperature lower than absolute zero. It isn’t a case of we haven’t discovered it yet - the scale stops.
ID: 63690 · Report as offensive
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 63691 - Posted: 13 Mar 2021, 22:55:42 UTC - in response to Message 63690.  

You have'n' a clue about the subject matter, have you?
I have an honours degree in Physics, so yes I do. I also have a sense of humour and an open mind.


OK, care to describe how a negative pressure (as an absolute value rather than a relative value) would work or is that an example of your humour?
Same way as electron holes in semiconductors, antimatter, etc, etc. Just because we haven't discovered it yet doesn't mean it doesn't exist.


You cannot have a lower pressure than an absolute vacuum in the same way that you cannot have a temperature lower than absolute zero. It isn’t a case of we haven’t discovered it yet - the scale stops.
The scale we currently use. If you lived back when the earth was flat, going right round would seem equally insane.
ID: 63691 · Report as offensive
Previous · 1 . . . 60 · 61 · 62 · 63 · 64 · 65 · 66 . . . 91 · Next

Message boards : Number crunching : New work Discussion

©2024 cpdn.org