climateprediction.net (CPDN) home page
Thread 'New work discussion - 2'

Thread 'New work discussion - 2'

Message boards : Number crunching : New work discussion - 2
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 10 · 11 · 12 · 13 · 14 · 15 · 16 . . . 42 · Next

AuthorMessage
AndreyOR

Send message
Joined: 12 Apr 21
Posts: 317
Credit: 14,805,338
RAC: 19,843
Message 66510 - Posted: 17 Nov 2022, 22:05:18 UTC - in response to Message 66506.  

Is the timing of the recent releases of a lot of N144s just coincidental? In an earlier post it seemed to me like you implied that they were related and why I asked if they were dependent on each other in any way. Resource availability will be a lot less for OpenIFS now that users are processing the several thousand Hadley models.
ID: 66510 · Report as offensive
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,696,681
RAC: 10,226
Message 66511 - Posted: 17 Nov 2022, 22:09:46 UTC - in response to Message 66510.  

That'll be helpful. It'll slow down the surge in requests for the new work, and reduce the bandwidth needed to supply every host with a copy of the new application.
ID: 66511 · Report as offensive
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1048
Credit: 16,431,665
RAC: 17,512
Message 66512 - Posted: 17 Nov 2022, 22:33:06 UTC - in response to Message 66510.  

Is the timing of the recent releases of a lot of N144s just coincidental? In an earlier post it seemed to me like you implied that they were related and why I asked if they were dependent on each other in any way. Resource availability will be a lot less for OpenIFS now that users are processing the several thousand Hadley models.
no they are not related at all. I think I mentioned that in an earlier response. Hadsm was ready to go whilst oifs testing needed longer. There's still plenty of spare capacity to run these.
ID: 66512 · Report as offensive
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1048
Credit: 16,431,665
RAC: 17,512
Message 66521 - Posted: 18 Nov 2022, 18:12:53 UTC

I've created a new thread 'OpenIFS frequently asked questions', as there will be more OpenIFS tasks appearing soon and I see similar questions often on this thread.

@Moderators, I wasn't sure where best to put this. The intention is that I update this from time to time and anyone is free to pose new questions to the thread.

I also wondered about starting an 'OpenIFS Discussion' thread to take some of the heat off this one?
ID: 66521 · Report as offensive
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 66522 - Posted: 18 Nov 2022, 19:32:51 UTC - in response to Message 66521.  

I also wondered about starting an 'OpenIFS Discussion' thread to take some of the heat off this one?


Seems to me to be a good idea. If the commuity does not care, the thread will empty. Does an empty thread consume a lot of resources? I doubt it.
ID: 66522 · Report as offensive
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 66523 - Posted: 18 Nov 2022, 20:13:54 UTC - in response to Message 66522.  

The thread is just below this one. :)
ID: 66523 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4535
Credit: 18,989,107
RAC: 21,788
Message 66532 - Posted: 20 Nov 2022, 16:47:38 UTC
Last modified: 20 Nov 2022, 18:31:37 UTC

Just completed two OpenIFS tasks from testing site. Also got a bunch of resends from main site to keep me going for a day and a bit.

Edit:Peak working set size of the OpenIFS tasks was 6.6GB
ID: 66532 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4535
Credit: 18,989,107
RAC: 21,788
Message 66533 - Posted: 22 Nov 2022, 12:25:55 UTC

And the last of the seven resends I got on Sunday has now finished. Bring on the 64bit models!
ID: 66533 · Report as offensive
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 66534 - Posted: 22 Nov 2022, 13:25:31 UTC - in response to Message 66533.  
Last modified: 22 Nov 2022, 13:31:45 UTC

I still have about 15 hours to go on each of these. Both currently running.

hadsm4_a07y_201312_3_941_012161103_1
hadsm4_a0hj_201312_3_941_012161448_1

I finished four yesterday. and one very early this morning.

So YES!
Bring on the 64bit models!

ID: 66534 · Report as offensive
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,696,681
RAC: 10,226
Message 66535 - Posted: 22 Nov 2022, 14:09:14 UTC

I've got both server status pages (main and dev) open, waiting for the F5 refresh. but no sign of any IFS work so far.
ID: 66535 · Report as offensive
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66536 - Posted: 22 Nov 2022, 14:33:50 UTC - in response to Message 66535.  

I've got both server status pages (main and dev) open, waiting for the F5 refresh. but no sign of any IFS work so far.
[Rolls eyes] You'd think Christmas was coming.
ID: 66536 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4535
Credit: 18,989,107
RAC: 21,788
Message 66537 - Posted: 22 Nov 2022, 18:06:43 UTC - in response to Message 66535.  

I've got both server status pages (main and dev) open, waiting for the F5 refresh. but no sign of any IFS work so far.
Nope, nothing since the 2 I got from dev on Sunday evening at a time only essential services normally work ;)
ID: 66537 · Report as offensive
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1048
Credit: 16,431,665
RAC: 17,512
Message 66538 - Posted: 22 Nov 2022, 18:19:23 UTC - in response to Message 66537.  

I've got both server status pages (main and dev) open, waiting for the F5 refresh. but no sign of any IFS work so far.
Nope, nothing since the 2 I got from dev on Sunday evening at a time only essential services normally work ;)
What are you guys like! :)

On train back from Oxford. 4 tests went in the Dev queue today. Two OpenIFS projects going to release 1000s of tasks next week if tests succeed.

These are 64bit, single core, do not require any other libraries. They need 6-7Gb RAM. Strongly suggest not to cram as many as will fit in your machine memory as this model moves lot of data in memory around.
ID: 66538 · Report as offensive
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66539 - Posted: 22 Nov 2022, 18:27:41 UTC - in response to Message 66538.  

What are you guys like! :)
Impatient and keen.

They need 6-7Gb RAM. Strongly suggest not to cram as many as will fit in your machine memory as this model moves lot of data in memory around.
Upgrades will be applied as necessary.

Just make it work in Windows please! You'd get so many more hosts....
ID: 66539 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4535
Credit: 18,989,107
RAC: 21,788
Message 66540 - Posted: 22 Nov 2022, 20:18:57 UTC

Just make it work in Windows please! You'd get so many more hosts....
With all the Linux hosts that are missing the libraries for the Met office models, there will be a lot more Linux hosts to run the tasks hopefully successfully than with previous tasks.
ID: 66540 · Report as offensive
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66541 - Posted: 22 Nov 2022, 21:24:03 UTC - in response to Message 66540.  

Just make it work in Windows please! You'd get so many more hosts....
With all the Linux hosts that are missing the libraries for the Met office models, there will be a lot more Linux hosts to run the tasks hopefully successfully than with previous tasks.
It amazes me there wasn't an automated way of telling the users those libraries should be installed.
ID: 66541 · Report as offensive
ProfileAlan K

Send message
Joined: 22 Feb 06
Posts: 491
Credit: 30,961,816
RAC: 14,107
Message 66542 - Posted: 22 Nov 2022, 23:15:13 UTC - in response to Message 66541.  

Just make it work in Windows please! You'd get so many more hosts....
With all the Linux hosts that are missing the libraries for the Met office models, there will be a lot more Linux hosts to run the tasks hopefully successfully than with previous tasks.
It amazes me there wasn't an automated way of telling the users those libraries should be installed.

Unfortunately they are the "set it and forget it" brigade who don't look at why they are getting hundreds (or thousands) of "computation error" messages on their tasks. Also I wouldn't mind betting that they don't look at these message boards either.
ID: 66542 · Report as offensive
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66543 - Posted: 23 Nov 2022, 7:09:21 UTC - in response to Message 66542.  

Unfortunately they are the "set it and forget it" brigade who don't look at why they are getting hundreds (or thousands) of "computation error" messages on their tasks. Also I wouldn't mind betting that they don't look at these message boards either.
But the project should do something about it. The simplest thing is a restriction on how many failed tasks a host gets before it doesn't get any more for a week. They'd soon notice they were getting nothing, and it would stop them hogging tasks others could be doing, and decrease load on the server. Or even better, something in the notices in Boinc saying "missing library, type this command to get it".

Not sure why this problem exists in the first place, I've never had to get a library in Windows. Can't it be included in the download for the task?
ID: 66543 · Report as offensive
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1048
Credit: 16,431,665
RAC: 17,512
Message 66544 - Posted: 23 Nov 2022, 7:23:00 UTC - in response to Message 66540.  

Just make it work in Windows please! You'd get so many more hosts....
With all the Linux hosts that are missing the libraries for the Met office models, there will be a lot more Linux hosts to run the tasks hopefully successfully than with previous tasks.

I've already answered this multiple times, I'm not going to repeat myself. Windows users can run virtual box if they are that desperate, if they have technical skills they can help with the work or fund it. Cpdn have just one funded programmer, just one, for the whole project. And volunteers. There is really no point keep repeating the same question, it doesn't make the work go any faster.
ID: 66544 · Report as offensive
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66545 - Posted: 23 Nov 2022, 7:29:49 UTC - in response to Message 66544.  

I've already answered this multiple times, I'm not going to repeat myself. Windows users can run virtual box if they are that desperate,
But not automatically within Boinc yet presumably.

if they have technical skills they can help with the work or fund it. Cpdn have just one funded programmer, just one, for the whole project. And volunteers.
In projects such as asteroids, there are volunteers helping code OpenCL for GPUs for example. Have you obtained the services of us users for here too? (Not myself, but I'm sure there are many).
ID: 66545 · Report as offensive
Previous · 1 . . . 10 · 11 · 12 · 13 · 14 · 15 · 16 . . . 42 · Next

Message boards : Number crunching : New work discussion - 2

©2024 cpdn.org