climateprediction.net (CPDN) home page
Thread 'Resends.'

Thread 'Resends.'

Message boards : Number crunching : Resends.
Message board moderation

To post messages, you must log in.

AuthorMessage
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 70045 - Posted: 15 Nov 2023, 20:29:06 UTC

I see that Glenn has been doing a sterling job of closing the batches where the results will not be any use. The only open batches now are the last two Windows batches where results are still wanted so any retreads will be from these.
ID: 70045 · Report as offensive     Reply Quote
zombie67 [MM]
Avatar

Send message
Joined: 2 Oct 06
Posts: 54
Credit: 27,309,613
RAC: 28,128
Message 70051 - Posted: 17 Nov 2023, 6:10:03 UTC

I am confused by this. According to the server status page, there are way more than two batches in progress.
ID: 70051 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 70052 - Posted: 17 Nov 2023, 6:20:57 UTC - in response to Message 70051.  

I am confused by this. According to the server status page, there are way more than two batches in progress.


The batches being closed means that when the tasks in progress time out that is the end. The tasks will show as in progress till they error out, complete or time out. Or at least that is my understanding of it. Not sure why full resolution ocean tasks are still showing as in progress though?
ID: 70052 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,490,541
RAC: 15,784
Message 70053 - Posted: 17 Nov 2023, 11:08:08 UTC - in response to Message 70052.  
Last modified: 17 Nov 2023, 11:08:43 UTC

I am confused by this. According to the server status page, there are way more than two batches in progress.
The batches being closed means that when the tasks in progress time out that is the end. The tasks will show as in progress till they error out, complete or time out. Or at least that is my understanding of it. Not sure why full resolution ocean tasks are still showing as in progress though?
Some of that is because of the 1yr deadline for the workunits for the Hadley family of models. I'll be correcting this before the next batches go out. Dunno about the full ocean batch, maybe that's got a 1+ yr deadline? Before my time at CPDN.
ID: 70053 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 70054 - Posted: 17 Nov 2023, 12:14:29 UTC - in response to Message 70053.  

Dunno about the full ocean batch, maybe that's got a 1+ yr deadline? Before my time at CPDN.
They are from back in the days when all tasks went out for Mac, Windows and Linux. 2016 was the last time I ran any of them and I think probably the last of that type was then.
ID: 70054 · Report as offensive     Reply Quote
zombie67 [MM]
Avatar

Send message
Joined: 2 Oct 06
Posts: 54
Credit: 27,309,613
RAC: 28,128
Message 70055 - Posted: 19 Nov 2023, 3:24:06 UTC

Is it possible to (say) just cancel any tasks that have not reported a trickle in the past month? For those batches where any results are no longer useful, of course.
ID: 70055 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 70056 - Posted: 19 Nov 2023, 7:59:50 UTC - in response to Message 70055.  

Is it possible to (say) just cancel any tasks that have not reported a trickle in the past month? For those batches where any results are no longer useful, of course.
No Idea. I have never looked at the server side of things. I vaguely remember something on the BOINC forums that some projects cancel jobs that are no longer needed if they haven't started running yet. CPDN has never implemented this to my knowledge. As for just deleting those you suggest, the real question is whether for the project it is worth the effort given that there are likely to be other priorities for Andy. The batches that have been closed will come off the system as and when they either complete or time out which will tidy things up a lot. It is really only the full resolution ocean tasks that will be left then. My guess is at some point Andy will clear them as he did the even older model types that were removed a year or so ago.
ID: 70056 · Report as offensive     Reply Quote

Message boards : Number crunching : Resends.

©2024 cpdn.org