climateprediction.net (CPDN) home page
Thread 'Batches closed'

Thread 'Batches closed'

Message boards : Number crunching : Batches closed
Message board moderation

To post messages, you must log in.

AuthorMessage
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 64640 - Posted: 18 Oct 2021, 11:17:21 UTC

These batches have just been closed:

759, 795, 835, 837, 844, 876, 892, 893, 894, 916, 917, 918
ID: 64640 · Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 15 Jul 17
Posts: 99
Credit: 18,701,746
RAC: 318
Message 64643 - Posted: 18 Oct 2021, 12:52:53 UTC

Then what? Server abort signals?
ID: 64643 · Report as offensive     Reply Quote
SolarSyonyk

Send message
Joined: 7 Sep 16
Posts: 262
Credit: 34,915,412
RAC: 16,463
Message 64645 - Posted: 18 Oct 2021, 18:13:36 UTC

I'll just ask the stupid question here: What does this mean and how do I tell if it impacts any of my active WUs?

Looking at the task and workunit data for my active tasks, I don't see batch listed anywhere.
ID: 64645 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4537
Credit: 19,001,532
RAC: 21,726
Message 64646 - Posted: 18 Oct 2021, 19:11:21 UTC - in response to Message 64645.  

Looking at the task and workunit data for my active tasks, I don't see batch listed anywhere.

This sticky tells you what information you can glean from task names which includes the batch number which is the third number in from the Right _919_ being the most recent batch number.
ID: 64646 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4537
Credit: 19,001,532
RAC: 21,726
Message 64647 - Posted: 18 Oct 2021, 19:22:59 UTC - in response to Message 64645.  

I'll just ask the stupid question here: What does this mean and how do I tell if it impacts any of my active WUs?


Unless you are very slow at completing tasks, it will not impact your work. Even if you are, I am fairly certain you can still get credit from closed batches, however by the time batches are closed, any data returned is no longer any use by the scientists. It would also mean any remaining tasks that hadn't been sent out would be cancelled however given there was no work left in the queue, that was not relevant on this occasion.

I am wondering if it means that tasks returned don't get mentioned on the server status page which shows how many computers have returned tasks within the past 24 hours as since all these batches were closed, "users in past 24 hours" has been zero?
ID: 64647 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 64648 - Posted: 18 Oct 2021, 19:29:46 UTC - in response to Message 64645.  
Last modified: 18 Oct 2021, 22:35:52 UTC

What does this mean


It means that the researchers are finished with those batches, so any still not returned are no longer being accepted by the relevant server.
So Abort any of those that you still have.
ID: 64648 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 64649 - Posted: 18 Oct 2021, 22:06:49 UTC - in response to Message 64647.  

I am wondering if it means that tasks returned don't get mentioned on the server status page which shows how many computers have returned tasks within the past 24 hours as since all these batches were closed, "users in past 24 hours" has been zero?

I think that's because the transitioner isn't running. I'm sure someone has completed hadam4h, hadam4, hadsm4 or wah2 tasks in the last 24 hours.
ID: 64649 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4537
Credit: 19,001,532
RAC: 21,726
Message 64652 - Posted: 19 Oct 2021, 17:05:56 UTC - in response to Message 64649.  

I think that's because the transitioner isn't running. I'm sure someone has completed hadam4h, hadam4, hadsm4 or wah2 tasks in the last 24 hours.



Clearly you are right George, now transitioner running again, server status updates have been happening.
ID: 64652 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,432,494
RAC: 17,331
Message 70026 - Posted: 31 Oct 2023, 13:34:32 UTC

The following OpenIFS batches have now been closed: 944, 945, 946, 947, 990. These batches were issued in Nov/22.

If you have any tasks still running or waiting to run from these batches please Abort them. It is not CPDN policy to remotely abort workunits on volunteer computers.

A closed batch means the project has enough returned results and any remaining uploads will be discarded.

The batch name can be determined from the task name e.g. oifs_a002_201312_25_994_012039265_2. For more details on task naming, see this post.
---
CPDN Visiting Scientist
ID: 70026 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,432,494
RAC: 17,331
Message 70027 - Posted: 31 Oct 2023, 13:54:03 UTC
Last modified: 31 Oct 2023, 14:30:49 UTC

The following hadam4h batches for the ArctiCONNECT project have now been closed: 931, 932. These batches were issued in June/22.

If you have any tasks still running or waiting to run from these batches please Abort them. It is not CPDN policy to remotely abort workunits on volunteer computers.

A closed batch means the project has enough returned results and any remaining uploads will be discarded.

The batch name can be determined from the task name e.g. *_a002_201312_25_994_012039265_2. For more details on task naming, see this post.
ID: 70027 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,432,494
RAC: 17,331
Message 70028 - Posted: 31 Oct 2023, 13:56:47 UTC
Last modified: 31 Oct 2023, 14:31:01 UTC

The following hadsm4 batches for the DOCILE project have now been closed: 937, 938, 939, 940, 941.
These batches were issued in Nov/22.

If you have any tasks still running or waiting to run from these batches please Abort them. It is not CPDN policy to remotely abort workunits on volunteer computers.

A closed batch means the project has enough returned results and any remaining uploads will be discarded.

The batch name can be determined from the task name e.g. *_a002_201312_25_994_012039265_2.
ID: 70028 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4537
Credit: 19,001,532
RAC: 21,726
Message 70275 - Posted: 2 Feb 2024, 11:35:08 UTC

I noticed a sudden big drop in the number of tasks ready to send. Have some of the current batches been cancelled?
ID: 70275 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,432,494
RAC: 17,331
Message 70277 - Posted: 2 Feb 2024, 11:40:47 UTC - in response to Message 70275.  
Last modified: 2 Feb 2024, 11:41:43 UTC

See my post in the EAS 1001-1004 thread. Copied here.

EAS Batches 1002, 1003, 1004 have been closed

An error in the production of the files used by these batches has been found and the results are not scientifically accurate. These batches have been closed, the error will be corrected and the batches resubmitted.

You can kill any tasks currently running with these batch numbers. The batch number can be found in the task title as the second to last number. e.g.
       wah2_eas25_h000_200912_24_1002_012229966

is for batch 1002.

Batch 1001 is unaffected, please keep these tasks running!
---
CPDN Visiting Scientist
ID: 70277 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4537
Credit: 19,001,532
RAC: 21,726
Message 70281 - Posted: 2 Feb 2024, 12:11:25 UTC

See my post in the EAS 1001-1004 thread. Copied here.
Spotted that seconds after posting!
ID: 70281 · Report as offensive     Reply Quote
zombie67 [MM]
Avatar

Send message
Joined: 2 Oct 06
Posts: 54
Credit: 27,309,613
RAC: 28,128
Message 70291 - Posted: 2 Feb 2024, 14:50:23 UTC - in response to Message 70026.  

It is not CPDN policy to remotely abort workunits on volunteer computers.


This is a bad policy, and needs to be changed. If the project is not going to use the results of any tasks out in the wild, they should be aborted from the server side. Otherwise electricity and time are just be wasted. Seems contrary to the goal of CPDN, right?
ID: 70291 · Report as offensive     Reply Quote
wujj123456

Send message
Joined: 14 Sep 08
Posts: 127
Credit: 41,662,895
RAC: 61,039
Message 70292 - Posted: 2 Feb 2024, 17:42:27 UTC - in response to Message 70291.  
Last modified: 2 Feb 2024, 17:46:38 UTC

This is a bad policy, and needs to be changed. If the project is not going to use the results of any tasks out in the wild, they should be aborted from the server side. Otherwise electricity and time are just be wasted. Seems contrary to the goal of CPDN, right?

Agreed. I'd rather server abort these immediately. Given the trickling mechanism, even if it's for credits, it won't affect people's contribution. Can't think of a reason of not aborting them...
ID: 70292 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,432,494
RAC: 17,331
Message 71550 - Posted: 23 Sep 2024, 10:52:40 UTC

The following OpenIFS batches for the STORMS project have now been closed: 1016, 1017, 1018.

The success rate was 98% and the project scientist in Finland is pleased with the results. Thanks to all those who computed these batches.
---
CPDN Visiting Scientist
ID: 71550 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,432,494
RAC: 17,331
Message 71561 - Posted: 30 Sep 2024, 10:41:31 UTC

The Weather@Home New Zealand domain NZ25 batch 1005 has now been closed. This batch was launched 23rd Jan 2024. The batch size was 4650 workunits and the success rate on this batch was 92%. Thanks to all who contributed results.

Closing a batch means no further resends will go out for any failed tasks. Running tasks can finish, the results will be used and credit given.
---
CPDN Visiting Scientist
ID: 71561 · Report as offensive     Reply Quote

Message boards : Number crunching : Batches closed

©2024 cpdn.org