climateprediction.net (CPDN) home page
Thread 'Progress percentage and trickles'

Thread 'Progress percentage and trickles'

Message boards : Number crunching : Progress percentage and trickles
Message board moderation

To post messages, you must log in.

AuthorMessage
Paul

Send message
Joined: 14 Feb 06
Posts: 31
Credit: 4,507,116
RAC: 2,013
Message 71249 - Posted: 15 Aug 2024, 8:44:24 UTC

I'd always assumed that as there were 20 trickles for each task, the progress percentage would "match" that and increase by 5% for each trickle. Note that I've never thought to check that, so it could be completely wrong.

But on batches 1020, 1022, 1023 and 1027 I'm definitely not seeing this. For example, there is a batch 1020 task at 79.80% that has 19 trickles, and a batch 1022 task that is at 38.76% that has has 10 trickles.

So are there more trickles on these batches? Or is there something else going on?

Thanks!
ID: 71249 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4537
Credit: 19,001,532
RAC: 21,726
Message 71250 - Posted: 15 Aug 2024, 8:59:20 UTC

I'd always assumed that as there were 20 trickles for each task, the progress percentage would "match" that and increase by 5% for each trickle. Note that I've never thought to check that, so it could be completely wrong.
The 20 trickles isn't a constant. This completed task from 1022

wah2_eas25_n39o_201912_24_1022_012316411_0 certainly had 20 trickles. I haven't paid attention to the timing of them but I would expect them to be evenly spaced throughout a task's progress. The _24_ in the task name tells you the number of model months. I am pretty sure that in the past some batches have had the trickle up messages aligned with the production of the zips which would have given this task 24 trickle up messages. Glenn would probably be able to give you a more definitive answer.
ID: 71250 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,700,823
RAC: 9,977
Message 71251 - Posted: 15 Aug 2024, 9:06:16 UTC - in response to Message 71249.  

If you look at your current WaH2 task by name - WaH2 tasks for host 1465867, you'll see names like:

wah2_eas25_3043_208912_24_1027_012338530_0

I've marked the planned number of trickles and the batch number. Other task types will have different trickle counts when complete.
ID: 71251 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,700,823
RAC: 9,977
Message 71252 - Posted: 15 Aug 2024, 9:15:09 UTC - in response to Message 71250.  

20 is the maximum number of trickles displayed on the result page. If you look at a task still in progress, like task 22496690, you'll see that the oldest trickle (at the bottom), is at timestep 11,819. But if you look at a completed WaH2 task like task 22430652, the oldest trickle is at timestep 57,899 - four have dropped off the bottom of the displayed list.
ID: 71252 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,432,494
RAC: 17,331
Message 71255 - Posted: 15 Aug 2024, 10:07:48 UTC - in response to Message 71252.  

The number of trickles is the same for all tasks in a batch and the same for all batches in a project like EAS25. It can happen that network delays cause trickles to arrive late. For the EAS25 batches, the output files with the model results are going to the scientists in South Korea, whereas the trickles are going back to Oxford/CPDN.
---
CPDN Visiting Scientist
ID: 71255 · Report as offensive     Reply Quote
Paul

Send message
Joined: 14 Feb 06
Posts: 31
Credit: 4,507,116
RAC: 2,013
Message 71279 - Posted: 16 Aug 2024, 10:32:31 UTC

Thanks for all your comments, especially those from Richard showing the "secret" coding of the number of trickles. 🙂

It's always nice to learn something.
ID: 71279 · Report as offensive     Reply Quote

Message boards : Number crunching : Progress percentage and trickles

©2024 cpdn.org