climateprediction.net (CPDN) home page
Thread 'New tasks issued December 2023'

Thread 'New tasks issued December 2023'

Message boards : Number crunching : New tasks issued December 2023
Message board moderation

To post messages, you must log in.

AuthorMessage
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,706,621
RAC: 9,524
Message 70086 - Posted: 5 Dec 2023, 8:49:29 UTC

Anyone reading here received one of the 38 IFS tasks shown as 'in progress' on the main site server status page this morning?

I'd like to monitor the progress of at least one, to check progress on the credit issue: I've been in touch with the project team, and we think we've identified a possible cause, but none of my machines picked up a job from this release.

A task, workunit, or host ID number would be most helpful. Many thanks.
ID: 70086 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,432,494
RAC: 17,331
Message 70087 - Posted: 5 Dec 2023, 11:17:39 UTC - in response to Message 70086.  

Richard, the 'in progress' Perturbed Surface OpenIFS tasks are leftovers from the earlier Pert. Surf. batches this year -- they are lost in someone's computer somewhere. The other small batches are tests from Andy.

There will be more to come before the holiday. Did you want one in particular on the main site or would something on the dev site do?
ID: 70087 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,706,621
RAC: 9,524
Message 70088 - Posted: 5 Dec 2023, 13:08:59 UTC - in response to Message 70087.  

Did you want one in particular on the main site or would something on the dev site do?
Thanks, Glenn.

You've seen the discussion between me and head office. They want to run a few tasks through with the extra server-side logging, to confirm the latest theory, and I offered to monitor the external reports again for the same task, to check that both methods point in the same direction. For that, it could be any task, but it would be good to use an agreed task number, so we knew that the comparison was fully justified.

I'm also mindful of your post 70057, where you say

A new Weather-at-Home NZ25 batch is being prepared & tested. It will go out before the Christmas break
- it would be nice to get the credit issue sorted once and for all before that goes out.

With regard to the dev site - I did actually receive several tasks from your Cubic Octahedral tco95 batch on 26 Nov, just as we were looking at the server logs. But they were shortened tasks, running about 90 minutes, and - to coin a couple of phrases - they produced five "upload trickles", but only one "credit trickle", at the very end. That won't do for this test - we need the intermediate credit trickles too.

What might work: use the dev site for the test, but for a WaH2 task - a full-length one, lasting around 8 days and producing 24 of each type of trickle. The server log should confirm the theory within two or three days, and we could then test the proposed revision to the credit script, while the same task is still running. That might be messy, but informative.
ID: 70088 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,432,494
RAC: 17,331
Message 70089 - Posted: 5 Dec 2023, 13:43:37 UTC - in response to Message 70088.  

There will be some WaH tests on the dev site. I've an updated, working, linux WaH code which I'm about to build on Windows once the VM is ready. As it's a new app, it'll be tested on the dev site, let's say in a week or two.

I suggest we take this conversation off-line.
---
CPDN Visiting Scientist
ID: 70089 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,706,621
RAC: 9,524
Message 70090 - Posted: 5 Dec 2023, 13:53:05 UTC - in response to Message 70089.  

OK
ID: 70090 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,016,442
RAC: 21,024
Message 70097 - Posted: 31 Dec 2023, 21:16:19 UTC

A new Weather-at-Home NZ25 batch is being prepared & tested. It will go out before the Christmas break


There were issues with some of the testing tasks. That is why the main site ones have not appeared yet. I am guessing that the holidays are the main reason the issues have not been resolved yet.
ID: 70097 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,432,494
RAC: 17,331
Message 70098 - Posted: 3 Jan 2024, 13:06:29 UTC - in response to Message 70097.  
Last modified: 3 Jan 2024, 13:06:39 UTC

A new Weather-at-Home NZ25 batch is being prepared & tested. It will go out before the Christmas break
There were issues with some of the testing tasks. That is why the main site ones have not appeared yet. I am guessing that the holidays are the main reason the issues have not been resolved yet.
Absolutely.

Happy New Year to all.
---
CPDN Visiting Scientist
ID: 70098 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,016,442
RAC: 21,024
Message 70099 - Posted: 3 Jan 2024, 16:35:47 UTC

And there is also some Hadam4 testing going on which also has a few niggles that need sorting out. I am guessing the testing tasks will be working by the end of this week in all probability. So know that the team at Oxford are not sitting on their hands while nothing is happening on the main site.
ID: 70099 · Report as offensive     Reply Quote

Message boards : Number crunching : New tasks issued December 2023

©2024 cpdn.org