climateprediction.net (CPDN) home page
Thread 'No trickles on webpage'

Thread 'No trickles on webpage'

Message boards : Number crunching : No trickles on webpage
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next

AuthorMessage
ProfileJIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,363,583
RAC: 5,022
Message 58698 - Posted: 5 Sep 2018, 19:24:42 UTC

Are trickles still necessary? I know why they were created. I was there, back in the old days, when slow, single core processors took 6 to 9 months to finished a single 160 year model. Trickles were need back then because it was not reasonable to expect that Crunchers would wait to till a model finished to get their credits.

Things have changed. Models are shorter, processors faster. Today, models take 21 days or less to crunch most models. Many finish in only 3 or 4 days. That is not an unreasonable amount of time to wait for credits. So do we really need them anymore, or have they outlived their usefulness and should be retired.
ID: 58698 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 58700 - Posted: 5 Sep 2018, 22:45:45 UTC - in response to Message 58698.  

It seems there is an underlying assumption in your post that tasks will continue to successful completion.

If you have tasks which crash after days or weeks of processing and all credit is lost, how would you react? Some of the research examines the margins of possible atmospheres and might generate impossible conditions in that search. Trickles provide a way to salvage some/most of the credit for work done. (How do we address the furor arising from those situations?)
"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 58700 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,030,523
RAC: 19,915
Message 58704 - Posted: 6 Sep 2018, 6:40:51 UTC - in response to Message 58700.  

Trickles provide a way to salvage some/most of the credit for work done. (How do we address the furor arising from those situations?)


Do the trickles still give the scientists any information or is that just the zips these days? If the latter, could the receipt of the zips have the same function or would that get complicated due to how them not carrying the credit information in the same way as the trickles?
ID: 58704 · Report as offensive     Reply Quote
Albert H.

Send message
Joined: 18 Feb 06
Posts: 73
Credit: 61,672,499
RAC: 47,431
Message 58706 - Posted: 6 Sep 2018, 6:50:03 UTC - in response to Message 51152.  

Credit is there and it seems to be correct. Gooooood job.
ID: 58706 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,030,523
RAC: 19,915
Message 58711 - Posted: 6 Sep 2018, 12:49:50 UTC - in response to Message 58706.  

Credit is there and it seems to be correct. Gooooood job.


I pay little enough attention to mine that I have no idea whether it is correct or not, just that my total has gone up and my recent average down. The latter is no great surprise after so long without any work.I haven't tried to investigate yet whether the trickles not showing on the task pages means the credit is a bit out of date or not.
ID: 58711 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,030,523
RAC: 19,915
Message 58742 - Posted: 10 Sep 2018, 12:55:05 UTC

Of my four tasks running under Linux, all are showing the first trickle including one that uploaded yesterday. The others should have 3, 5 and 6 trickles showing yet only the first appears on the task page. I wonder if this is an issue specific to this batch of hadcm3s tasks?
ID: 58742 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,030,523
RAC: 19,915
Message 58745 - Posted: 11 Sep 2018, 9:29:22 UTC - in response to Message 58742.  

Done some checking and it seems all of batch 749 are only showing 1st trickle and only have credit for that. Project now informed. The relatively small numbers of these tasks seems to have let me report it before the complaints appear.
ID: 58745 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,030,523
RAC: 19,915
Message 58748 - Posted: 11 Sep 2018, 13:50:12 UTC - in response to Message 58745.  

David has replied and informed me that this will be looked at in the next few days.
ID: 58748 · Report as offensive     Reply Quote
bernard_ivo

Send message
Joined: 18 Jul 13
Posts: 438
Credit: 25,620,508
RAC: 4,981
Message 58757 - Posted: 13 Sep 2018, 16:33:21 UTC

I do not see any trickles after 11.09 for any batch/machines I have.

I also have one sam25 batch 742 received 09.09 that hasn't recorded a trickle on the web.
ID: 58757 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 58761 - Posted: 14 Sep 2018, 1:53:24 UTC - in response to Message 58757.  

I do not see any trickles after 11.09 for any batch/machines I have.

I also have one sam25 batch 742 received 09.09 that hasn't recorded a trickle on the web.

This has been communicated to the project people.
ID: 58761 · Report as offensive     Reply Quote
Albert H.

Send message
Joined: 18 Feb 06
Posts: 73
Credit: 61,672,499
RAC: 47,431
Message 58769 - Posted: 18 Sep 2018, 17:57:13 UTC - in response to Message 58761.  

All missing trickles are there, but credit is actually missing. This is the next job to follow.
Well done....thanks
ID: 58769 · Report as offensive     Reply Quote
Waldmeister

Send message
Joined: 13 Jun 11
Posts: 34
Credit: 1,416,714
RAC: 311
Message 58770 - Posted: 18 Sep 2018, 18:00:29 UTC - in response to Message 58757.  

I do not see any trickles after 11.09 for any batch/machines I have.

I also have one sam25 batch 742 received 09.09 that hasn't recorded a trickle on the web.


Just until one hour ago I also was missing all trickles for my current task , that is running for the last 5+ days. But hodiho, trickles have been inserted during the last hour and are showing up now.

Good work!
ID: 58770 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,030,523
RAC: 19,915
Message 58771 - Posted: 19 Sep 2018, 6:58:04 UTC

All missing trickles are there, but credit is actually missing. This is the next job to follow.



The credit won't show till next time the credit script is run on Saturday. Not sure what happened to the new script that would be able to run daily.
ID: 58771 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,030,523
RAC: 19,915
Message 58772 - Posted: 19 Sep 2018, 7:08:58 UTC

Though batch 749, only the first trickles seem to show. This is true both for completed tasks and those still in progress. I had a first one go through last night which is showing so it is not just trickles sent before something went wrong showing.
These are the hadcm3s models that I think only went out to Linux and Mac hosts.
ID: 58772 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,030,523
RAC: 19,915
Message 58785 - Posted: 20 Sep 2018, 14:08:25 UTC - in response to Message 58772.  

From the project.
Hi Dave,

Batch 749 is HadCM3 and I think we have seen the “only a single trickle appearing” error before for this model. It is a bit confusing as it produces trickles ok in a local run. I an afraid I don’t have much time at the moment to do fault finding on this but I will add it to the to-do list.

Best wishes,
Sarah

I have given a bit more information to Sarah in that the trickles appear to upload fine according to my event log so we will have to wait and see on this one.
ID: 58785 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,030,523
RAC: 19,915
Message 58804 - Posted: 24 Sep 2018, 11:20:41 UTC - in response to Message 58785.  

Looking at my tasks' web pages, the credit seems to be going up as expected despite the trickles not appearing there.

That probably explains the lack of furore here about it.
ID: 58804 · Report as offensive     Reply Quote
ProfileBonsai911

Send message
Joined: 9 Sep 04
Posts: 228
Credit: 30,754,933
RAC: 3,639
Message 58815 - Posted: 26 Sep 2018, 12:59:11 UTC
Last modified: 26 Sep 2018, 13:05:14 UTC

ID: 58815 · Report as offensive     Reply Quote
bernard_ivo

Send message
Joined: 18 Jul 13
Posts: 438
Credit: 25,620,508
RAC: 4,981
Message 58816 - Posted: 26 Sep 2018, 16:56:48 UTC - in response to Message 58815.  

All my WUs do not show trickles on the web some time after early morning on 21st.
ID: 58816 · Report as offensive     Reply Quote
Harri Liljeroos

Send message
Joined: 9 Dec 05
Posts: 116
Credit: 12,547,934
RAC: 2,738
Message 58819 - Posted: 28 Sep 2018, 17:56:10 UTC

New trickles finally visible for new tasks.
ID: 58819 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,030,523
RAC: 19,915
Message 58820 - Posted: 30 Sep 2018, 6:23:39 UTC

But not the hadcm3s tasks. They are only showing the first trickle but on comparing the 12 and 120 month tasks it seems that once the first trickle is posted the credit for the whole task is granted. I will email project again.
ID: 58820 · Report as offensive     Reply Quote
Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next

Message boards : Number crunching : No trickles on webpage

©2024 cpdn.org