climateprediction.net (CPDN) home page
Thread 'New work Discussion'

Thread 'New work Discussion'

Message boards : Number crunching : New work Discussion
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 11 · 12 · 13 · 14 · 15 · 16 · 17 . . . 91 · Next

AuthorMessage
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4535
Credit: 18,989,107
RAC: 21,788
Message 57677 - Posted: 20 Jan 2018, 8:26:51 UTC - in response to Message 57676.  

When a task finishes, taskname.restart.zip is one of the files uploaded. This being produced at the end of the first month when zip.1 is produced is unusual though I think there have been occasional batches which did this before. My post was intended to forestall queries by anyone noticing this strange behaviour.

The restart.zip is sometimes used to generate further tasks. While I have seen the information that says it is being generated early for this batch, there was no explanation as to why.
ID: 57677 · Report as offensive
Eirik Redd

Send message
Joined: 31 Aug 04
Posts: 391
Credit: 219,896,461
RAC: 649
Message 57681 - Posted: 21 Jan 2018, 9:01:41 UTC - in response to Message 57677.  

Thanks. It all seems confusing still, but there's a lot of complexity that most of us don't grok.
ID: 57681 · Report as offensive
DJStarfox

Send message
Joined: 27 Jan 07
Posts: 300
Credit: 3,288,263
RAC: 26,370
Message 57684 - Posted: 21 Jan 2018, 23:28:33 UTC

Speaking of new work, I just got a single hadcm3s model after many months of nothing. Seems very random. Now, the server's queue is 27 but I have no idea which model these are.
ID: 57684 · Report as offensive
ProfileIain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1084
Credit: 7,803,756
RAC: 5,187
Message 57685 - Posted: 22 Jan 2018, 0:20:19 UTC - in response to Message 57684.  

Speaking of new work, I just got a single hadcm3s model after many months of nothing. Seems very random. Now, the server's queue is 27 but I have no idea which model these are.

The 27 is some BOINC server bug, and similar things apparently happen on other BOINC projects: 27 is really zero.
ID: 57685 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4535
Credit: 18,989,107
RAC: 21,788
Message 57689 - Posted: 22 Jan 2018, 8:47:52 UTC

I just got a single hadcm3s model after many months of nothing.


My guess is that the hadcm3s you got is one that has either been aborted or failed on another machine.
ID: 57689 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4535
Credit: 18,989,107
RAC: 21,788
Message 57717 - Posted: 24 Jan 2018, 20:15:59 UTC
Last modified: 24 Jan 2018, 20:22:35 UTC

Three new batches totalling about 23,000 tasks have gone in the hopper. Batches 703,704 and 705. all SAS region, 50Km squares.
An inordinately high number of these seem to be crashing so they may be withdrawn. However the reason for the crashes may be down to something in the restart files from the tasks they are based on and may not affect all tasks. If anyone has tasks from these batches that are running normally please let us know. (The crashes all happen in the first few seconds. (about 13 on my box.))

Edit: unsent tasks have or are being paused.
ID: 57717 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4535
Credit: 18,989,107
RAC: 21,788
Message 57727 - Posted: 25 Jan 2018, 16:48:02 UTC

Just downloaded a 706 so I am presuming the last withdrawn batch is going out at 706,707 and 708. The problem has been identified and I have a task which is 7 minutes in, well past the problem area caused by some misconfigured files on previous three batches.
ID: 57727 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4535
Credit: 18,989,107
RAC: 21,788
Message 57730 - Posted: 26 Jan 2018, 7:10:24 UTC

Just confirming that these tasks have all been released now under the new batch numbers.
ID: 57730 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4535
Credit: 18,989,107
RAC: 21,788
Message 57733 - Posted: 29 Jan 2018, 11:14:51 UTC

Batch 709 25Km squares (higher resolution) covering the Eur region. something over 9,600 tasks in total.
ID: 57733 · Report as offensive
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2186
Credit: 64,822,615
RAC: 5,275
Message 57736 - Posted: 29 Jan 2018, 16:02:36 UTC - in response to Message 57733.  

Dave your post may have been a little confusing. Batch 709 has 11 tasks and a newly released 710 has 10 tasks. Those are the EU25 tasks just released.
ID: 57736 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4535
Credit: 18,989,107
RAC: 21,788
Message 57740 - Posted: 29 Jan 2018, 17:36:01 UTC - in response to Message 57736.  

I didn't read things properly, if the small number released show no problems then the rest of the batches will go out. I will make sure I wait till the full release happens in future.
ID: 57740 · Report as offensive
Colin

Send message
Joined: 15 Oct 06
Posts: 5
Credit: 6,909,924
RAC: 296
Message 57746 - Posted: 31 Jan 2018, 12:31:06 UTC

My first post in over 10 years.My computer is quite ancient but is currently running 24/7. I am crunching 2 tasks from Batch 695 and 2 from 696.They have 8days and 48days respectively to completion after completion of 32.3% and 27.3% resp. Is this the normal timespan for this Batch or is my computer trying to "die" again?
ID: 57746 · Report as offensive
WB8ILI

Send message
Joined: 1 Sep 04
Posts: 161
Credit: 81,522,141
RAC: 1,164
Message 57747 - Posted: 31 Jan 2018, 13:35:53 UTC

Colin -

My opinion is you are probably OK. You are taking about 9.5 seconds per step which is about 3 or 4 times longer than what a "newer" processor would take.

Sometimes the "Remaining" column is not calculated correctly. Look at the "Progress" column and "% completed" to make sure where you are.
ID: 57747 · Report as offensive
ProfileBill F

Send message
Joined: 17 Jan 09
Posts: 124
Credit: 2,025,353
RAC: 2,666
Message 57773 - Posted: 15 Feb 2018, 1:27:03 UTC

I got 5 nice new WU's to boot happy days ...

They were about half the predicted run length that I am used to but I will not complain about work to do.

Bill F
Dallas TX
In October 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 57773 · Report as offensive
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 57775 - Posted: 15 Feb 2018, 5:42:49 UTC

Huzzah! I just got the stuff to run two work units (almost three weeks of work each):

14-Feb-2018 06:43:39 [climateprediction.net] Finished download of hadcm3s_71wg_200012_168_514_010909121.zip
14-Feb-2018 06:43:44 [climateprediction.net] Finished download of zgxu_2000.astart.gz
14-Feb-2018 06:43:45 [climateprediction.net] Finished download of spec3a_sw_3_asol2c_hadcm3.gz
14-Feb-2018 06:43:46 [climateprediction.net] Finished download of spec3a_lw_3_asol2c_hadcm3.gz
14-Feb-2018 06:43:47 Finished download of waterfix.ancil.be.32.gz
14-Feb-2018 06:43:48 Finished download of zgxu_2000.ostart.gz
14-Feb-2018 06:43:48 Finished download of NAT_VOLC.gz
14-Feb-2018 06:44:00 Finished download of SO2DMS_cmip6h_2000_2014_n48.gz
14-Feb-2018 06:44:03 Finished download of ozone_cmip6hist_2000_2014_n48.gz
14-Feb-2018 06:44:04 Finished download of hadcm3s_75ok_200012_168_514_010914021.zip
14-Feb-2018 06:44:11 Finished download of sulpc_oxidants_19_A2_1990.gz
14-Feb-2018 06:44:19 Finished download of zlor_2000.astart.gz
14-Feb-2018 06:44:29 Finished download of zlor_2000.ostart.gz

I notice of these, one started about a year ago and timed out, and the other started then too, and one errored out the first attempt and the the second attempt timed out, so now I have it.
ID: 57775 · Report as offensive
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 57776 - Posted: 15 Feb 2018, 7:01:22 UTC - in response to Message 57775.  

I hate to burst your balloon, (especially when I'm trying not to be involved now), but that batch 514 is over/done with/finished/not needed/etc.

But sharp eyed observers will have noticed that there's big batch of brand new work that's just appeared.
ID: 57776 · Report as offensive
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 57802 - Posted: 18 Feb 2018, 22:12:12 UTC - in response to Message 57776.  

Sorry my balloon is busted, but the system did supply me with those two work units. If they are not wanted, needed, etc., why did it send them out?

Also, that big batch of work is not for Linux/Unix users.

Weather At Home 2 (wah2) 10173 85521
Weather At Home 2 (wah2) (region independent) 0 3255
ID: 57802 · Report as offensive
ProfileIain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1084
Credit: 7,803,756
RAC: 5,187
Message 57845 - Posted: 24 Feb 2018, 0:07:50 UTC

There are quite a few new EAS50/10 models available: 5,250 x batch #711 and 7,800 x batch #712 (batch list).
ID: 57845 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4535
Credit: 18,989,107
RAC: 21,788
Message 57846 - Posted: 24 Feb 2018, 7:18:08 UTC - in response to Message 54840.  

There's over 200,000 tasks out there somewhere, so some people must have stockpiles.
Which may be why some of these latest batches are showing up - the researchers aren't getting their data back.


Which seems to me a good reason for shortening the deadlines.
ID: 57846 · Report as offensive
Jim1348

Send message
Joined: 15 Jan 06
Posts: 637
Credit: 26,751,529
RAC: 653
Message 57847 - Posted: 24 Feb 2018, 14:39:53 UTC - in response to Message 57846.  

There's over 200,000 tasks out there somewhere, so some people must have stockpiles.
Which may be why some of these latest batches are showing up - the researchers aren't getting their data back.


Which seems to me a good reason for shortening the deadlines.

Sixty days would be about right. Anyone serious about the project could do it in that time, and would prevent hoarding (as I call it). The scientists could show they have a real interest in proactive efforts in the field also. If they don't, there is no point in doing it at all. As a mere academic exercise, there are better ways of spending my computer time.
ID: 57847 · Report as offensive
Previous · 1 . . . 11 · 12 · 13 · 14 · 15 · 16 · 17 . . . 91 · Next

Message boards : Number crunching : New work Discussion

©2024 cpdn.org