climateprediction.net (CPDN) home page
Thread 'upload failure: for tasks wah2_pnw25 last zip file in tasks with 49 zips ?'

Thread 'upload failure: for tasks wah2_pnw25 last zip file in tasks with 49 zips ?'

Message boards : Number crunching : upload failure: for tasks wah2_pnw25 last zip file in tasks with 49 zips ?
Message board moderation

To post messages, you must log in.

AuthorMessage
ProfileByron Leigh Hatch @ team Carl ...
Avatar

Send message
Joined: 17 Aug 04
Posts: 289
Credit: 44,103,664
RAC: 0
Message 54913 - Posted: 11 Oct 2016, 20:05:33 UTC



Hello everyone,

I thought I should start a new thread for this subject,
as it dose not fit in any other thread I can see,
and in case there is some information here that could help the scientist who coded these models?

Output file wah2_pnw25_c0g8_200312_49_452_010736562_1_r1593781528_50.zip ??? for task wah2_pnw25_c0g8_200312_49_452_010736562_1 absent ?

Just out of curiosity.

Regarding:

wah2_pnw25_c0eh_200312_49_452_010736499_1

astroWX posted the following:
They are, in fact, monthly.
Eventually, all restart files will lose their sequence numbers and be identified with ".restart
".

my computer crunched for 7 days - two (2) of the -- wah2_pnw25__49_ tasks
my computer successfully uploaded all 49 zip files.

and then I got the following message. it looks like my computerr upload all 49 Zip files for the following two tasks:


10/10/2016 8:09:29 PM | climateprediction.net | Computation for task wah2_pnw25_c0g8_200312_49_452_010736562_1 finished
10/10/2016 8:09:29 PM | climateprediction.net | Output file wah2_pnw25_c0g8_200312_49_452_010736562_1_r1593781528_50.zip ??? for task wah2_pnw25_c0g8_200312_49_452_010736562_1 absent

10/10/2016 11:37:53 PM | climateprediction.net | Computation for task wah2_pnw25_c0eh_200312_49_452_010736499_1 finished
10/10/2016 11:37:53 PM | climateprediction.net | Output file wah2_pnw25_c0eh_200312_49_452_010736499_1_r1448810276_50.zip ??? for task wah2_pnw25_c0eh_200312_49_452_010736499_1 absent


wah2_pnw25_c0g8_200312_49_452_010736562_1
wah2_pnw25_c0eh_200312_49_452_010736499_1

<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
Error converting file to netcdf:
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk3dec
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk4feb
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk4mar
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk4apr
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk4may
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk4jun
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk4jul
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk4aug
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk4sep
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk4oct
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk4nov
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk4dec
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk5feb
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk5mar
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk5apr
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk5may
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk5jun
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk5jul
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk5aug
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk5sep
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk5oct
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk5dec
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk6feb
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk6mar
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk6apr
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk6may
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk6jun
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk6jul
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk6aug
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk6sep
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk6oct
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk6dec
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk7feb
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk7mar
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk7apr
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk7may
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk7jun
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk7jul
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk7aug
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk7sep
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk7oct
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0eh_200312_49_452_010736499/dataout\c0ehga.pdk7dec

Leaving CPDN_ain::Monitor...
23:37:50 (11604): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
<file_name>wah2_pnw25_c0eh_200312_49_452_010736499_1_r1448810276_50.zip ??? </file_name>
<error_code>-161 (not found)</error_code>
</file_xfer_error>

</message>
]]>

I did a search of other different computers and they are getting the exact same </stderr_txt> <message> as my computer:

wah2_pnw25_c0ch_200312_49_452_010736427_0
wah2_pnw25_c0bj_200312_49_452_010736393_0
wah2_pnw25_c0ch_200312_49_452_010736427_0
wah2_pnw25_c0bj_200312_49_452_010736393_0

Trickle Information for: wah2_pnw25_c0g8_200312_49_452_010736562_1 --- Result # 20004357


Just out curiosity :)
Best Wishes to all,
Byron.

P.S.
sorry about the long post :-(




ID: 54913 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 54916 - Posted: 12 Oct 2016, 4:37:18 UTC - in response to Message 54913.  

Hi Byron

Good call putting this in a new thread.

Let's jump straight to the good news: The messages are benign.

We were told about this rather a while ago now, and I forget the reasons why, but after the last zip, some more model time is crunched.
But this data isn't needed at which ever project it's for, and this leaves a dilemma:
Convert the files and add them to a zip, which will cause more upload time for users, plus storage space on the server,
or
Leave them, and have part of the program create error messages.

After some talk, it was decided that a lot of people wouldn't look at the stderr list, and for those that did, an explanation could be provided.

It's interesting to actually see the messages, instead of just being told about them.

ID: 54916 · Report as offensive     Reply Quote
bernard_ivo

Send message
Joined: 18 Jul 13
Posts: 438
Credit: 25,620,508
RAC: 4,981
Message 54917 - Posted: 12 Oct 2016, 5:53:47 UTC - in response to Message 54916.  

Hi Les,
But if the model errored out on purpose instead of being reported as successful, then it is relocated to new cruncher in vain, isn't it?
ID: 54917 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 54918 - Posted: 12 Oct 2016, 6:35:50 UTC - in response to Message 54917.  

Oopsie.
I'll report this little problem.

ID: 54918 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 54923 - Posted: 12 Oct 2016, 20:00:22 UTC

It appears that there was a problem with how to deal with the error messages.
Should be fixed for "next time", but we may need to live with the current situation. :(

Might be more info later.

ID: 54923 · Report as offensive     Reply Quote
ProfileByron Leigh Hatch @ team Carl ...
Avatar

Send message
Joined: 17 Aug 04
Posts: 289
Credit: 44,103,664
RAC: 0
Message 54931 - Posted: 13 Oct 2016, 13:56:39 UTC - in response to Message 54923.  

Thank you Les,
Best Wishes
Byron.
ID: 54931 · Report as offensive     Reply Quote
bernard_ivo

Send message
Joined: 18 Jul 13
Posts: 438
Credit: 25,620,508
RAC: 4,981
Message 55002 - Posted: 26 Oct 2016, 16:02:35 UTC - in response to Message 54923.  

My first pnw25_49 errored out as expected. 2/3 errors allowed, however I think it is out of the hopper, so no 3rd attempt will be made.

Extract from stderr
<core_client_version>7.6.9</core_client_version>
<![CDATA[
<stderr_txt>
Error converting file to netcdf: D:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c07e_200312_49_452_010736244/dataout\c07ega.pdk3dec
Error converting file to netcdf: D:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c07e_200312_49_452_010736244/dataout\c07ega.pdk4feb
Error converting file to netcdf: D:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c07e_200312_49_452_010736244/dataout\c07ega.pdk4mar
.....................
Error converting file to netcdf: D:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c07e_200312_49_452_010736244/dataout\c07ega.pdk7dec
Leaving CPDN_ain::Monitor...
21:11:45 (7120): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
<file_name>wah2_pnw25_c07e_200312_49_452_010736244_1_r106950667_50.zip</file_name>
<error_code>-161 (not found)</error_code>
</file_xfer_error>

</message>

Hope it helps
ID: 55002 · Report as offensive     Reply Quote
bernard_ivo

Send message
Joined: 18 Jul 13
Posts: 438
Credit: 25,620,508
RAC: 4,981
Message 55048 - Posted: 30 Oct 2016, 12:29:59 UTC

And the second one also finished with the same error. So far no resubmission.
ID: 55048 · Report as offensive     Reply Quote
ProfileBonsai911

Send message
Joined: 9 Sep 04
Posts: 228
Credit: 30,756,611
RAC: 3,303
Message 55111 - Posted: 8 Nov 2016, 21:32:03 UTC

ID: 55111 · Report as offensive     Reply Quote

Message boards : Number crunching : upload failure: for tasks wah2_pnw25 last zip file in tasks with 49 zips ?

©2024 cpdn.org