Upload problem. Last week I downloaded a WU hadam3p_pnw_7028_2003_1_007595320_2. It is a reissue on its third go round. Everything went fine and it finished crunching in 121 hours. The problem is that zip file 13 is stuck in the transfer tab.
Relevant messages are as follows:
11/20/2013 2:20:45 PM | climateprediction.net | Started upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip
11/20/2013 2:22:41 PM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_7028_2003_1_007595320_2_13.zip: No such file or directory
11/20/2013 2:22:41 PM | climateprediction.net | Temporarily failed upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip: transient upload error
11/20/2013 2:22:41 PM | climateprediction.net | Backing off 04:20:03 on upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip
11/20/2013 2:51:08 PM | climateprediction.net | Sending scheduler request: To send trickle-up message.
11/20/2013 2:51:08 PM | climateprediction.net | Requesting new tasks for CPU
11/20/2013 2:51:11 PM | climateprediction.net | Scheduler request completed: got 0 new tasks
11/20/2013 2:51:11 PM | climateprediction.net | Project has no tasks available
11/20/2013 3:51:51 PM | climateprediction.net | Sending scheduler request: To send trickle-up message.
11/20/2013 3:51:51 PM | climateprediction.net | Requesting new tasks for CPU
11/20/2013 3:51:54 PM | climateprediction.net | Scheduler request completed: got 0 new tasks
11/20/2013 3:51:54 PM | climateprediction.net | Project has no tasks available
11/20/2013 6:42:45 PM | climateprediction.net | Started upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip
11/20/2013 6:44:52 PM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_7028_2003_1_007595320_2_13.zip: No such file or directory
11/20/2013 6:44:52 PM | climateprediction.net | Temporarily failed upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip: transient upload error
11/20/2013 6:44:52 PM | climateprediction.net | Backing off 05:26:44 on upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip
11/20/2013 7:04:09 PM | climateprediction.net | Sending scheduler request: To send trickle-up message.
11/20/2013 7:04:09 PM | climateprediction.net | Requesting new tasks for CPU
11/20/2013 7:04:13 PM | climateprediction.net | Scheduler request completed: got 0 new tasks
11/20/2013 7:04:13 PM | climateprediction.net | Project has no tasks available
11/21/2013 12:11:37 AM | climateprediction.net | Started upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip
11/21/2013 12:13:37 AM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_7028_2003_1_007595320_2_13.zip: No such file or directory
11/21/2013 12:13:37 AM | climateprediction.net | Temporarily failed upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip: transient upload error
11/21/2013 12:13:37 AM | climateprediction.net | Backing off 04:02:29 on upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip

As you can see file seems to upload fine, reaching the 100% mark and then the upload fails with the can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_7028_2003_1_007595320_2_13.zip: No such file or directory message.

Is there a way to save this WU or is it another case of the server sending old reissues that are missing files.

---

That is a problem with the re-start server at Oxford.
I'll send them an email, but in the meantime, the thing to remember is: DON'T PANIC (In big friendly letters). (The Hitch Hiker's Guide to the Galaxy.)

DON'T PANIC (In big friendly letters).

[/quote]
Thanks Les. I�ll take my own advise to someone else and �Chill Out.� There is no hurry and hopefully they can sort it out at Oxford.

---

Andy is looking into this.

Andy says:

This restart server has now been rebooted, could you confirm with them whether they are still have an issue.

So, how is it now?

Sorry, no joy. The file is still stuck in the transfer tab. Same error messages.

---

Another email then. Sigh.

AHA !!

Another CPDN User to commiserate over the same Error Condition...
One that I've been afflicted with for the better part of a Month, and posted about on a pair of occasions...

Upload starts - 33.96MB size
Upload progressing at ~150KBps
Upload progresses to 100.00%
Upload FAILED - Retry in xx:xx:xx

Log Excerpt:
11/22/2013 9:30:53 AM | climateprediction.net | Started upload of hadam3p_eu_qdje_2005_1_008343335_1_13.zip
11/22/2013 9:34:39 AM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_eu_qdje_2005_1_008343335_1_13.zip: No such file or directory
11/22/2013 9:34:39 AM | climateprediction.net | Temporarily failed upload of hadam3p_eu_qdje_2005_1_008343335_1_13.zip: transient upload error
11/22/2013 9:34:39 AM | climateprediction.net | Backing off 5 hr 26 min 21 sec on upload of hadam3p_eu_qdje_2005_1_008343335_1_13.zip

It hasn't harmed my CPDN efforts, nor pushed me over any ISP Data Limits, but it would be GREAT to see it resolved...

Yes, it does seem to be the same problem. It is a bit discouraging that it has going on for a month without resolution. Maybe now that it is no longer lumped in with the problem in �persistent upload problems� we can find a fix for this one. We are going to need it if more Hadam3p�s are coming as rumored.

---

OK. No "good news, bad news". More like "interesting observation, bad news".

Jim
Your model was first issued back at the end of 2011, where, I suspect, the first person to get it had the same problem as you, and it timed out.

seigell
Yours is "more interesting".
If you look at the trickle list, you'll see an extra trickle near the start.
And if you look at the trickle list for the other person that ran it, there were 2 extra trickles at the end. And it crashed at the end too, possible saving having to work out what was wrong then.

My guess is that both of these data sets had/have a problem, and that both of them should be aborted.

In the case of Jim's, it shouldn't be re-issued again. But there's one more re-issue due for seigell's model, so this will probably get revisited in a years time. Unless the server upgrade allows for these old data sets to be blocked.

Done, task aborted. Shame it couldn't be saved. Thanks for the help.

---

Comparing the Trickle list of my execution of this WU to that of the other Computer, there are a few oddities as well as what you called out:

Other Computer produced a couple sets of Trickles only single-digit Timesteps apart - these are essentially the 2 "extra" Trickles.
Both Computers produced same initial and "near-final" Trickles at same Timesteps.
My Computer performed 1 Trickle at a Timestep beyond where the Other Computer stopped.

In any case, this Error Condition has been reported and reviewed. And it doesn't seem that the WU nor the Credits are worth much more Effort (nor the pertubations of several additional Moles of Electrons simply to add to the already 2GB of "Attempted Upload" Traffic at either my nor CPDN Server ends).

My PC is already happily chewing on a different HADCM3N WU, so the one in question will simply be ABORTED.

Same issue with this unit. Should I abort?

http://climateapps2.oerc.ox.ac.uk/cpdnboinc/workunit.php?wuid=7768213


mar 26 nov 2013 15:28:08 CET climateprediction.net Started upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip
mar 26 nov 2013 15:28:44 CET climateprediction.net [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: No such file or directory
mar 26 nov 2013 15:28:44 CET climateprediction.net Temporarily failed upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: transient upload error
mar 26 nov 2013 15:28:44 CET climateprediction.net Backing off 2 hr 6 min 9 sec on upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip
mar 26 nov 2013 17:34:53 CET climateprediction.net Started upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip
mar 26 nov 2013 17:35:30 CET climateprediction.net [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: No such file or directory
mar 26 nov 2013 17:35:30 CET climateprediction.net Temporarily failed upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: transient upload error
mar 26 nov 2013 17:35:30 CET climateprediction.net Backing off 2 hr 38 min 0 sec on upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip
mar 26 nov 2013 20:13:31 CET climateprediction.net Started upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip
mar 26 nov 2013 20:14:07 CET climateprediction.net [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: No such file or directory
mar 26 nov 2013 20:14:07 CET climateprediction.net Temporarily failed upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: transient upload error
mar 26 nov 2013 20:14:07 CET climateprediction.net Backing off 1 hr 34 min 2 sec on upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip
mar 26 nov 2013 21:35:50 CET climateprediction.net Started upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip
mar 26 nov 2013 21:36:24 CET climateprediction.net [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: No such file or directory
mar 26 nov 2013 21:36:24 CET climateprediction.net Temporarily failed upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: transient upload error
mar 26 nov 2013 21:36:24 CET climateprediction.net Backing off 8 min 55 sec on upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip

Now that more people are reporting on this, I'm going to have a think about it for a while.
There may be something subtle going on. (The server is reported as working.)

Trotador

Could you please have a look in client_state.xml with notepad, (better still, a copy of it :) ), look for the string 6w0r, and keep looking until you reach the line for zip13.
Then, a few lines earlier, there'll be a line ending in file_upload_handler.
Copy this line and paste it here.

This will tell me the exact url to which BOINC is trying to send the file.

Thanks.

Trotador

Could you please have a look in client_state.xml with notepad, (better still, a copy of it :) ), look for the string 6w0r, and keep looking until you reach the line for zip13.
Then, a few lines earlier, there'll be a line ending in file_upload_handler.
Copy this line and paste it here.

This will tell me the exact url to which BOINC is trying to send the file.

Thanks.

this one?

<file_info>
<name>hadam3p_pnw_6w0r_2002_1_007590083.zip</name>
<nbytes>12766.000000</nbytes>
<max_nbytes>0.000000</max_nbytes>
<md5_cksum>582a163389f911283352728c384377d6</md5_cksum>
<status>1</status>
<url>http://cpdn-downloads.oerc.ox.ac.uk/download/hadam3p/hadam3p_pnw_6w0r_2002_1_007590083.zip</url>
</file_info>
<file_info>
<name>ic19611201_10_N96.gz</name>
<nbytes>1312884.000000</nbytes>
<max_nbytes>0.000000</max_nbytes>
<md5_cksum>aec9660d191182affe1d98eeda2d6abe</md5_cksum>
<status>1</status>
<url>http://cpdn-downloads.oerc.ox.ac.uk/download/hadam3p/ancil/mirror.php?file=ic19611201_10_N96.gz</url>
</file_info>
<file_info>
<name>xaclfa.start.0000.gz</name>
<nbytes>26657809.000000</nbytes>
<max_nbytes>0.000000</max_nbytes>
<md5_cksum>a4a3d4947da96f3f37dff5c0878407c0</md5_cksum>
<status>1</status>
<url>http://cpdn-downloads.oerc.ox.ac.uk/download/hadam3p/ancil/mirror.php?file=xaclfa.start.0000.gz</url>
</file_info>
<file_info>
<name>dchaba.start.pnw.b.0000.gz</name>
<nbytes>6083952.000000</nbytes>
<max_nbytes>0.000000</max_nbytes>
<md5_cksum>2f3d1c3e97c7eb668d15f3cb4e7e5fbc</md5_cksum>
<status>1</status>
<url>http://cpdn-downloads.oerc.ox.ac.uk/download/hadam3p/ancil/mirror.php?file=dchaba.start.pnw.b.0000.gz</url>
</file_info>
<file_info>
<name>HadISST_SI_N96_2002_12_2004_01f.gz</name>
<nbytes>1085060.000000</nbytes>
<max_nbytes>0.000000</max_nbytes>
<md5_cksum>ca7d7f7c03b72c5b027071ce157bbe86</md5_cksum>
<status>1</status>
<url>http://cpdn-downloads.oerc.ox.ac.uk/download/hadam3p/ancil/mirror.php?file=HadISST_SI_N96_2002_12_2004_01f.gz</url>
</file_info>
<file_info>
<name>HadISST_SST_N96_2002_12_2004_01f.gz</name>
<nbytes>3893018.000000</nbytes>
<max_nbytes>0.000000</max_nbytes>
<md5_cksum>8b234747ed142e60d75242a5b2cf1c3f</md5_cksum>
<status>1</status>
<url>http://cpdn-downloads.oerc.ox.ac.uk/download/hadam3p/ancil/mirror.php?file=HadISST_SST_N96_2002_12_2004_01f.gz</url>
</file_info>
<file_info>
<name>hadam3p_pnw_6w0r_2002_1_007590083_2_1.zip</name>
<nbytes>7563497.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>339d82aa5b1763cde20d2388681a5f39</md5_cksum>
<generated_locally/>
<status>0</status>
<uploaded/>
<upload_when_present/>
<url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url>
</file_info>
<file_info>
<name>hadam3p_pnw_6w0r_2002_1_007590083_2_2.zip</name>
<nbytes>7577967.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>9e280e9af5046245a5681f1f95bc1d9d</md5_cksum>
<generated_locally/>
<status>0</status>
<uploaded/>
<upload_when_present/>
<url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url>
</file_info>
<file_info>
<name>hadam3p_pnw_6w0r_2002_1_007590083_2_3.zip</name>
<nbytes>7657353.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>a20b7679b13537c530b5595b3113b464</md5_cksum>
<generated_locally/>
<status>0</status>
<uploaded/>
<upload_when_present/>
<url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url>
</file_info>
<file_info>
<name>hadam3p_pnw_6w0r_2002_1_007590083_2_4.zip</name>
<nbytes>7737615.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>07595e77fffc4033bfaacba8d6597597</md5_cksum>
<generated_locally/>
<status>0</status>
<uploaded/>
<upload_when_present/>
<url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url>
</file_info>
<file_info>
<name>hadam3p_pnw_6w0r_2002_1_007590083_2_5.zip</name>
<nbytes>7785628.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>0e9e3fe10610d31f93d4224d11a3bfba</md5_cksum>
<generated_locally/>
<status>0</status>
<uploaded/>
<upload_when_present/>
<url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url>
</file_info>
<file_info>
<name>hadam3p_pnw_6w0r_2002_1_007590083_2_6.zip</name>
<nbytes>7713417.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>1e736f1ea5006028fcf796ae5cf2df53</md5_cksum>
<generated_locally/>
<status>0</status>
<uploaded/>
<upload_when_present/>
<url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url>
</file_info>
<file_info>
<name>hadam3p_pnw_6w0r_2002_1_007590083_2_7.zip</name>
<nbytes>7711829.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>296ef500ea92f563f31340e80b2a68e9</md5_cksum>
<generated_locally/>
<status>0</status>
<uploaded/>
<upload_when_present/>
<url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url>
</file_info>
<file_info>
<name>hadam3p_pnw_6w0r_2002_1_007590083_2_8.zip</name>
<nbytes>7707894.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>9b091c143608b03a7ba633cac0dccfd3</md5_cksum>
<generated_locally/>
<status>0</status>
<uploaded/>
<upload_when_present/>
<url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url>
</file_info>
<file_info>
<name>hadam3p_pnw_6w0r_2002_1_007590083_2_9.zip</name>
<nbytes>7800310.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>9ec5a615dfcac482a7e7c93cf421607d</md5_cksum>
<generated_locally/>
<status>0</status>
<uploaded/>
<upload_when_present/>
<url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url>
</file_info>
<file_info>
<name>hadam3p_pnw_6w0r_2002_1_007590083_2_10.zip</name>
<nbytes>7853736.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>602dc898a4537497b79d4c39b9f583e9</md5_cksum>
<generated_locally/>
<status>0</status>
<uploaded/>
<upload_when_present/>
<url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url>
</file_info>
<file_info>
<name>hadam3p_pnw_6w0r_2002_1_007590083_2_11.zip</name>
<nbytes>7896535.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>f36058919a4a856648010be9e23e2139</md5_cksum>
<generated_locally/>
<status>0</status>
<uploaded/>
<upload_when_present/>
<url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url>
</file_info>
<file_info>
<name>hadam3p_pnw_6w0r_2002_1_007590083_2_12.zip</name>
<nbytes>8044336.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>1fea2126fd65965d676e4e60ef50fdfe</md5_cksum>
<generated_locally/>
<status>0</status>
<uploaded/>
<upload_when_present/>
<url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url>
</file_info>
<file_info>
<name>hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip</name>
<nbytes>33737443.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>44c55ea026ea604749cc9ff8592c7fad</md5_cksum>
<generated_locally/>
<status>1</status>
<upload_when_present/>
<url>http://cpdn-restarts.oerc.ox.ac.uk/cgi-bin/file_upload_handler</url>
<persistent_file_xfer>
<num_retries>28</num_retries>
<first_request_time>1385379856.550667</first_request_time>
<next_request_time>1385534194.430921</next_request_time>
<time_so_far>1044.810202</time_so_far>
<last_bytes_xferred>33737658.000000</last_bytes_xferred>
</persistent_file_xfer>
</file_info>

Yes, that's it. Unfortunately it looks OK, so I'm now out of ideas.
I've just posted to our email forum, so I'll now wait to see if anyone else has an idea.

Hello!

Looks like I'm having the same problem like the others. After there seems to be no conclusion in almost two weeks and the file already tried to upload for 15 hours I finally came to look here if there's something I can do.

27.11.2013 08:18:18 | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_eu_qic1_1999_1_008397041_0_13.zip: No such file or directory
27.11.2013 08:18:18 | climateprediction.net | Temporarily failed upload of hadam3p_eu_qic1_1999_1_008397041_0_13.zip: transient upload error

I assume I can cancel the unit also?

Edit:
I finally see that the referring task already has it's full credits, so I guess the upload really isn't necessary anymore.

---

Life is Science, and Science rules. To the universe and beyond
Proud member of BOINC@Heidelberg
My BOINCstats-Sig

My wu (and Trickle 13) http://climateapps2.oerc.ox.ac.uk/cpdnboinc/result.php?resultid=16078667 has been sent.


Thanks

---

Edit:
I finally see that the referring task already has it's full credits, so I guess the upload really isn't necessary anymore.

The upload file contains the scientific information of use to the researchers, so the awarding of credit is very far from the end of the story - please give it at least one more try.

Andy Bowery has written:

I think this has been fixed now. The server which receives these files wasn't correctly mounting the directory where these files are received. It is mounted now so these should be coming in correctly now.

(that was about 2 hours ago. I suspect the server may have switched from 'not responding' to 'very busy' in the meantime - check for changed error messages if it doesn't go at the next attempt, and please keep trying if that message shows that things have changed)