I think you're right there Les:-

24/04/2016 22:34:00 | climateprediction.net | [http] [ID#365] Info: Closing connection 4009
24/04/2016 22:34:00 | climateprediction.net | [http] [ID#365] Info: Connection #4018 to host upload2.cpdn.org left intact
24/04/2016 22:34:01 | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/incoming/uploader/hadam3p_eu_h853_201412_5_389_010504224_1_1.zip: No such file or directory
24/04/2016 22:34:01 | climateprediction.net | Temporarily failed upload of hadam3p_eu_h853_201412_5_389_010504224_1_1.zip: transient upload error
24/04/2016 22:34:01 | climateprediction.net | Backing off 01:00:27 on upload of hadam3p_eu_h853_201412_5_389_010504224_1_1.zip

Nothing to add, just a "me too" to the previous messages - I have 4 transfers in the queue (all belonging to 1 task, it seems), and all are failing with the "No such file or directory". The one I've looked at was indeed going to upload2... server.

Task: http://climateapps2.oerc.ox.ac.uk/cpdnboinc/result.php?resultid=19536662

Les has notified Andy so a good chance this might change sometime this morning.

Looks like the cleaner has unpluged her vacuum:-)

---

Kevin

Just to confirm that Andy has restarted Apache but due to the backlog there may still be some transient errors.

I trust he enjoys The Shadows!

All of my backed up zip files are now cleared.

---

And now, for a completely different problem...

Files go "upload active" then just sit there for 5 minutes, and I eventually get:

4/26/2016 7:41:59 AM | climateprediction.net | Temporarily failed upload of hadam3p_eu_g4hq_201412_13_380_010446194_0_4.zip: transient HTTP error
4/26/2016 7:41:59 AM | climateprediction.net | Backing off 00:03:21 on upload of hadam3p_eu_g4hq_201412_13_380_010446194_0_4.zip
4/26/2016 7:41:59 AM | climateprediction.net | Temporarily failed upload of hadam3p_eu_g4hq_201412_13_380_010446194_0_5.zip: transient HTTP error
4/26/2016 7:41:59 AM | climateprediction.net | Backing off 00:03:20 on upload of hadam3p_eu_g4hq_201412_13_380_010446194_0_5.zip

Note that files try to upload even though the project is in "Project backoff"

Email sent to Andy who will no doubt kick something again.

Email sent to Andy who will no doubt kick something again.

This looks different.

Had one stuck upload an _5 which has now gone.

But am only showing 3 trickles on task page, _4 and _5 missing.

http://climateapps2.oerc.ox.ac.uk/cpdnboinc/result.php?resultid=19547983

---

Kevin

A few uploads went through on Monday, but the rest of the transfers are stuck w/ a connection time-out.

I will let Andy know about the trickle ups not showing as well. Hopefully all will be sorted before the weekend which in UK has an extra day this time around!

Looks like all my trickle ups are now showing and all my zips have gone through.

Kevin, it looks like yours on the link you gave have also gone through.

Can't add new thread
Unable to handle request
missing or bad parameter: id; supplied:

---

This is a known problem, caused by a new version of one of the server programs.
The best way to solve it is being discussed.

Uploads are not going through again.

4/29/2016 11:56:27 PM | climateprediction.net | Started upload of wah2_sas50_h20m_199212_13_387_010495147_1_4.zip
4/29/2016 11:57:55 PM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/incoming/uploader/wah2_sas50_h20m_199212_13_387_010495147_1_4.zip: No such file or directory
4/29/2016 11:57:55 PM | climateprediction.net | Temporarily failed upload of wah2_sas50_h20m_199212_13_387_010495147_1_4.zip: transient upload error
4/29/2016 11:57:55 PM | climateprediction.net | Backing off 00:07:11 on upload of wah2_sas50_h20m_199212_13_387_010495147_1_4.zip
4/30/2016 12:05:07 AM | climateprediction.net | Started upload of wah2_sas50_h20m_199212_13_387_010495147_1_4.zip
4/30/2016 12:06:35 AM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/incoming/uploader/wah2_sas50_h20m_199212_13_387_010495147_1_4.zip: No such file or directory
4/30/2016 12:06:35 AM | climateprediction.net | Temporarily failed upload of wah2_sas50_h20m_199212_13_387_010495147_1_4.zip: transient upload error
4/30/2016 12:06:35 AM | climateprediction.net | Backing off 00:14:37 on upload of wah2_sas50_h20m_199212_13_387_010495147_1_4.zip
4/30/2016 12:16:01 AM | climateprediction.net | Started upload of wah2_sas50_h20m_199212_13_387_010495147_1_4.zip
4/30/2016 12:17:26 AM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/incoming/uploader/wah2_sas50_h20m_199212_13_387_010495147_1_4.zip: No such file or directory
4/30/2016 12:17:26 AM | climateprediction.net | Temporarily failed upload of wah2_sas50_h20m_199212_13_387_010495147_1_4.zip: transient upload error
4/30/2016 12:17:26 AM | climateprediction.net | Backing off 00:24:29 on upload of wah2_sas50_h20m_199212_13_387_010495147_1_4.zip

---

Email sent.
Not just "the weekend" this time; Monday is Early May bank holiday in the UK.

The hadam3p_afr zips have stopped uploading again with transient http errors. Andy has been informed.

Hi.
Just letting you know that I have a stuck WAH2_SAS50 upload with a transient http error
Windows 10 Computer if anyone one wants to grab more details of the task.
Lets Hope things run more smoothly soon
Vicki

Vicki, it looked to me this morning that by the time I emailed Andy back with some more information your zips had gone through.

Mine from batches 371 and 372 have also cleared.

If when reporting failed uploads, the batch number could be included this would be useful for forwarding on to Andy.

hadam3p_afr50_ez0c_201412_12_371_010406906_2 For information the hadam3p gives information about the particular model type, afr is the region, 371 in this case is the batch number, and the final 2 means the task has already failed on two other machines so this is it's last chance! I think the 201412 refers to the year and month the task starts looking at and the following 12 the number of model months it runs for.

I've just emailed Andy with the following:

I've got 2 SAS50 from batch 370 going to upload2. Or trying to.
Been getting transient HTTP error all "night".

This is all that's need to identify a problem.
No need for long posts from logs.

Getting the name of the upload server is a bit like rocket science, but just the other 2 highlighted items will suffice. Also the error message would be useful.