climateprediction.net (CPDN) home page
Thread 'ANOTHER UPLOAD PROBLEM'

Thread 'ANOTHER UPLOAD PROBLEM'

Message boards : Number crunching : ANOTHER UPLOAD PROBLEM
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 33 · Next

AuthorMessage
ProfileJIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,363,583
RAC: 5,022
Message 47739 - Posted: 5 Dec 2013, 22:37:09 UTC

As of this moment the server rapid-watch.badc.rl.ac.uk is not excepting zip files from me.


ID: 47739 · Report as offensive     Reply Quote
ProfileAlex

Send message
Joined: 1 Apr 07
Posts: 5
Credit: 1,022,165
RAC: 0
Message 47740 - Posted: 5 Dec 2013, 23:00:51 UTC

Just chiming in on the off chance it might help - had the same problem with the "server full" error until today. Now transfer progress is showing 100%, but it's not completing.

12/5/2013 12:24:14 PM | climateprediction.net | Started upload of hadcm3n_o54x_2020_40_008398757_1_4.zip
12/5/2013 12:28:22 PM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/incoming/uploader//hadcm3n_o54x_2020_40_008398757_1_4.zip: No such file or directory
12/5/2013 12:28:22 PM | climateprediction.net | Temporarily failed upload of hadcm3n_o54x_2020_40_008398757_1_4.zip: transient upload error
12/5/2013 12:28:22 PM | climateprediction.net | Backing off 3 hr 6 min 8 sec on upload of hadcm3n_o54x_2020_40_008398757_1_4.zip

I'll leave it be and let the gurus sort it out.
ID: 47740 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 47741 - Posted: 5 Dec 2013, 23:22:57 UTC

OK, another email.

ID: 47741 · Report as offensive     Reply Quote
ProfileJIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,363,583
RAC: 5,022
Message 47742 - Posted: 6 Dec 2013, 0:37:51 UTC - in response to Message 47741.  

Hopefully it can be fixed before the weekend sets in a the staff is shut out of the server room until Monday.

ID: 47742 · Report as offensive     Reply Quote
SicongMA

Send message
Joined: 1 May 07
Posts: 1
Credit: 116,463
RAC: 0
Message 47743 - Posted: 6 Dec 2013, 10:17:07 UTC

Hi guys, i got the same error...

12/6/2013 10:11:08 AM | climateprediction.net | Started upload of hadcm3n_81zf_1980_40_008460510_2_4.zip
12/6/2013 10:17:03 AM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/incoming/uploader//hadcm3n_81zf_1980_40_008460510_2_4.zip: No such file or directory
12/6/2013 10:17:03 AM | climateprediction.net | Temporarily failed upload of hadcm3n_81zf_1980_40_008460510_2_4.zip: transient upload error
12/6/2013 10:17:03 AM | climateprediction.net | Backing off 05:45:03 on upload of hadcm3n_81zf_1980_40_008460510_2_4.zip
ID: 47743 · Report as offensive     Reply Quote
Dave Roberts

Send message
Joined: 15 Jan 11
Posts: 175
Credit: 6,242,691
RAC: 699
Message 47744 - Posted: 6 Dec 2013, 10:39:32 UTC

Task 16077533
hadcm3n_4fhy_1980_40_008398010_4

In case it's any use, I have the same problem as Alex. I have one zip file to upload which has tried three times. Each time the transfer info. reaches 100% completion but then the 'transient upload error' is thrown.
ID: 47744 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 47745 - Posted: 6 Dec 2013, 15:02:33 UTC

OK, time to start your backup hobbies.
It's been decided that a bigger server is needed, and this will take time to set up.

ID: 47745 · Report as offensive     Reply Quote
ProfileByron Leigh Hatch @ team Carl ...
Avatar

Send message
Joined: 17 Aug 04
Posts: 289
Credit: 44,103,664
RAC: 0
Message 47746 - Posted: 6 Dec 2013, 16:13:44 UTC
Last modified: 6 Dec 2013, 16:39:21 UTC

I am pleased to report that just now my hadcm3n zip files stuck in the transfer tab cleared and uploaded. Also Workunit 8609006 - hadcm3n_805v_1980_40_008458150 - UK Met Office Coupled Model Full Resolution Ocean has reported. Outcome: Success. It took from the 15 Nov. to 6 Dec running 24/7
ID: 47746 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 47747 - Posted: 6 Dec 2013, 17:31:05 UTC

I guess my upload problem is another instance of this. I have been trying to upload something (probably a trickle) about 52 megabytes, and it uploads the full amount, and the progress bar says 100% for a long time. It then schedules a retry, and when that expires, it uploads the file again, ... rinse and repeat. I suppose I will just wait it out.

06-Dec-2013 07:00:47 [climateprediction.net] Started upload of hadcm3n_o8wq_1900_40_008466669_2_3.zip
06-Dec-2013 07:02:35 [climateprediction.net] [error] Error reported by file upload server: can't open file /storage/incoming/uploader//hadcm3n_o8wq_1900_40_008466669_2_3.zip: No such file or directory
06-Dec-2013 07:02:35 [climateprediction.net] Temporarily failed upload of hadcm3n_o8wq_1900_40_008466669_2_3.zip: transient upload error
06-Dec-2013 07:02:35 [climateprediction.net] Backing off 4 min 3 sec on upload of hadcm3n_o8wq_1900_40_008466669_2_3.zip
06-Dec-2013 08:18:03 [climateprediction.net] Started upload of hadcm3n_o8wq_1900_40_008466669_2_3.zip
06-Dec-2013 08:23:06 [---] Project communication failed: attempting access to reference site
06-Dec-2013 08:23:07 [climateprediction.net] Temporarily failed upload of hadcm3n_o8wq_1900_40_008466669_2_3.zip: HTTP error
06-Dec-2013 08:23:07 [climateprediction.net] Backing off 16 min 8 sec on upload of hadcm3n_o8wq_1900_40_008466669_2_3.zip
06-Dec-2013 08:23:08 [---] Internet access OK - project servers may be temporarily down.
06-Dec-2013 10:35:36 [climateprediction.net] Started upload of hadcm3n_o8wq_1900_40_008466669_2_3.zip
06-Dec-2013 11:09:57 [---] Project communication failed: attempting access to reference site
06-Dec-2013 11:09:57 [climateprediction.net] Temporarily failed upload of hadcm3n_o8wq_1900_40_008466669_2_3.zip: HTTP error
06-Dec-2013 11:09:57 [climateprediction.net] Backing off 1 hr 34 min 14 sec on upload of hadcm3n_o8wq_1900_40_008466669_2_3.zip
06-Dec-2013 11:09:58 [---] Internet access OK - project servers may be temporarily down.

ID: 47747 · Report as offensive     Reply Quote
ProfileMikeMarsUK
Volunteer moderator
Avatar

Send message
Joined: 13 Jan 06
Posts: 1498
Credit: 15,613,038
RAC: 0
Message 47748 - Posted: 6 Dec 2013, 18:51:14 UTC


If you were only running 1 project, then your best bet would be to pause network access in Boinc. But this is not possible if you are running multiple projects.


I'm a volunteer and my views are my own.
News and Announcements and FAQ
ID: 47748 · Report as offensive     Reply Quote
ProfileJIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,363,583
RAC: 5,022
Message 47749 - Posted: 7 Dec 2013, 0:48:28 UTC

Good work guys. The transfer tab is now clear. All zip files have uploaded and the completed task has reported.

ID: 47749 · Report as offensive     Reply Quote
Kees Oskam

Send message
Joined: 24 Aug 06
Posts: 2
Credit: 2,631,091
RAC: 0
Message 47750 - Posted: 7 Dec 2013, 10:55:40 UTC

Tab is empty, cheers!
ID: 47750 · Report as offensive     Reply Quote
MartinNZ

Send message
Joined: 22 Mar 06
Posts: 144
Credit: 24,695,428
RAC: 0
Message 47751 - Posted: 8 Dec 2013, 3:45:41 UTC - in response to Message 47750.  

Turned the network connection back on for the afternoon, but still no joy - not that I was expecting much else as I assume they will let us know when the new server goes in.

In my case, I guess that being at the opposite end of the world, but the time the combination of electrons and photons get to the UK, I guess they are just plum tuckered out with not enough energy left to open the CPDN pearly gates ;-)
ID: 47751 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 47752 - Posted: 8 Dec 2013, 6:34:28 UTC

Martin,

My stuck upload file managed to go home on its own. Finally! However, in times past, stuck files refused to budge even when the server was known to be operational. A reboot invariably set things aright and the files then went home okay. (Admittedly, my problem might be that I [intentionally] run an old boinc version [6.2.19] but reboot reset whatever parameter in boinc kept my files locked in place.) Might be worth a try if you haven't already tried what must be the oldest M$ recovery ploy -- when in doubt, reboot.

Good luck with that.

"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 47752 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 47753 - Posted: 8 Dec 2013, 8:07:05 UTC

Or it may be that you "just missed the boat" for getting in while there was still a little bit of room on the server.

I tried again about 12 hours after others reported success, and towards the end it was obvious that something was struggling; the transfer often paused for 10-30 seconds, before a few more kilobytes uploaded. But it finally finished.

New server Monday. Or Tuesday, or Wednesday.
We ARE talking computers, and the delivery person may use SatNav, and end up jammed in a narrow lane, which apparently happens a lot in the UK. (At least according to the BBC. :) )

ID: 47753 · Report as offensive     Reply Quote
Dave Roberts

Send message
Joined: 15 Jan 11
Posts: 175
Credit: 6,242,691
RAC: 699
Message 47755 - Posted: 8 Dec 2013, 11:33:20 UTC
Last modified: 8 Dec 2013, 11:34:59 UTC

As Les infers, it's a case of hitting the right time. I usually allow network activity for a couple of hours per day, but with this problem I switched to 'aways available'. The task tried to upload every few hours and finally succeeded after 3 days. It's just a case of waiting.
Edit - apologies for the double hit
ID: 47755 · Report as offensive     Reply Quote
MartinNZ

Send message
Joined: 22 Mar 06
Posts: 144
Credit: 24,695,428
RAC: 0
Message 47757 - Posted: 8 Dec 2013, 18:37:21 UTC - in response to Message 47755.  

Hmmm. Left network on overnight again, but no joy, in fact the list grows. (Normally the network is open all the time.) Now 23 files in the transfers tab, and 7 in the Tasks tab at 100% with status Uploading. All hadcm3n models of course. Trickles seem to be going up OK, e.g. 16085698 which is one of the Tasks reporting 100% status, and an EU task 16105847.

Now moving to the EU models (3 hadcm3n and 7 EU models currently running), and they should take about 50hrs to run.

BTW, rebooted both the PC and modem.

For the moment I'll leave the network off except for a couple of hours a day to upload trickles and get new projects if necessary. I'm assuming here that a big backlog of upload files at my end is not going to be an issue. If it is, I can always stop running CPDN until the new server is running.

Typical error as previously reported:
9/12/2013 7:32:13 a.m. | climateprediction.net | [error] Error reported by file upload server: can't write file /storage/incoming/uploader//hadcm3n_o6aj_2020_40_008410109_1_4.zip: Input/output error
9/12/2013 7:32:13 a.m. | climateprediction.net | Temporarily failed upload of hadcm3n_o6aj_2020_40_008410109_1_4.zip: transient upload error
9/12/2013 7:32:13 a.m. | climateprediction.net | Backing off 00:08:38 on upload of hadcm3n_o6aj_2020_40_008410109_1_4.zip

ID: 47757 · Report as offensive     Reply Quote
Nort

Send message
Joined: 7 Aug 08
Posts: 2
Credit: 261,438
RAC: 118
Message 47762 - Posted: 9 Dec 2013, 10:40:28 UTC - in response to Message 47757.  
Last modified: 9 Dec 2013, 11:29:18 UTC

Yes, same here, but after about 20 automatic retries, uploads were completed. It took 2 days, but not a problem.
ID: 47762 · Report as offensive     Reply Quote
Profilepommystuart
Avatar

Send message
Joined: 13 Aug 12
Posts: 6
Credit: 5,515,504
RAC: 459
Message 47769 - Posted: 11 Dec 2013, 11:41:20 UTC

Hi.
I am also having upload problems.
This is my error log (part of)

11/12/2013 9:50:04 PM | climateprediction.net | Started upload of hadcm3n_38rs_2020_40_008363373_2_4.zip
11/12/2013 9:50:04 PM | climateprediction.net | Started upload of hadcm3n_3f2l_1980_40_008395556_4_1.zip
11/12/2013 10:03:36 PM | climateprediction.net | [error] Error reported by file upload server: can't write file /storage/incoming/uploader//hadcm3n_3f2l_1980_40_008395556_4_1.zip: Input/output error
11/12/2013 10:03:36 PM | climateprediction.net | Temporarily failed upload of hadcm3n_3f2l_1980_40_008395556_4_1.zip: transient upload error
11/12/2013 10:03:36 PM | climateprediction.net | Backing off 03:33:47 on upload of hadcm3n_3f2l_1980_40_008395556_4_1.zip
11/12/2013 10:24:46 PM | climateprediction.net | [error] Error reported by file upload server: can't write file /storage/incoming/uploader//hadcm3n_38rs_2020_40_008363373_2_4.zip: Input/output error
11/12/2013 10:24:46 PM | climateprediction.net | Temporarily failed upload of hadcm3n_38rs_2020_40_008363373_2_4.zip: transient upload error
11/12/2013 10:24:46 PM | climateprediction.net | Backing off 05:24:59 on upload of hadcm3n_38rs_2020_40_008363373_2_4.zip


Any suggestions?
ID: 47769 · Report as offensive     Reply Quote
ProfileJIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,363,583
RAC: 5,022
Message 47770 - Posted: 11 Dec 2013, 16:34:05 UTC

Dear Pommy:

Server is probably full again. I had the same problem earlier today. It uploaded successfully after several tries. If you just let it keep trying it will eventually catch the server at a point that it has some room.

ID: 47770 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 33 · Next

Message boards : Number crunching : ANOTHER UPLOAD PROBLEM

©2024 cpdn.org