climateprediction.net (CPDN) home page
Thread 'ANOTHER UPLOAD PROBLEM'

Thread 'ANOTHER UPLOAD PROBLEM'

Message boards : Number crunching : ANOTHER UPLOAD PROBLEM
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 11 · 12 · 13 · 14 · 15 · 16 · 17 . . . 33 · Next

AuthorMessage
ProfileAlan K

Send message
Joined: 22 Feb 06
Posts: 491
Credit: 30,992,465
RAC: 14,585
Message 50247 - Posted: 21 Sep 2014, 10:19:16 UTC - in response to Message 50242.  

getting upload problems on short runs:

21/09/2014 09:54:20 | climateprediction.net | Started upload of hadcm3s_11f8_1980_2_008906126_2_1.zip
21/09/2014 09:54:20 | climateprediction.net | Started upload of hadcm3s_2juk_2001_2_009033699_0_1.zip
21/09/2014 09:54:43 | climateprediction.net | Temporarily failed upload of hadcm3s_11f8_1980_2_008906126_2_1.zip: connect() failed
21/09/2014 09:54:43 | climateprediction.net | Backing off 04:33:53 on upload of hadcm3s_11f8_1980_2_008906126_2_1.zip
21/09/2014 09:54:46 | | Project communication failed: attempting access to reference site
21/09/2014 09:54:48 | | Internet access OK - project servers may be temporarily down.
21/09/2014 09:57:29 | climateprediction.net | Temporarily failed upload of hadcm3s_2juk_2001_2_009033699_0_1.zip: transient HTTP error
21/09/2014 09:57:29 | climateprediction.net | Backing off 00:11:07 on upload of hadcm3s_2juk_2001_2_009033699_0_1.zip
21/09/2014 09:57:32 | | Project communication failed: attempting access to reference site
21/09/2014 09:57:34 | | Internet access OK - project servers may be temporarily down.

Is another of theservers down?
ID: 50247 · Report as offensive     Reply Quote
ProfileJIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,363,583
RAC: 5,022
Message 50248 - Posted: 21 Sep 2014, 11:39:34 UTC

I have the same problem. There are 3 zip files stuck in the transfer tab of my second fastest machine. It is the only one running the hadcm shorties.

ID: 50248 · Report as offensive     Reply Quote
Art Masson
Avatar

Send message
Joined: 16 Oct 11
Posts: 254
Credit: 15,954,577
RAC: 0
Message 50250 - Posted: 21 Sep 2014, 18:13:34 UTC - in response to Message 50248.  

Yep...same thing...

9/21/2014 10:05:55 AM | climateprediction.net | Computation for task hadcm3s_2egt_2001_2_009026724_0 finished
9/21/2014 10:05:55 AM | climateprediction.net | Output file hadcm3s_2egt_2001_2_009026724_0_1.zip for task hadcm3s_2egt_2001_2_009026724_0 absent
9/21/2014 10:05:55 AM | climateprediction.net | Output file hadcm3s_2egt_2001_2_009026724_0_2.zip for task hadcm3s_2egt_2001_2_009026724_0 absent
9/21/2014 10:58:29 AM | climateprediction.net | Started upload of hadcm3s_2egp_2001_2_009026720_0_1.zip
9/21/2014 10:58:51 AM | climateprediction.net | Temporarily failed upload of hadcm3s_2egp_2001_2_009026720_0_1.zip: connect() failed
9/21/2014 10:58:51 AM | climateprediction.net | Backing off 00:03:41 on upload of hadcm3s_2egp_2001_2_009026720_0_1.zip
9/21/2014 10:58:54 AM | | Project communication failed: attempting access to reference site
9/21/2014 10:58:57 AM | | Internet access OK - project servers may be temporarily down.
9/21/2014 10:59:22 AM | climateprediction.net | Sending scheduler request: To send trickle-up message.
9/21/2014 10:59:22 AM | climateprediction.net | Reporting 1 completed tasks
9/21/2014 10:59:22 AM | climateprediction.net | Requesting new tasks for CPU
9/21/2014 10:59:24 AM | climateprediction.net | Scheduler request completed: got 0 new tasks
9/21/2014 10:59:24 AM | climateprediction.net | No work sent
9/21/2014 10:59:24 AM | climateprediction.net | This computer has finished a daily quota of 1 tasks)
9/21/2014 11:22:51 AM | climateprediction.net | Started upload of hadcm3s_2egs_2001_2_009026723_0_1.zip
9/21/2014 11:23:14 AM | climateprediction.net | Temporarily failed upload of hadcm3s_2egs_2001_2_009026723_0_1.zip: connect() failed
9/21/2014 11:23:14 AM | climateprediction.net | Backing off 00:02:33 on upload of hadcm3s_2egs_2001_2_009026723_0_1.zip
9/21/2014 11:23:17 AM | | Project communication failed: attempting access to reference site
9/21/2014 11:23:19 AM | | Internet access OK - project servers may be temporarily down.
ID: 50250 · Report as offensive     Reply Quote
ProfileJIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,363,583
RAC: 5,022
Message 50253 - Posted: 22 Sep 2014, 3:43:41 UTC

All Zip files have uploaded.
ID: 50253 · Report as offensive     Reply Quote
Eirik Redd

Send message
Joined: 31 Aug 04
Posts: 391
Credit: 219,896,461
RAC: 649
Message 50256 - Posted: 22 Sep 2014, 8:39:06 UTC - in response to Message 50253.  

No hadcm3s zip files have uploaded from here yet, not since last Friday.
But the equinoctial morning sun is shining at 5/4 degree west -- good odds the problem - whatever it might have been - will be mostly gone in hours or days.

I'll not be hitting the "retry now" button any time soon.
ID: 50256 · Report as offensive     Reply Quote
TrueBlue

Send message
Joined: 27 Aug 04
Posts: 1
Credit: 1,407,281
RAC: 0
Message 50264 - Posted: 22 Sep 2014, 14:41:03 UTC - in response to Message 50256.  

I am having upload issues too since Friday. Does the server need a reboot. I was looking at the server status page and it appears that there are other upload servers as well. How do I repoint my client to those servers (if that is something that will resolve he issue?
ID: 50264 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,020,584
RAC: 20,684
Message 50266 - Posted: 22 Sep 2014, 16:11:05 UTC - in response to Message 50264.  

TrueBlue

Afriad pointing them at a different server won't help. The most common reasons I read recently for upload problems are in no particular order, (because I can't remember what the post said exactly) disk full, disk come unmounted and server needing rebooting. At least the problem this time doesn't upload the data before telling us things aren't working!
ID: 50266 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,708,278
RAC: 9,361
Message 50267 - Posted: 22 Sep 2014, 16:17:31 UTC - in response to Message 50266.  

If you set the logging flag for http_debug, for hadcm3s you get (currently):

22/09/2014 17:09:32 | climateprediction.net | [http] [ID#570] Info: About to connect() to rapid-watch.badc.rl.ac.uk port 80 (#1144)
22/09/2014 17:09:32 | climateprediction.net | [http] [ID#570] Info: Trying 130.246.191.84...
22/09/2014 17:09:54 | climateprediction.net | [http] [ID#570] Info: Failed connect to rapid-watch.badc.rl.ac.uk:80; No error
22/09/2014 17:09:54 | climateprediction.net | Temporarily failed upload of hadcm3s_2jcd_2001_2_009033044_1_1.zip: connect() failed

- which does sound like a server needing a restart, in this case. (or perhaps just a restart of the Apache service)
ID: 50267 · Report as offensive     Reply Quote
ProfileAlan K

Send message
Joined: 22 Feb 06
Posts: 491
Credit: 30,992,465
RAC: 14,585
Message 50269 - Posted: 22 Sep 2014, 22:43:16 UTC - in response to Message 50267.  

Just had a dowload failure as well:_

22/09/2014 22:50:15 | climateprediction.net | Started download of hadcm3s_1a0k_2001_2_008988374.zip
22/09/2014 22:50:15 | climateprediction.net | Started download of 1m7a_2001.astart.gz
22/09/2014 22:50:17 | climateprediction.net | Finished download of hadcm3s_1a0k_2001_2_008988374.zip
22/09/2014 22:50:17 | climateprediction.net | Giving up on download of 1m7a_2001.astart.gz: permanent HTTP error
22/09/2014 22:50:17 | climateprediction.net | Started download of 1m7a_2001.ostart.gz
22/09/2014 22:50:19 | climateprediction.net | Giving up on download of 1m7a_2001.ostart.gz: permanent HTTP error
22/09/2014 22:50:26 | climateprediction.net | Temporarily failed upload of hadcm3s_2a94_2001_2_009021263_1_1.zip: connect() failed
ID: 50269 · Report as offensive     Reply Quote
Niall

Send message
Joined: 18 Dec 13
Posts: 62
Credit: 1,078,935
RAC: 0
Message 50270 - Posted: 23 Sep 2014, 10:29:12 UTC

Error on upload of zip file for hadcm3n since 0740 GMT (transient HTTP error).
ID: 50270 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,708,278
RAC: 9,361
Message 50271 - Posted: 23 Sep 2014, 10:53:26 UTC - in response to Message 50270.  

Error on upload of zip file for hadcm3n since 0740 GMT (transient HTTP error).

Is that heading towards the same 'rapid-watch.badc' server as the cm3s uploads?

Apparently that server isn't under the direct control of the CPDN project staff, but is administered by http://www.ceda.ac.uk/blog/. A message has been sent...
ID: 50271 · Report as offensive     Reply Quote
Niall

Send message
Joined: 18 Dec 13
Posts: 62
Credit: 1,078,935
RAC: 0
Message 50272 - Posted: 23 Sep 2014, 13:53:27 UTC - in response to Message 50271.  

Error on upload of zip file for hadcm3n since 0740 GMT (transient HTTP error).

Is that heading towards the same 'rapid-watch.badc' server as the cm3s uploads?



I don't know, Richard. How do I find out?

NB: Now getting "connect () failed" error.

hadam3p_anz zip uploaded normally.
ID: 50272 · Report as offensive     Reply Quote
Admin

Send message
Joined: 29 Mar 14
Posts: 2
Credit: 707,720
RAC: 0
Message 50273 - Posted: 23 Sep 2014, 13:54:16 UTC

Had3cms zip uploads currently total over 2.5GB on this computer alone. Do you guys have an explanation you can share? It's not a big problem .. yet .. But it would be nice to use this months internet usage allowance sometime this month?
With Thanks from a UTC+10 colonial ...

23/09/2014 9:48:00 PM | climateprediction.net | Started upload of hadcm3s_2e8c_2001_2_009026419_0_1.zip
23/09/2014 9:48:00 PM | climateprediction.net | Started upload of hadcm3s_2e89_2001_2_009026416_0_1.zip
23/09/2014 9:48:22 PM | climateprediction.net | Temporarily failed upload of hadcm3s_2e8c_2001_2_009026419_0_1.zip: connect() failed
23/09/2014 9:48:22 PM | climateprediction.net | Backing off 00:13:22 on upload of hadcm3s_2e8c_2001_2_009026419_0_1.zip
23/09/2014 9:48:22 PM | climateprediction.net | Temporarily failed upload of hadcm3s_2e89_2001_2_009026416_0_1.zip: connect() failed
23/09/2014 9:48:22 PM | climateprediction.net | Backing off 00:13:48 on upload of hadcm3s_2e89_2001_2_009026416_0_1.zip
23/09/2014 9:48:47 PM | | Project communication failed: attempting access to reference site
23/09/2014 9:48:49 PM | | Internet access OK - project servers may be temporarily down.
ID: 50273 · Report as offensive     Reply Quote
KWSN Sir Clark

Send message
Joined: 8 Jul 05
Posts: 33
Credit: 1,274,211
RAC: 0
Message 50274 - Posted: 23 Sep 2014, 14:42:37 UTC

It needs a kick up the backside.

Just under 2,000 WUs available a no way to report them. Currently got two queued and a third on the way.
ID: 50274 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,708,278
RAC: 9,361
Message 50275 - Posted: 23 Sep 2014, 15:20:31 UTC - in response to Message 50272.  

I don't know, Richard. How do I find out?

Either look - DON'T CHANGE ANYTHING - inside client_state.xml for the upload urls.

Or enable http_debug logging, to display the sort of event log messages I posted.
ID: 50275 · Report as offensive     Reply Quote
Niall

Send message
Joined: 18 Dec 13
Posts: 62
Credit: 1,078,935
RAC: 0
Message 50276 - Posted: 23 Sep 2014, 15:45:09 UTC - in response to Message 50275.  

I don't know, Richard. How do I find out?

Either look - DON'T CHANGE ANYTHING - inside client_state.xml for the upload urls.

Or enable http_debug logging, to display the sort of event log messages I posted.


From what I can see, these zips seem to be being sent to http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler, so I take that as a yes.

I imagine this will be fixed at the same time as the hadcm3s bug is fixed, then.
ID: 50276 · Report as offensive     Reply Quote
Gabriel Dario Wrobel

Send message
Joined: 4 Mar 05
Posts: 3
Credit: 8,862,167
RAC: 9,309
Message 50300 - Posted: 24 Sep 2014, 19:12:32 UTC

Hi guys!

I'm having upload problems for some days too:

24/09/2014 03:27:12 p.m. | climateprediction.net | Started upload of hadcm3s_27t8_1991_2_009018099_0_2.zip
24/09/2014 03:27:12 p.m. | climateprediction.net | Started upload of hadcm3s_2j1k_2001_2_009032655_0_1.zip
24/09/2014 03:32:20 p.m. | climateprediction.net | Temporarily failed upload of hadcm3s_27t8_1991_2_009018099_0_2.zip: transient HTTP error
24/09/2014 03:32:20 p.m. | climateprediction.net | Backing off 05:17:15 on upload of hadcm3s_27t8_1991_2_009018099_0_2.zip
24/09/2014 03:32:20 p.m. | climateprediction.net | Temporarily failed upload of hadcm3s_2j1k_2001_2_009032655_0_1.zip: transient HTTP error
24/09/2014 03:32:20 p.m. | climateprediction.net | Backing off 05:31:53 on upload of hadcm3s_2j1k_2001_2_009032655_0_1.zip

These are just examples. I�m having ten tasks waiting theirs uploads to complete.

Anything to do? Or should I just wait?


ID: 50300 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 50301 - Posted: 24 Sep 2014, 20:02:00 UTC - in response to Message 50300.  

Hi Gabriel

Just wait.
Look through the recent posts in this thread if you want to know what's going on.

ID: 50301 · Report as offensive     Reply Quote
Eirik Redd

Send message
Joined: 31 Aug 04
Posts: 391
Credit: 219,896,461
RAC: 649
Message 50307 - Posted: 25 Sep 2014, 5:21:20 UTC - in response to Message 50301.  

rapid-watch seems to be up, but with a big backlog. Like locally, here, almost 100 63GB uploads to go.

Please don't try hitting the "retry now" -- that just makes it worse.

The files will be uploaded, the data will be saved and archived.

Patience is a virtue. As I remind myself time to time.

This time a peripheral server was down for about 5 days, and is catching up very well thank you.

Please consider the time scales of heat-death vs "models that anticipate heat-death"

Yup. Please smile. Thanks.


ID: 50307 · Report as offensive     Reply Quote
Admin

Send message
Joined: 29 Mar 14
Posts: 2
Credit: 707,720
RAC: 0
Message 50309 - Posted: 25 Sep 2014, 10:21:59 UTC - in response to Message 50307.  

With Thanks from a UTC+10 colonial for the explanation.
ID: 50309 · Report as offensive     Reply Quote
Previous · 1 . . . 11 · 12 · 13 · 14 · 15 · 16 · 17 . . . 33 · Next

Message boards : Number crunching : ANOTHER UPLOAD PROBLEM

©2024 cpdn.org