climateprediction.net (CPDN) home page
Thread 'transient HTTP error'

Thread 'transient HTTP error'

Message boards : Number crunching : transient HTTP error
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4

AuthorMessage
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 59358 - Posted: 8 Jan 2019, 20:42:28 UTC - in response to Message 59357.  

And HADCM3S zips also failing at 100%. Was vaguely hoping they were going somewhere else so would get through. Obviously not!


And now there are two.

Tue 08 Jan 2019 03:21:18 PM EST | climateprediction.net | [error] Error reported by file upload server: EOF on socket read : asked for 262144, got 141232
Tue 08 Jan 2019 03:28:27 PM EST | climateprediction.net | Requesting new tasks for CPU
Tue 08 Jan 2019 03:28:29 PM EST | climateprediction.net | Scheduler request completed: got 0 new tasks
Tue 08 Jan 2019 03:28:29 PM EST | climateprediction.net | No tasks sent
Tue 08 Jan 2019 03:28:29 PM EST | climateprediction.net | No tasks are available for UK Met Office HadAM3P (global only) with MOSES II landsurface scheme
Tue 08 Jan 2019 03:28:29 PM EST | climateprediction.net | No tasks are available for UK Met Office Coupled Model Full Resolution Ocean
Tue 08 Jan 2019 03:28:29 PM EST | climateprediction.net | No tasks are available for UK Met Office HadCM3 short
Tue 08 Jan 2019 03:28:29 PM EST | climateprediction.net | No tasks are available for Weather At Home 2 (wah2) (region independent)
Tue 08 Jan 2019 03:29:15 PM EST | climateprediction.net | Started upload of hadcm3s_x5300_190012_60_771_011668342_2_r376222488_2.zip
Tue 08 Jan 2019 03:29:18 PM EST | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space
Tue 08 Jan 2019 03:29:18 PM EST | climateprediction.net | Temporarily failed upload of hadcm3s_x5300_190012_60_771_011668342_2_r376222488_2.zip: transient upload error
Tue 08 Jan 2019 03:29:18 PM EST | climateprediction.net | Backing off 00:02:24 on upload of hadcm3s_x5300_190012_60_771_011668342_2_r376222488_2.zip
ID: 59358 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4538
Credit: 19,005,674
RAC: 21,647
Message 59359 - Posted: 9 Jan 2019, 8:16:50 UTC

Looks like there is no new work now so perhaps in time that will allow data to be taken off quicker than it is piling up.
ID: 59359 · Report as offensive     Reply Quote
Eirik Redd

Send message
Joined: 31 Aug 04
Posts: 391
Credit: 219,896,461
RAC: 649
Message 59362 - Posted: 9 Jan 2019, 11:05:31 UTC - in response to Message 59355.  

The future is a strange place. You'll just have to wait and see.


Too true. Thanks for short sweet true words. And thanks for your long time support of this project.
We like Les!
ID: 59362 · Report as offensive     Reply Quote
[SG]Felix

Send message
Joined: 4 Oct 15
Posts: 34
Credit: 9,075,151
RAC: 374
Message 59363 - Posted: 9 Jan 2019, 12:35:01 UTC

now there is enough space on the disk, but now i have this transient HTTP error..
ID: 59363 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 59364 - Posted: 9 Jan 2019, 12:46:05 UTC - in response to Message 59363.  

now there is enough space on the disk, but now i have this transient HTTP error..


Not recently:

Wed 09 Jan 2019 06:26:18 AM EST | climateprediction.net | Started upload of hadcm3s_x5300_190012_60_771_011668342_2_r376222488_1.zip
Wed 09 Jan 2019 06:26:18 AM EST | climateprediction.net | Started upload of hadcm3s_x5300_190012_60_771_011668342_2_r376222488_2.zip
Wed 09 Jan 2019 06:26:21 AM EST | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space
Wed 09 Jan 2019 06:26:21 AM EST | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space
Wed 09 Jan 2019 06:26:21 AM EST | climateprediction.net | Temporarily failed upload of hadcm3s_x5300_190012_60_771_011668342_2_r376222488_1.zip: transient upload error
Wed 09 Jan 2019 06:26:21 AM EST | climateprediction.net | Backing off 05:51:37 on upload of hadcm3s_x5300_190012_60_771_011668342_2_r376222488_1.zip
Wed 09 Jan 2019 06:26:21 AM EST | climateprediction.net | Temporarily failed upload of hadcm3s_x5300_190012_60_771_011668342_2_r376222488_2.zip: transient upload error
Wed 09 Jan 2019 06:26:21 AM EST | climateprediction.net | Backing off 00:17:48 on upload of hadcm3s_x5300_190012_60_771_011668342_2_r376222488_2.zip
ID: 59364 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 59365 - Posted: 9 Jan 2019, 12:47:36 UTC

That's because all of the computers are pushing and shoving trying to get THEIR zips onto the server.

Now's the time for a nice long relaxing walk. :)
ID: 59365 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 59366 - Posted: 9 Jan 2019, 13:00:15 UTC - in response to Message 59364.  

Tried again:

Wed 09 Jan 2019 07:49:06 AM EST | climateprediction.net | Started upload of hadcm3s_x5300_190012_60_771_011668342_2_r376222488_1.zip
Wed 09 Jan 2019 07:49:06 AM EST | climateprediction.net | Started upload of hadcm3s_x5300_190012_60_771_011668342_2_r376222488_2.zip
Wed 09 Jan 2019 07:56:10 AM EST | | Project communication failed: attempting access to reference site
Wed 09 Jan 2019 07:56:10 AM EST | climateprediction.net | Temporarily failed upload of hadcm3s_x5300_190012_60_771_011668342_2_r376222488_1.zip: transient HTTP error
Wed 09 Jan 2019 07:56:10 AM EST | climateprediction.net | Backing off 05:47:46 on upload of hadcm3s_x5300_190012_60_771_011668342_2_r376222488_1.zip
Wed 09 Jan 2019 07:56:11 AM EST | | Internet access OK - project servers may be temporarily down.
Wed 09 Jan 2019 07:58:12 AM EST | climateprediction.net | [error] Error reported by file upload server: EOF on socket read : asked for 262144, got 139416
Wed 09 Jan 2019 07:58:12 AM EST | climateprediction.net | Temporarily failed upload of hadcm3s_x5300_190012_60_771_011668342_2_r376222488_2.zip: transient upload error
Wed 09 Jan 2019 07:58:12 AM EST | climateprediction.net | Backing off 00:56:34 on upload of hadcm3s_x5300_190012_60_771_011668342_2_r376222488_2.zip
ID: 59366 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4538
Credit: 19,005,674
RAC: 21,647
Message 59367 - Posted: 9 Jan 2019, 16:18:51 UTC

Tried again:


And still getting the same. laptop that runs all the time is set to upload zips during the night, will see if any have gone tomorrow morning. For this machine will try again then.
ID: 59367 · Report as offensive     Reply Quote
nairb

Send message
Joined: 3 Sep 04
Posts: 105
Credit: 5,646,090
RAC: 102,785
Message 59369 - Posted: 9 Jan 2019, 22:14:29 UTC

Nooooooo .... still getting to 100% then fails with transient HTTP error.
ID: 59369 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 59373 - Posted: 10 Jan 2019, 1:53:44 UTC

It may well be next week before the data moving is complete.

In the mean time, I'd recommend turn off Network Access.
ID: 59373 · Report as offensive     Reply Quote
ProfileHK1959
Avatar

Send message
Joined: 16 Jan 05
Posts: 2
Credit: 356,855
RAC: 0
Message 59388 - Posted: 11 Jan 2019, 5:39:59 UTC
Last modified: 11 Jan 2019, 5:59:09 UTC

Since several days there ist a problem with uploading the following zip-files. Both files are about 100MB. The servers actually are NOT down. Is there anything to do to fix the problem ???

11.01.2019 06:15:56 | climateprediction.net | Started upload of wah2_safr50_n0os_198812_14_781_011715524_0_r2119897606_2.zip
11.01.2019 06:15:56 | climateprediction.net | Started upload of wah2_safr50_n0os_198812_14_781_011715524_0_r2119897606_3.zip
11.01.2019 06:15:59 | | Project communication failed: attempting access to reference site
11.01.2019 06:15:59 | climateprediction.net | Temporarily failed upload of wah2_safr50_n0os_198812_14_781_011715524_0_r2119897606_2.zip: connect() failed
11.01.2019 06:15:59 | climateprediction.net | Backing off 05:06:15 on upload of wah2_safr50_n0os_198812_14_781_011715524_0_r2119897606_2.zip
11.01.2019 06:15:59 | climateprediction.net | Temporarily failed upload of wah2_safr50_n0os_198812_14_781_011715524_0_r2119897606_3.zip: connect() failed
11.01.2019 06:15:59 | climateprediction.net | Backing off 05:34:35 on upload of wah2_safr50_n0os_198812_14_781_011715524_0_r2119897606_3.zip
11.01.2019 06:16:01 | | Internet access OK - project servers may be temporarily down.
ID: 59388 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 59389 - Posted: 11 Jan 2019, 6:13:00 UTC

1) Suspend each of the climate models. (This will stop yet more files from being created.)

2) Set the Network access in the BOINC Manager to OFF. (This will stop BOINC's constant attempts to upload the files.)

3) Wait patiently until lots of space has been freed up on the Upload server.
This may take until Monday.
ID: 59389 · Report as offensive     Reply Quote
ProfileHK1959
Avatar

Send message
Joined: 16 Jan 05
Posts: 2
Credit: 356,855
RAC: 0
Message 59390 - Posted: 11 Jan 2019, 6:32:50 UTC - in response to Message 59389.  

Then I will just be more patient. Thank you.
ID: 59390 · Report as offensive     Reply Quote
Speedy

Send message
Joined: 20 Jul 05
Posts: 25
Credit: 414,873
RAC: 406
Message 59399 - Posted: 11 Jan 2019, 20:23:34 UTC - in response to Message 59389.  
Last modified: 11 Jan 2019, 20:25:05 UTC

1) Suspend each of the climate models. (This will stop yet more files from being created.)

2) Set the Network access in the BOINC Manager to OFF. (This will stop BOINC's constant attempts to upload the files.)

3) Wait patiently until lots of space has been freed up on the Upload server.
This may take until Monday.

Is it possible to set number 2) if you are wanting to work on other projects? If yes could somebody please explain how to do this
ID: 59399 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 59400 - Posted: 12 Jan 2019, 1:18:49 UTC

Only manually.

Set it to off.
Then, when other projects need to upload files, set it to ON.

And then back to off again after they finish uploading, even if the cpdn files have started uploading.
They're not going to get anywhere anyway, so you may as well save your bandwidth.

None of this is particularly wonderful; it's just trying to make the best of a bad situation.
ID: 59400 · Report as offensive     Reply Quote
Speedy

Send message
Joined: 20 Jul 05
Posts: 25
Credit: 414,873
RAC: 406
Message 59401 - Posted: 12 Jan 2019, 1:52:41 UTC - in response to Message 59400.  

Only manually.

Set it to off.
Then, when other projects need to upload files, set it to ON.

And then back to off again after they finish uploading, even if the cpdn files have started uploading.
They're not going to get anywhere anyway, so you may as well save your bandwidth.

None of this is particularly wonderful; it's just trying to make the best of a bad situation.

Thanks Les, I am on an unlimited plan. Hope the data shifting goes well. It would be useful if we had a storage indicator on the server status page. I am not sure if this is possible. Would help us know what was going on moving forward.
ID: 59401 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4

Message boards : Number crunching : transient HTTP error

©2024 cpdn.org