climateprediction.net (CPDN) home page
Thread 'Uploading files fails'

Thread 'Uploading files fails'

Message boards : Number crunching : Uploading files fails
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 · Next

AuthorMessage
Fons

Send message
Joined: 25 Aug 18
Posts: 4
Credit: 160,583
RAC: 0
Message 62438 - Posted: 19 May 2020, 12:06:27 UTC

Project Climateprediction.net Wether at Home fails to upload results. Upload keeps pending for months now in Boinc.
Other projects upload properly, such as Rosetta@home, World Community Grid. What is the problem here with Climate prediction?
These files have taken many days to complete, it will be nice if the work will not get lost.

The projects are:
Weather At Home 2 (wah2) 8.24.
Filenames are:
wah2_cam25_a0hz_200405_18_832_011891014
wah2_cam25_a0kj_200405_18_832_011891106
wah2_cam25_a0dd_200405_18_832_01189084
wah2_cam25_a0ld_200405_18_832_011891136

files were recieved on 18-9-2019
ID: 62438 · Report as offensive     Reply Quote
Bryn Mawr

Send message
Joined: 28 Jul 19
Posts: 150
Credit: 12,830,559
RAC: 228
Message 62439 - Posted: 19 May 2020, 12:56:43 UTC - in response to Message 62438.  

Project Climateprediction.net Wether at Home fails to upload results. Upload keeps pending for months now in Boinc.
Other projects upload properly, such as Rosetta@home, World Community Grid. What is the problem here with Climate prediction?
These files have taken many days to complete, it will be nice if the work will not get lost.

The projects are:
Weather At Home 2 (wah2) 8.24.
Filenames are:
wah2_cam25_a0hz_200405_18_832_011891014
wah2_cam25_a0kj_200405_18_832_011891106
wah2_cam25_a0dd_200405_18_832_01189084
wah2_cam25_a0ld_200405_18_832_011891136

files were recieved on 18-9-2019


Can you turn the file xfer option on in the event log options just before the retry? That should give you more detail about the reason for failure.
ID: 62439 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 62440 - Posted: 19 May 2020, 13:36:15 UTC - in response to Message 62438.  

Batch 832 was closed on 14 February, so just abort any transfers you have for those batches.
ID: 62440 · Report as offensive     Reply Quote
Harri Liljeroos

Send message
Joined: 9 Dec 05
Posts: 116
Credit: 12,547,934
RAC: 2,738
Message 62466 - Posted: 22 May 2020, 18:01:15 UTC

The zips from new anz50 tasks from batch 871 fail to upload.
ID: 62466 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 62467 - Posted: 22 May 2020, 18:36:59 UTC - in response to Message 62466.  

And the error message is?
ID: 62467 · Report as offensive     Reply Quote
Fons

Send message
Joined: 25 Aug 18
Posts: 4
Credit: 160,583
RAC: 0
Message 62470 - Posted: 22 May 2020, 19:12:37 UTC - in response to Message 62440.  

Why did that happen? i have until august to finisch according to boinc. So thats 54 days of computing down the drain?
ID: 62470 · Report as offensive     Reply Quote
Fons

Send message
Joined: 25 Aug 18
Posts: 4
Credit: 160,583
RAC: 0
Message 62472 - Posted: 22 May 2020, 20:08:27 UTC - in response to Message 62439.  

I wil look in to this and come back on it.
ID: 62472 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 62474 - Posted: 22 May 2020, 20:44:27 UTC

The "BOINC deadline" is long to prevent cpdn from hogging the processors, when other very much shorter projects are run at the same time.
This has been posted about for years.

The "deadline" here is, ASAP, so the researchers can do their analysis of the data.
And when they get back enough results, the batch is usually closed to free up server space.

Anyone who hasn't returned their results in a timely manner just misses out.
ID: 62474 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 62476 - Posted: 22 May 2020, 21:09:45 UTC - in response to Message 62467.  
Last modified: 22 May 2020, 21:13:27 UTC

And the error message is?

Trying to upload zips to upload4...


5/22/2020 3:34:53 PM | climateprediction.net | Started upload of wah2_anz50_32by_209712_32_872_012028010_0_r1951086341_1.zip
5/22/2020 3:36:38 PM | climateprediction.net | Started upload of wah2_anz50_310v_209212_32_872_012026315_0_r2048446855_1.zip
5/22/2020 3:40:01 PM | | Project communication failed: attempting access to reference site
5/22/2020 3:40:01 PM | climateprediction.net | Temporarily failed upload of wah2_anz50_32by_209712_32_872_012028010_0_r1951086341_1.zip: transient HTTP error
5/22/2020 3:40:01 PM | climateprediction.net | Backing off 00:02:50 on upload of wah2_anz50_32by_209712_32_872_012028010_0_r1951086341_1.zip
5/22/2020 3:40:02 PM | | Internet access OK - project servers may be temporarily down.
5/22/2020 3:42:53 PM | climateprediction.net | Started upload of wah2_anz50_32by_209712_32_872_012028010_0_r1951086341_1.zip
5/22/2020 3:47:59 PM | climateprediction.net | Temporarily failed upload of wah2_anz50_32by_209712_32_872_012028010_0_r1951086341_1.zip: transient HTTP error
5/22/2020 3:47:59 PM | climateprediction.net | Backing off 00:07:19 on upload of wah2_anz50_32by_209712_32_872_012028010_0_r1951086341_1.zip
5/22/2020 3:48:00 PM | | Project communication failed: attempting access to reference site
5/22/2020 3:48:02 PM | | Internet access OK - project servers may be temporarily down.
5/22/2020 3:52:06 PM | climateprediction.net | [error] Error reported by file upload server: EOF on socket read : asked for 262144, got 163840
5/22/2020 3:52:06 PM | climateprediction.net | Temporarily failed upload of wah2_anz50_310v_209212_32_872_012026315_0_r2048446855_1.zip: transient upload error
5/22/2020 3:52:06 PM | climateprediction.net | Backing off 00:03:07 on upload of wah2_anz50_310v_209212_32_872_012026315_0_r2048446855_1.zip

It now uploads the 33 MB files to 100% but doesn't complete.
ID: 62476 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 62478 - Posted: 22 May 2020, 21:53:57 UTC - in response to Message 62476.  

Thanks George.
I've emailed Andy.

The ANZ people may be working from a home office, and it's the weekend.
And freezing down here at the moment.
ID: 62478 · Report as offensive     Reply Quote
Harri Liljeroos

Send message
Joined: 9 Dec 05
Posts: 116
Credit: 12,547,934
RAC: 2,738
Message 62479 - Posted: 22 May 2020, 22:16:25 UTC

My uploads our now mostly uploaded, usually not on first try, but eventually they do finish successfully.
ID: 62479 · Report as offensive     Reply Quote
Tomcat

Send message
Joined: 29 May 15
Posts: 17
Credit: 717,192
RAC: 12,206
Message 62484 - Posted: 23 May 2020, 18:38:04 UTC
Last modified: 23 May 2020, 18:40:46 UTC

I have 21 or so uploads waiting. It's been over 36 hours and they still haven't uploaded yet.
Often they get to 100%, then just get stuck there. Is it a client problem, or is it a server problem? Rosetta@home tasks are uploading fine.
ID: 62484 · Report as offensive     Reply Quote
Dr Who Fan
Avatar

Send message
Joined: 30 May 05
Posts: 12
Credit: 690,627
RAC: 312
Message 62485 - Posted: 23 May 2020, 21:31:00 UTC

I also am having UPLOAD problem with a task just received on 5/22/2020 06:36:21.
(Add 5 hours to times noted to get UTC time).

Application: Weather At Home 2 (wah2) 8.24
Workunit name: wah2_anz50_2124_209212_32_871_012023210

From the BOINC evernt logs:
5/23/2020 16:19:40 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle 'C:\BOINC\ca-bundle.crt'
5/23/2020 16:19:40 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set
5/23/2020 16:19:40 | climateprediction.net | Started upload of wah2_anz50_2124_209212_32_871_012023210_0_r307744128_1.zip
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Info: Connection 2297 seems to be dead!
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Info: Closing connection 2297
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Info: Connection 2298 seems to be dead!
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Info: Closing connection 2298
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Info: Connection 2299 seems to be dead!
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Info: Closing connection 2299
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Info: Trying 144.6.252.28...
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Info: Connected to upload4.cpdn.org (144.6.252.28) port 80 (#2300)
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Sent header to server: Host: upload4.cpdn.org
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.16.3)
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Sent header to server: Accept: */*
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Sent header to server: Accept-Encoding: deflate, gzip
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Sent header to server: Accept-Language: en_US
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Sent header to server: Content-Length: 311
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Sent header to server: Content-Type: application/x-www-form-urlencoded
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Sent header to server:
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Sent header to server: d
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Sent header to server: Expect: 100-continue
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Sent header to server:
5/23/2020 16:19:41 | climateprediction.net | [http] [ID#8945] Info: We are completely uploaded and fine
5/23/2020 16:21:13 | climateprediction.net | [http] [ID#8945] Info: Recv failure: Connection was aborted
5/23/2020 16:21:13 | climateprediction.net | [http] [ID#8945] Info: Closing connection 2300
5/23/2020 16:21:13 | climateprediction.net | [http] HTTP error: Failure when receiving data from the peer
5/23/2020 16:21:13 | climateprediction.net | Temporarily failed upload of wah2_anz50_2124_209212_32_871_012023210_0_r307744128_1.zip: transient HTTP error
5/23/2020 16:21:13 | climateprediction.net | Backing off 04:29:04 on upload of wah2_anz50_2124_209212_32_871_012023210_0_r307744128_1.zip


ID: 62485 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 62486 - Posted: 23 May 2020, 22:34:21 UTC

Yes, there's something not going on down in Hobart Tasmania.

I've told Andy, but it's the weekend.
And Monday is Spring bank holiday in the UK.
ID: 62486 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 62487 - Posted: 23 May 2020, 23:59:10 UTC

The people involved with this are looking into it.
ID: 62487 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Jan 06
Posts: 637
Credit: 26,751,529
RAC: 653
Message 62488 - Posted: 24 May 2020, 1:49:19 UTC - in response to Message 62487.  

I am uploading two zips now. They are a bit slow at 50 kbps, but at least going.
ID: 62488 · Report as offensive     Reply Quote
BulletMagnetEd

Send message
Joined: 5 Sep 04
Posts: 2
Credit: 9,012,838
RAC: 0
Message 62489 - Posted: 24 May 2020, 3:37:48 UTC

Me too. I have 7 zips waiting to upload.
ID: 62489 · Report as offensive     Reply Quote
ProfileJIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,363,583
RAC: 5,022
Message 62496 - Posted: 25 May 2020, 6:38:15 UTC - in response to Message 62488.  

I am uploading two zips now. They are a bit slow at 50 kbps, but at least going.


Did they ever finish uploading and clear? Many of mine have reached 100% only to stall there and then drop back to 0%.
ID: 62496 · Report as offensive     Reply Quote
Tomcat

Send message
Joined: 29 May 15
Posts: 17
Credit: 717,192
RAC: 12,206
Message 62497 - Posted: 25 May 2020, 9:23:09 UTC - in response to Message 62496.  

I am uploading two zips now. They are a bit slow at 50 kbps, but at least going.


Did they ever finish uploading and clear? Many of mine have reached 100% only to stall there and then drop back to 0%.


My uploads either don't move at all or get to 100% and stall there. Interestingly, these trickles do appear on the website. Although, I don't seem to be getting any credits for them.
I think my tasks are from batch 870, are they still open?
ID: 62497 · Report as offensive     Reply Quote
Panzer_V

Send message
Joined: 12 Sep 04
Posts: 2
Credit: 583,083
RAC: 0
Message 62498 - Posted: 25 May 2020, 10:39:08 UTC

Same here....uploads from the ANZ50 are not uploading. And when they do....they get stuck on 100%.

Is there a sollution pending?
ID: 62498 · Report as offensive     Reply Quote
1 · 2 · 3 · 4 · Next

Message boards : Number crunching : Uploading files fails

©2024 cpdn.org