climateprediction.net (CPDN) home page
Thread 'Stuck upload issue'

Thread 'Stuck upload issue'

Message boards : Number crunching : Stuck upload issue
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 . . . 5 · Next

AuthorMessage
boinc127

Send message
Joined: 5 Apr 14
Posts: 10
Credit: 510,274
RAC: 671
Message 57400 - Posted: 27 Nov 2017, 4:03:13 UTC
Last modified: 27 Nov 2017, 4:06:52 UTC

I've got a stuck upload issue. I have been trying for almost a week to upload the last 2 "trickles?" of a workunit and the final zip file, but all three refuse to upload. The workunit is here https://www.cpdn.org/cpdnboinc/result.php?resultid=20166404. The most recent attempt to upload shows:

11.26.2017 21.59.39 | climateprediction.net | Started upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_9.zip
11.26.2017 21.59.39 | climateprediction.net | Started upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_10.zip
11.26.2017 22.00.01 | climateprediction.net | Temporarily failed upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_9.zip: connect() failed
11.26.2017 22.00.01 | climateprediction.net | Backing off 03:26:17 on upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_9.zip
11.26.2017 22.00.01 | climateprediction.net | Temporarily failed upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_10.zip: connect() failed
11.26.2017 22.00.01 | climateprediction.net | Backing off 04:44:45 on upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_10.zip
11.26.2017 22.00.01 | climateprediction.net | Started upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_out.zip
11.26.2017 22.00.01 | | Project communication failed: attempting access to reference site
11.26.2017 22.00.03 | | Internet access OK - project servers may be temporarily down.
11.26.2017 22.00.22 | climateprediction.net | Temporarily failed upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_out.zip: connect() failed
11.26.2017 22.00.22 | climateprediction.net | Backing off 03:50:21 on upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_out.zip
11.26.2017 22.00.23 | | Project communication failed: attempting access to reference site
11.26.2017 22.00.24 | | Internet access OK - project servers may be temporarily down.


I'm not sure what the issue is. The server status shows all green. Does anyone have any thoughts on the issue? Thanks in advance.
ID: 57400 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 57401 - Posted: 27 Nov 2017, 7:52:33 UTC - in response to Message 57400.  

It's possible the server it is being sent to is located somewhere other than oxford. The Server Status page doesn't have status for those servers. If you are running a recent version of boinc, there is an Event Log Option under the Options menu of boinc manager that is called file_xfer_debug. If you select that, debug messages will give you the server name the next time it tries to upload the files. If you answer back here with that upload server name, we can have someone check what is going on.
ID: 57401 · Report as offensive     Reply Quote
MossyRock
Avatar

Send message
Joined: 4 Oct 13
Posts: 27
Credit: 2,301,681
RAC: 7,632
Message 57405 - Posted: 27 Nov 2017, 13:31:36 UTC - in response to Message 57400.  
Last modified: 27 Nov 2017, 13:39:05 UTC

I had the exact same problem with this same type of model.

See my recent thread here: https://www.cpdn.org/cpdnboinc/forum_thread.php?id=8516

You can wait for the server-end problem to be resolved at which time your files will upload, or you can abort the model showing as uploading in BM, then abort the transfers.

After waiting for days I decided to clean things up and do the aborts. If you report the server name that is having the problem perhaps the third party will fix it so your uploads will complete.
ID: 57405 · Report as offensive     Reply Quote
Dave Roberts

Send message
Joined: 15 Jan 11
Posts: 175
Credit: 6,242,691
RAC: 699
Message 57406 - Posted: 27 Nov 2017, 17:46:09 UTC

I had a similar problem a couple of months ago. Everything uploaded after about 8 days.
Very frustrating when one doesn't know where the problem lies.
ID: 57406 · Report as offensive     Reply Quote
boinc127

Send message
Joined: 5 Apr 14
Posts: 10
Credit: 510,274
RAC: 671
Message 57407 - Posted: 27 Nov 2017, 18:11:13 UTC

Here is the diagnostic information. It appears the upload server URL is: http://upload3.cpdn.org/cgi-bin/file_upload_handler

11.27.2017 12.06.59 | climateprediction.net | [fxd] starting upload, upload_offset -1
11.27.2017 12.06.59 | climateprediction.net | Started upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_9.zip
11.27.2017 12.06.59 | climateprediction.net | [file_xfer] URL: http://upload3.cpdn.org/cgi-bin/file_upload_handler
11.27.2017 12.06.59 | climateprediction.net | [fxd] starting upload, upload_offset -1
11.27.2017 12.06.59 | climateprediction.net | Started upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_10.zip
11.27.2017 12.06.59 | climateprediction.net | [file_xfer] URL: http://upload3.cpdn.org/cgi-bin/file_upload_handler
11.27.2017 12.07.21 | climateprediction.net | [file_xfer] http op done; retval -107 (connect() failed)
11.27.2017 12.07.21 | climateprediction.net | [file_xfer] http op done; retval -107 (connect() failed)
11.27.2017 12.07.21 | climateprediction.net | [file_xfer] file transfer status -107 (connect() failed)
11.27.2017 12.07.21 | climateprediction.net | Temporarily failed upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_9.zip: connect() failed
11.27.2017 12.07.21 | climateprediction.net | Backing off 05:59:18 on upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_9.zip
11.27.2017 12.07.21 | climateprediction.net | [file_xfer] file transfer status -107 (connect() failed)
11.27.2017 12.07.21 | climateprediction.net | Temporarily failed upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_10.zip: connect() failed
11.27.2017 12.07.21 | climateprediction.net | Backing off 04:10:13 on upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_10.zip
11.27.2017 12.07.21 | climateprediction.net | [fxd] starting upload, upload_offset -1
11.27.2017 12.07.21 | climateprediction.net | Started upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_out.zip
11.27.2017 12.07.21 | climateprediction.net | [file_xfer] URL: http://upload3.cpdn.org/cgi-bin/file_upload_handler
11.27.2017 12.07.22 | | Project communication failed: attempting access to reference site
11.27.2017 12.07.24 | | Internet access OK - project servers may be temporarily down.
11.27.2017 12.07.43 | | Project communication failed: attempting access to reference site
11.27.2017 12.07.43 | climateprediction.net | [file_xfer] http op done; retval -107 (connect() failed)
11.27.2017 12.07.43 | climateprediction.net | [file_xfer] file transfer status -107 (connect() failed)
11.27.2017 12.07.43 | climateprediction.net | Temporarily failed upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_out.zip: connect() failed
11.27.2017 12.07.43 | climateprediction.net | [file_xfer] project-wide xfer delay for 592.225105 sec
11.27.2017 12.07.43 | climateprediction.net | Backing off 03:47:33 on upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_out.zip
11.27.2017 12.07.44 | | Internet access OK - project servers may be temporarily down.
ID: 57407 · Report as offensive     Reply Quote
boinc127

Send message
Joined: 5 Apr 14
Posts: 10
Credit: 510,274
RAC: 671
Message 57421 - Posted: 1 Dec 2017, 16:40:08 UTC

Please disregard this or thank you for fixing the upload issue. It finally uploaded last night.
ID: 57421 · Report as offensive     Reply Quote
Harri Liljeroos

Send message
Joined: 9 Dec 05
Posts: 116
Credit: 12,547,934
RAC: 2,738
Message 57426 - Posted: 3 Dec 2017, 12:01:10 UTC

Upload errors also on eas50 tasks for me:

39927	climateprediction.net	03-12-2017 12:00	Started upload of wah2_eas50_a23q_201212_12_686_011361874_1_r1920095199_1.zip	
39928			        03-12-2017 12:00	Project communication failed: attempting access to reference site	
39929	climateprediction.net	03-12-2017 12:00	Temporarily failed upload of wah2_eas50_a23q_201212_12_686_011361874_1_r1920095199_1.zip: connect() failed	
39930	climateprediction.net	03-12-2017 12:00	Backing off 03:41:37 on upload of wah2_eas50_a23q_201212_12_686_011361874_1_r1920095199_1.zip	
39931			        03-12-2017 12:00	Internet access OK - project servers may be temporarily down.	


Four zips pending, trickles have went through.
ID: 57426 · Report as offensive     Reply Quote
Owner

Send message
Joined: 12 Mar 06
Posts: 3
Credit: 193,079
RAC: 314
Message 57520 - Posted: 22 Dec 2017, 19:18:10 UTC - in response to Message 57401.  

Hello geophi,

My URL is HTTP://upload7.cpdn.org/cpdn_cgi/file_upload_handler is also not uploading my results for climateprediction project. It is saying that it is backing off and that the servers may be temporarily down.

sincerely,
Mark(USA,Philadelphia area)
ID: 57520 · Report as offensive     Reply Quote
Mephist0

Send message
Joined: 21 Feb 08
Posts: 47
Credit: 7,929,915
RAC: 0
Message 57547 - Posted: 2 Jan 2018, 12:02:22 UTC - in response to Message 57520.  

Hello geophi,

My URL is HTTP://upload7.cpdn.org/cpdn_cgi/file_upload_handler is also not uploading my results for climateprediction project. It is saying that it is backing off and that the servers may be temporarily down.

sincerely,
Mark(USA,Philadelphia area)


I guess you still have that problem?

I have the same problem.. Also upload7.cpdn.org. Anyone knows anything about this host?
ID: 57547 · Report as offensive     Reply Quote
Alex Plantema

Send message
Joined: 3 Sep 04
Posts: 126
Credit: 26,610,380
RAC: 3,377
Message 57548 - Posted: 2 Jan 2018, 20:30:19 UTC

It's in Korea:

D:\Gebruikers\Alex>nslookup upload7.cpdn.org
Server: fritz.box
Address: 192.168.178.1

Non-authoritative answer:
Name: upload7.cpdn.org
Address: 141.223.16.156


D:\Gebruikers\Alex>nslookup 141.223.16.156
Server: fritz.box
Address: 192.168.178.1

Name: eawah.postech.ac.kr
Address: 141.223.16.156
ID: 57548 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4538
Credit: 19,005,674
RAC: 21,647
Message 57552 - Posted: 3 Jan 2018, 11:42:12 UTC

The uploads are going to be temporarily redirected to Oxford to clear the backlog on crunchers' machines. The request to do this has been sent about half an hour ago. I would guess it will happen either today or tomorrow.

For the long term on EAS tasks I have no clue about how long it will take them at the University in Korea to sort out their end.
ID: 57552 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 57559 - Posted: 3 Jan 2018, 19:44:23 UTC

Let us know if this redirect works and your backlog of uploads clears.
ID: 57559 · Report as offensive     Reply Quote
ProfileAlan K

Send message
Joined: 22 Feb 06
Posts: 491
Credit: 30,975,898
RAC: 14,500
Message 57561 - Posted: 4 Jan 2018, 9:09:57 UTC

Looks as if there is a problem with upload6 as well:

04/01/2018 07:06:57 | climateprediction.net | [file_xfer] file transfer status -184 (transient HTTP error)
04/01/2018 07:06:57 | climateprediction.net | Temporarily failed upload of wah2_cam25_a0ds_200405_18_691_011370045_1_r1231016019_17.zip: transient HTTP error
04/01/2018 07:06:57 | climateprediction.net | Backing off 03:22:47 on upload of wah2_cam25_a0ds_200405_18_691_011370045_1_r1231016019_17.zip
ID: 57561 · Report as offensive     Reply Quote
Doug Jenkins
Avatar

Send message
Joined: 28 Aug 04
Posts: 2
Credit: 2,562,763
RAC: 2,731
Message 57563 - Posted: 5 Jan 2018, 0:33:52 UTC - in response to Message 57561.  

I have been having the same problem, and have been waiting to see if the redirect fixed it. So far, no.
Here is what I am seeing:
1/4/2018 18:36:38 | climateprediction.net | [http] [ID#972] Info: Connection #1409 to host upload7.cpdn.org left intact
1/4/2018 18:36:38 | climateprediction.net | [file_xfer] http op done; retval -224 (permanent HTTP error)
1/4/2018 18:36:38 | climateprediction.net | [file_xfer] http op done; retval -224 (permanent HTTP error)
1/4/2018 18:36:38 | climateprediction.net | [file_xfer] file transfer status -224 (permanent HTTP error)
1/4/2018 18:36:38 | climateprediction.net | [file_xfer] project-wide xfer delay for 20340.598773 sec
1/4/2018 18:36:38 | climateprediction.net | Backing off 04:51:07 on upload of wah2_eas50_a220_201212_12_686_011361812_0_r1839784977_1.zip
1/4/2018 18:36:38 | climateprediction.net | [file_xfer] file transfer status -224 (permanent HTTP error)
1/4/2018 18:36:38 | climateprediction.net | [file_xfer] project-wide xfer delay for 16206.756798 sec
1/4/2018 18:36:38 | climateprediction.net | Backing off 03:49:22 on upload of wah2_eas50_a220_201212_12_686_011361812_0_r1839784977_2.zip
ID: 57563 · Report as offensive     Reply Quote
Mephist0

Send message
Joined: 21 Feb 08
Posts: 47
Credit: 7,929,915
RAC: 0
Message 57564 - Posted: 5 Jan 2018, 8:45:10 UTC - in response to Message 57552.  
Last modified: 5 Jan 2018, 8:58:58 UTC

Ok great.

I just did a test now. Not working at the moment.

Only got 8 WU for eas50 .. 7,2GB data waiting for upload :) Only running on 2 computers at the moment :)

05/01/2018 09:43:05 | climateprediction.net | [fxd] starting upload, upload_offset -1
05/01/2018 09:43:05 | climateprediction.net | Started upload of wah2_eas50_a04d_199112_12_690_011368926_0_r1954941867_11.zip
05/01/2018 09:43:05 | climateprediction.net | [file_xfer] URL: http://upload7.cpdn.org/cpdn_cgi/file_upload_handler
05/01/2018 09:43:05 | climateprediction.net | [fxd] starting upload, upload_offset -1
05/01/2018 09:43:05 | climateprediction.net | Started upload of wah2_eas50_a04d_199112_12_690_011368926_0_r1954941867_restart.zip
05/01/2018 09:43:05 | climateprediction.net | [file_xfer] URL: http://upload7.cpdn.org/cpdn_cgi/file_upload_handler
05/01/2018 09:43:06 | climateprediction.net | [file_xfer] http op done; retval -224 (permanent HTTP error)
05/01/2018 09:43:06 | climateprediction.net | [file_xfer] http op done; retval -224 (permanent HTTP error)
05/01/2018 09:43:06 | climateprediction.net | [file_xfer] file transfer status -224 (permanent HTTP error)
05/01/2018 09:43:06 | climateprediction.net | Backing off 00:05:02 on upload of wah2_eas50_a04d_199112_12_690_011368926_0_r1954941867_11.zip
05/01/2018 09:43:06 | climateprediction.net | [file_xfer] file transfer status -224 (permanent HTTP error)
05/01/2018 09:43:06 | climateprediction.net | Backing off 00:06:55 on upload of wah2_eas50_a04d_199112_12_690_011368926_0_r1954941867_restart.zip
ID: 57564 · Report as offensive     Reply Quote
Mephist0

Send message
Joined: 21 Feb 08
Posts: 47
Credit: 7,929,915
RAC: 0
Message 57565 - Posted: 5 Jan 2018, 8:52:06 UTC

I had no idea different upload servers were used for CPDN. You learn something new every day..

That explains the speed difference in uploads :)

pwn25 WU = 2Mbit/s
cam50 WU = 25Mbit/s

:)
ID: 57565 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4538
Credit: 19,005,674
RAC: 21,647
Message 57566 - Posted: 5 Jan 2018, 9:15:42 UTC

Redirect not working and problems with batch 691 both reported to project.
ID: 57566 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4538
Credit: 19,005,674
RAC: 21,647
Message 57568 - Posted: 5 Jan 2018, 11:21:04 UTC

Redirect not working and problems with batch 691 both reported to project.


This is now being looked at.

Again, it would be good to get continued feedback on this so the project can know whether or not it is working. - Probably worth waiting a few hours though unless the feedback is that zips are being uploaded.
ID: 57568 · Report as offensive     Reply Quote
Henk Haneveld

Send message
Joined: 9 Dec 17
Posts: 2
Credit: 221,043
RAC: 774
Message 57569 - Posted: 5 Jan 2018, 11:57:12 UTC

I have just uploaded a set of files that had been stuck for close to a month.
ID: 57569 · Report as offensive     Reply Quote
Harri Liljeroos

Send message
Joined: 9 Dec 05
Posts: 116
Credit: 12,547,934
RAC: 2,738
Message 57571 - Posted: 5 Jan 2018, 13:53:39 UTC

The eas50 zips have all uploaded. Well done people.
ID: 57571 · Report as offensive     Reply Quote
1 · 2 · 3 · 4 . . . 5 · Next

Message boards : Number crunching : Stuck upload issue

©2024 cpdn.org