climateprediction.net (CPDN) home page
Thread 'NZ25 file upload server problems?'

Thread 'NZ25 file upload server problems?'

Message boards : Number crunching : NZ25 file upload server problems?
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3

AuthorMessage
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 65894 - Posted: 19 Aug 2022, 19:53:59 UTC

From Andy,

I have halted the batch sorting processing processes on this server for the time being. They are causing problems with the file uploading.

File uploading should now be proceeding.

All my zips have now uploaded suggesting Andy is right.
ID: 65894 · Report as offensive     Reply Quote
AndreyOR

Send message
Joined: 12 Apr 21
Posts: 317
Credit: 14,896,476
RAC: 18,586
Message 66525 - Posted: 18 Nov 2022, 21:09:52 UTC

Got one of these Windows tasks as a re-send a couple of days ago. Initially trickles were uploading fine but today I have 4 files unable to upload, transient http error. Any known issues with servers like before?
ID: 66525 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66529 - Posted: 20 Nov 2022, 13:07:19 UTC - in response to Message 66525.  
Last modified: 20 Nov 2022, 13:10:20 UTC

Got one of these Windows tasks as a re-send a couple of days ago. Initially trickles were uploading fine but today I have 4 files unable to upload, transient http error. Any known issues with servers like before?
I have the same problem. It uploads half the file then gets stuck, either transient HTTP or EOF on socket read. If it's busy, seems like it should be concentrating on less connections at once, rather than half doing everything then trying again and getting nowhere fast. The following shows difficulty with the last trickleup, followed by several failed attempts at the final upload:

88	climateprediction.net	19-11-2022 03:51 AM	Sending scheduler request: To send trickle-up message.	
89	climateprediction.net	19-11-2022 03:51 AM	Not requesting tasks: don't need (job cache full)	
90	climateprediction.net	19-11-2022 03:51 AM	[sched_op] CPU work request: 0.00 seconds; 0.00 devices	
91	climateprediction.net	19-11-2022 03:51 AM	Scheduler request completed	
92	climateprediction.net	19-11-2022 03:51 AM	[sched_op] Server version 715	
93	climateprediction.net	19-11-2022 03:51 AM	Project requested delay of 3636 seconds	
94	climateprediction.net	19-11-2022 03:51 AM	[sched_op] Deferring communication for 01:00:36	
95	climateprediction.net	19-11-2022 03:51 AM	[sched_op] Reason: requested by project	
96	climateprediction.net	19-11-2022 03:52 AM	Started upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_24.zip	
112	climateprediction.net	19-11-2022 04:03 AM	Temporarily failed upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_24.zip: transient HTTP error	
113	climateprediction.net	19-11-2022 04:03 AM	Backing off 00:02:17 on upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_24.zip	
114			19-11-2022 04:03 AM	Project communication failed: attempting access to reference site	
115			19-11-2022 04:03 AM	Internet access OK - project servers may be temporarily down.	
116	climateprediction.net	19-11-2022 04:03 AM	Started upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_24.zip	
117	climateprediction.net	19-11-2022 04:08 AM	Finished upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_24.zip	
391	climateprediction.net	20-11-2022 12:04 PM	[sched_op] Starting scheduler request	
392	climateprediction.net	20-11-2022 12:04 PM	Sending scheduler request: To send trickle-up message.	
393	climateprediction.net	20-11-2022 12:04 PM	Not requesting tasks: don't need (job cache full)	
394	climateprediction.net	20-11-2022 12:04 PM	[sched_op] CPU work request: 0.00 seconds; 0.00 devices	
395	climateprediction.net	20-11-2022 12:04 PM	Scheduler request completed	
396	climateprediction.net	20-11-2022 12:04 PM	[sched_op] Server version 715	
397	climateprediction.net	20-11-2022 12:04 PM	Project requested delay of 3636 seconds	
398	climateprediction.net	20-11-2022 12:04 PM	[sched_op] Deferring communication for 01:00:36	
399	climateprediction.net	20-11-2022 12:04 PM	[sched_op] Reason: requested by project	
400	climateprediction.net	20-11-2022 12:04 PM	Started upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_25.zip	
401	climateprediction.net	20-11-2022 12:19 PM	Computation for task wah2_nz25_a0ua_199305_25_936_012150852_2 finished	
402	climateprediction.net	20-11-2022 12:19 PM	Started upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_out.zip	
403	climateprediction.net	20-11-2022 12:20 PM	[error] Error reported by file upload server: EOF on socket read : asked for 262144, got 135535	
404	climateprediction.net	20-11-2022 12:20 PM	Temporarily failed upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_25.zip: transient upload error	
405	climateprediction.net	20-11-2022 12:20 PM	Backing off 00:03:23 on upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_25.zip	
406	climateprediction.net	20-11-2022 12:20 PM	Finished upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_out.zip	
407	climateprediction.net	20-11-2022 12:20 PM	Started upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_25.zip	
422	climateprediction.net	20-11-2022 12:32 PM	[error] Error reported by file upload server: EOF on socket read : asked for 262144, got 136237	
423	climateprediction.net	20-11-2022 12:32 PM	Temporarily failed upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_25.zip: transient upload error	
424	climateprediction.net	20-11-2022 12:32 PM	Backing off 00:07:01 on upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_25.zip	
425	climateprediction.net	20-11-2022 12:32 PM	Started upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_25.zip	
426	climateprediction.net	20-11-2022 12:43 PM	Temporarily failed upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_25.zip: transient HTTP error	
427	climateprediction.net	20-11-2022 12:43 PM	Backing off 00:15:02 on upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_25.zip	
428			20-11-2022 12:43 PM	Project communication failed: attempting access to reference site	
429			20-11-2022 12:43 PM	Internet access OK - project servers may be temporarily down.	
430	climateprediction.net	20-11-2022 12:43 PM	Started upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_25.zip	
431			20-11-2022 12:55 PM	Project communication failed: attempting access to reference site	
432	climateprediction.net	20-11-2022 12:55 PM	Temporarily failed upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_25.zip: transient HTTP error	
433	climateprediction.net	20-11-2022 12:55 PM	Backing off 00:17:42 on upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_25.zip	
434			20-11-2022 12:55 PM	Internet access OK - project servers may be temporarily down.	
435	climateprediction.net	20-11-2022 12:55 PM	Started upload of wah2_nz25_a0ua_199305_25_936_012150852_2_r1227134329_25.zip	
ID: 66529 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 66530 - Posted: 20 Nov 2022, 14:51:24 UTC
Last modified: 20 Nov 2022, 14:53:52 UTC

I will let Andy know and he will let those in charge of the server in Tasmania know. Server might not get nudged till Monday though I do know Andy has often acted on these things outside of normal UK work hours.

Edit: done.
ID: 66530 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66531 - Posted: 20 Nov 2022, 16:07:46 UTC - in response to Message 66530.  
Last modified: 20 Nov 2022, 16:09:01 UTC

Dunno if it's fixed or they eventually work, but mine went through. Not sure if you meant done as in you told Andy or done as in somebody nudged it.
ID: 66531 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3

Message boards : Number crunching : NZ25 file upload server problems?

©2024 cpdn.org