climateprediction.net (CPDN) home page
Thread 'Uploading files fails'

Thread 'Uploading files fails'

Message boards : Number crunching : Uploading files fails
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4

AuthorMessage
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 62549 - Posted: 30 May 2020, 22:42:25 UTC

I've let Andy know.
ID: 62549 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,709,106
RAC: 9,121
Message 62550 - Posted: 31 May 2020, 8:02:01 UTC - in response to Message 62545.  
Last modified: 31 May 2020, 8:02:39 UTC

Can you confirm that it is from the three recent batches and go to the event log and say what the message is so we have a bit more information to pass on to Andy and via him to the servers in Oz if needed.
If you see the phrase "transient HTTP error" in your log, please enable the additional detail "http_debug" in BOINC Diagnostic Log Flags (Ctrl+Shift+F). Just retry one upload to get the details, and turn it off again - otherwise it rather fills up your log.

There is a BOINC-wide problem at the moment connecting with some https servers. We need to check whether this is causing the spate of upload problems starting yesterday.
ID: 62550 · Report as offensive     Reply Quote
Dr Who Fan
Avatar

Send message
Joined: 30 May 05
Posts: 12
Credit: 690,627
RAC: 312
Message 62551 - Posted: 31 May 2020, 12:27:39 UTC - in response to Message 62550.  

Here you go Richard

Host 1493214
Microsoft Windows Vista / Home Premium x64 Edition, Service Pack 2,
BOINC Version:: 7.16.3 x64 Windows

5/31/2020 07:14:34 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle 'C:\BOINC\ca-bundle.crt'
5/31/2020 07:14:34 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set
5/31/2020 07:14:34 | climateprediction.net | Started upload of wah2_anz50_2124_209212_32_871_012023210_0_r307744128_5.zip
5/31/2020 07:14:35 | climateprediction.net | [http] [ID#10981] Info: Connection 2577 seems to be dead!
5/31/2020 07:14:35 | climateprediction.net | [http] [ID#10981] Info: Closing connection 2577
5/31/2020 07:14:35 | climateprediction.net | [http] [ID#10981] Info: Trying 144.6.252.28...
5/31/2020 07:14:36 | climateprediction.net | [http] [ID#10981] Info: Connected to upload4.cpdn.org (144.6.252.28) port 80 (#2578)
5/31/2020 07:14:36 | climateprediction.net | [http] [ID#10981] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
5/31/2020 07:14:36 | climateprediction.net | [http] [ID#10981] Sent header to server: Host: upload4.cpdn.org
5/31/2020 07:14:36 | climateprediction.net | [http] [ID#10981] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.16.3)
5/31/2020 07:14:36 | climateprediction.net | [http] [ID#10981] Sent header to server: Accept: */*
5/31/2020 07:14:36 | climateprediction.net | [http] [ID#10981] Sent header to server: Accept-Encoding: deflate, gzip
5/31/2020 07:14:36 | climateprediction.net | [http] [ID#10981] Sent header to server: Accept-Language: en_US
5/31/2020 07:14:36 | climateprediction.net | [http] [ID#10981] Sent header to server: Content-Length: 311
5/31/2020 07:14:36 | climateprediction.net | [http] [ID#10981] Sent header to server: Content-Type: application/x-www-form-urlencoded
5/31/2020 07:14:36 | climateprediction.net | [http] [ID#10981] Sent header to server:
5/31/2020 07:14:36 | climateprediction.net | [http] [ID#10981] Sent header to server: pect: 100-continue
5/31/2020 07:14:36 | climateprediction.net | [http] [ID#10981] Sent header to server:
5/31/2020 07:14:36 | climateprediction.net | [http] [ID#10981] Info: We are completely uploaded and fine
5/31/2020 07:17:42 | climateprediction.net | [http] [ID#10981] Info: Operation too slow. Less than 10 bytes/sec transferred the last 180 seconds
5/31/2020 07:17:42 | climateprediction.net | [http] [ID#10981] Info: Closing connection 2578
5/31/2020 07:17:42 | climateprediction.net | [http] HTTP error: Timeout was reached
5/31/2020 07:17:42 | climateprediction.net | Temporarily failed upload of wah2_anz50_2124_209212_32_871_012023210_0_r307744128_5.zip: transient HTTP error
5/31/2020 07:17:42 | climateprediction.net | Backing off 03:11:24 on upload of wah2_anz50_2124_209212_32_871_012023210_0_r307744128_5.zip


ID: 62551 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,709,106
RAC: 9,121
Message 62552 - Posted: 31 May 2020, 12:57:00 UTC - in response to Message 62551.  

Ta. Simple timeout, not a certificate problem. As you were - false alarm.
ID: 62552 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,026,382
RAC: 20,431
Message 62555 - Posted: 1 Jun 2020, 5:49:03 UTC

I assume that for now this is fixed again judging by the large increase in the numbers reporting according to status page?
ID: 62555 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 62556 - Posted: 1 Jun 2020, 6:10:24 UTC

Hopefully.
ID: 62556 · Report as offensive     Reply Quote
Home

Send message
Joined: 20 Dec 13
Posts: 4
Credit: 959,023
RAC: 887
Message 62574 - Posted: 11 Jun 2020, 20:14:10 UTC

Hello,

uploads are sometimes failing, sometimes working. Below is an excerpt from the log file when failing.

Ron.

11/06/2020 18:27:46 | | log flags: file_xfer, sched_ops, task, http_debug
11/06/2020 18:27:54 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle 'C:\Program Files\BOINC\ca-bundle.crt'
11/06/2020 18:27:54 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set
11/06/2020 18:27:54 | climateprediction.net | Started upload of wah2_anz50_21gc_209412_32_871_012023722_0_r803778365_1.zip
11/06/2020 18:27:55 | climateprediction.net | [http] [ID#95] Info: Hostname in DNS cache was stale, zapped
11/06/2020 18:27:55 | climateprediction.net | [http] [ID#95] Info: Trying 144.6.252.28...
11/06/2020 18:27:55 | climateprediction.net | [http] [ID#95] Info: Connected to upload4.cpdn.org (144.6.252.28) port 80 (#27)
11/06/2020 18:27:55 | climateprediction.net | [http] [ID#95] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
11/06/2020 18:27:55 | climateprediction.net | [http] [ID#95] Sent header to server: Host: upload4.cpdn.org
11/06/2020 18:27:55 | climateprediction.net | [http] [ID#95] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.16.5)
11/06/2020 18:27:55 | climateprediction.net | [http] [ID#95] Sent header to server: Accept: */*
11/06/2020 18:27:55 | climateprediction.net | [http] [ID#95] Sent header to server: Accept-Encoding: deflate, gzip
11/06/2020 18:27:55 | climateprediction.net | [http] [ID#95] Sent header to server: Accept-Language: en_GB
11/06/2020 18:27:55 | climateprediction.net | [http] [ID#95] Sent header to server: Content-Length: 311
11/06/2020 18:27:55 | climateprediction.net | [http] [ID#95] Sent header to server: Content-Type: application/x-www-form-urlencoded
11/06/2020 18:27:55 | climateprediction.net | [http] [ID#95] Sent header to server:
11/06/2020 18:27:55 | climateprediction.net |
11/06/2020 18:27:55 | climateprediction.net | [http] [ID#95] Info: We are completely uploaded and fine
11/06/2020 18:27:56 | climateprediction.net | [http] [ID#95] Received header from server: HTTP/1.1 200 OK
11/06/2020 18:27:56 | climateprediction.net | [http] [ID#95] Received header from server: Date: Thu, 11 Jun 2020 17:28:32 GMT
11/06/2020 18:27:56 | climateprediction.net | [http] [ID#95] Received header from server: Server: Apache/2.4.7 (Ubuntu)
11/06/2020 18:27:56 | climateprediction.net | [http] [ID#95] Received header from server: Vary: Accept-Encoding
11/06/2020 18:27:56 | climateprediction.net | [http] [ID#95] Received header from server: Content-Encoding: gzip
11/06/2020 18:27:56 | climateprediction.net | [http] [ID#95] Received header from server: Content-Length: 84
11/06/2020 18:27:56 | climateprediction.net | [http] [ID#95] Received header from server: Content-Type: text/plain
11/06/2020 18:27:56 | climateprediction.net | [http] [ID#95] Received header from server:
11/06/2020 18:27:56 | climateprediction.net |
11/06/2020 18:27:56 | climateprediction.net | [http] [ID#95] Info: Connection #27 to host upload4.cpdn.org left intact
11/06/2020 18:27:56 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Info: Found bundle for host upload4.cpdn.org: 0x24973a0 [can pipeline]
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Info: Re-using existing connection! (#27) with host upload4.cpdn.org
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Info: Connected to upload4.cpdn.org (144.6.252.28) port 80 (#27)
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Sent header to server: Host: upload4.cpdn.org
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.16.5)
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Sent header to server: Accept: */*
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Sent header to server: Accept-Encoding: deflate, gzip
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Sent header to server: Accept-Language: en_GB
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Sent header to server: Content-Length: 8738195
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Sent header to server: Content-Type: application/x-www-form-urlencoded
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Sent header to server: Expect: 100-continue
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Sent header to server:
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Sent header to server: 
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Received header from server: HTTP/1.1 100 Continue
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Info: HTTP 1.0, assume close after body
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Received header from server: HTTP/1.0 200 OK
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Received header from server: Server: ADSL Router
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Received header from server: Conten-Type:text/html
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Received header from server:
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Received header from server: <html><head><meta http-equiv="content-type" content="text/html;charset=ISO-8859-1"><title>Web Site Blocked</title><style type="text/css">A{text-decoration:none}</style><body bgcolor=black text=white><br><br><br><table border=0 width=100%><tr height=25><td bgcolor=red></td></tr><tr><td><br><center><H2>Web Site Blocked By NETGEAR Firewall</H2><br></td></tr><tr height=25><td bgcolor=red></td></tr></table><p align=right><a href=http://www.netgear.com><font color=white size=5><b>NETGEAR</head></html>
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Info: we are done reading and this is set to close, stop send
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Info: Closing connection 27
11/06/2020 18:27:58 | climateprediction.net | Temporarily failed upload of wah2_anz50_21gc_209412_32_871_012023722_0_r803778365_1.zip: transient upload error
11/06/2020 18:27:58 | climateprediction.net | Backing off 03:40:26 on upload of wah2_anz50_21gc_209412_32_871_012023722_0_r803778365_1.zip
ID: 62574 · Report as offensive     Reply Quote
lazlo_vii

Send message
Joined: 11 Dec 19
Posts: 108
Credit: 3,012,142
RAC: 0
Message 62575 - Posted: 11 Jun 2020, 20:25:29 UTC - in response to Message 62574.  

...
...
...
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Received header from server: <html><head><meta http-equiv="content-type" content="text/html;charset=ISO-8859-1"><title>Web Site Blocked</title><style type="text/css">A{text-decoration:none}</style><body bgcolor=black text=white><br><br><br><table border=0 width=100%><tr height=25><td bgcolor=red></td></tr><tr><td><br><center><H2>Web Site Blocked By NETGEAR Firewall</H2><br></td></tr><tr height=25><td bgcolor=red></td></tr></table><p align=right><a href=http://www.netgear.com><font color=white size=5><b>NETGEAR</head></html>
...


This is your problem. It looks like you have a NetGear home router between your PC and the internet that is blocking access to this site.
ID: 62575 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,026,382
RAC: 20,431
Message 62576 - Posted: 12 Jun 2020, 13:48:30 UTC

This is your problem. It looks like you have a NetGear home router between your PC and the internet that is blocking access to this site.


I think this bears a little more scrutiny.

uploads are sometimes failing, sometimes working. Below is an excerpt from the log file when failing.


Unless the router has some time based restrictions?
ID: 62576 · Report as offensive     Reply Quote
lazlo_vii

Send message
Joined: 11 Dec 19
Posts: 108
Credit: 3,012,142
RAC: 0
Message 62577 - Posted: 12 Jun 2020, 14:27:11 UTC - in response to Message 62576.  

Or if the router has some bugs in it's firmware. I don't know if NetGear ever released an official fix for it or not, but this issue is why my NetGear R6400 now runs a third party (DD-WRT) firmware.
ID: 62577 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,026,382
RAC: 20,431
Message 62578 - Posted: 12 Jun 2020, 18:14:01 UTC - in response to Message 62577.  

Or if the router has some bugs in it's firmware. I don't know if NetGear ever released an official fix for it or not, but this issue is why my NetGear R6400 now runs a third party (DD-WRT) firmware.


Yes, updating firmware can make a difference. When I got my current Asus router, it refused to upload tasks when connected via wireless to CPDN main site but uploading to testing site worked fine. Also worked fine if connected to router via cable. One day after applying a firmware update everything was sorted.
ID: 62578 · Report as offensive     Reply Quote
Home

Send message
Joined: 20 Dec 13
Posts: 4
Credit: 959,023
RAC: 887
Message 62579 - Posted: 12 Jun 2020, 19:33:19 UTC - in response to Message 62578.  

Or if the router has some bugs in it's firmware. I don't know if NetGear ever released an official fix for it or not, but this issue is why my NetGear R6400 now runs a third party (DD-WRT) firmware.


Yes, updating firmware can make a difference. When I got my current Asus router, it refused to upload tasks when connected via wireless to CPDN main site but uploading to testing site worked fine. Also worked fine if connected to router via cable. One day after applying a firmware update everything was sorted.


Hello,

to update.

The router has no rules to block uploads ( default with no rules is to allow outgoing traffic ), no time restrictions, and no available firmware upgrades

However, I did add a rule for the site allowing outgoing traffic. The backlog of updates was cleared. I then removed the rule, and so far today uploads have worked. But the problem is intermittent. Will update again if failures happen.

Thanks for the replies,
Ron.
ID: 62579 · Report as offensive     Reply Quote
lazlo_vii

Send message
Joined: 11 Dec 19
Posts: 108
Credit: 3,012,142
RAC: 0
Message 62580 - Posted: 12 Jun 2020, 21:17:54 UTC - in response to Message 62579.  
Last modified: 12 Jun 2020, 21:18:21 UTC

Or if the router has some bugs in it's firmware. I don't know if NetGear ever released an official fix for it or not, but this issue is why my NetGear R6400 now runs a third party (DD-WRT) firmware.


Yes, updating firmware can make a difference. When I got my current Asus router, it refused to upload tasks when connected via wireless to CPDN main site but uploading to testing site worked fine. Also worked fine if connected to router via cable. One day after applying a firmware update everything was sorted.


Hello,

to update.

The router has no rules to block uploads ( default with no rules is to allow outgoing traffic ), no time restrictions, and no available firmware upgrades

However, I did add a rule for the site allowing outgoing traffic. The backlog of updates was cleared. I then removed the rule, and so far today uploads have worked. But the problem is intermittent. Will update again if failures happen.

Thanks for the replies,
Ron.



I can say with almost 100% certainty that it will continue to be intermittent. A few years ago (I think it was in 2016) I beat my head against this and when I figured out what was going on I looked for official fixes from NetGear but didn't find any. They may have released newer firmware by now so your mileage may vary if you go looking for a fix.
ID: 62580 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4

Message boards : Number crunching : Uploading files fails

©2024 cpdn.org