Boinc trying to connect to cpdn gives "request failed HTTP internal server error"

Boinc trying to connect to cpdn gives "request failed HTTP internal server error"

I am just getting the normal "No tasks available" message.

Boinc trying to connect to cpdn gives "request failed HTTP internal server error"

I am just getting the normal "No tasks available" message.

Same "no Tasks available"

Weird. All my PCs give the same message, both Linux and Windows. No problems connecting to and requesting work from the development site (although none available of course).

As little as 10 days ago, there were no errors when requesting work from cpdn.

Boinc trying to connect to cpdn gives "request failed HTTP internal server error"

I have the same error when validating completed tasks.
No credit validated for 4 days.

Kali.

Weird. All my PCs give the same message, both Linux and Windows. No problems connecting to and requesting work from the development site (although none available of course).

As little as 10 days ago, there were no errors when requesting work from cpdn.

Just fired up the VM. I am getting the normal "No tasks available" message on Windows as well as on Linux.
Edit:Boinc8.0.4 Windows, 8.1.0 Linux.

hmm... this thread seems to have drifted off the 'new work announcements' thread.

There have been significant internet outage recently in the UK in multiple regions (including Oxford). It's ploughing season... there's probably info online.

As soon as Sarah finds the XML I'm sending the NZ25 batch out.

---

---
CPDN Visiting Scientist

I'm getting a download failed with these WUs. Windows 11 Boinc 8.0.2

15714 climateprediction.net 10/30/2024 3:41:53 PM Scheduler request completed: got 4 new tasks
15715 climateprediction.net 10/30/2024 3:41:53 PM Project requested delay of 3636 seconds
15716 climateprediction.net 10/30/2024 3:41:55 PM Started download of wah2_8.24_windows_intelx86.exe
15717 climateprediction.net 10/30/2024 3:41:55 PM Started download of wah2_data_8.24_windows_intelx86.zip
15718 climateprediction.net 10/30/2024 3:41:57 PM Giving up on download of wah2_8.24_windows_intelx86.exe: permanent HTTP error
15719 climateprediction.net 10/30/2024 3:41:57 PM Giving up on download of wah2_data_8.24_windows_intelx86.zip: permanent HTTP error
15720 climateprediction.net 10/30/2024 3:41:57 PM Started download of wah2_se_8.24_windows_intelx86.zip
15721 climateprediction.net 10/30/2024 3:41:57 PM Started download of wah2am3m2_um_8.24_windows_intelx86.zip
15722 climateprediction.net 10/30/2024 3:41:58 PM Giving up on download of wah2_se_8.24_windows_intelx86.zip: permanent HTTP error
15723 climateprediction.net 10/30/2024 3:41:58 PM Giving up on download of wah2am3m2_um_8.24_windows_intelx86.zip: permanent HTTP error
15724 climateprediction.net 10/30/2024 3:41:58 PM Started download of wah2rm3m2t_um_8.24_windows_intelx86.zip
15725 climateprediction.net 10/30/2024 3:41:58 PM Started download of wah2_nz25_10er_209105_25_1028_012344458.zip
15726 climateprediction.net 10/30/2024 3:41:59 PM Giving up on download of wah2rm3m2t_um_8.24_windows_intelx86.zip: permanent HTTP error

Same here.

I'm getting a download failed with these WUs. Windows 11 Boinc 8.0.2

15714 climateprediction.net 10/30/2024 3:41:53 PM Scheduler request completed: got 4 new tasks
15715 climateprediction.net 10/30/2024 3:41:53 PM Project requested delay of 3636 seconds
15716 climateprediction.net 10/30/2024 3:41:55 PM Started download of wah2_8.24_windows_intelx86.exe
15717 climateprediction.net 10/30/2024 3:41:55 PM Started download of wah2_data_8.24_windows_intelx86.zip
15718 climateprediction.net 10/30/2024 3:41:57 PM Giving up on download of wah2_8.24_windows_intelx86.exe: permanent HTTP error
15719 climateprediction.net 10/30/2024 3:41:57 PM Giving up on download of wah2_data_8.24_windows_intelx86.zip: permanent HTTP error

Yes, I saw a lot of download errors in the logs late last night. I have just connected a new 8.0.2 client and successfully downloaded a task.

Are you still having download problems? Might just have been temporary.

---

---
CPDN Visiting Scientist

I was just checking and yes some tasks have downloaded successfully.
At least 1 client has completed its quota of 2 tasks today so can't get more tasks to work on yet !

Here in Luxembourg, all OK

31/10/2024 10:07:16 | climateprediction.net | Scheduler request completed: got 6 new tasks
31/10/2024 10:07:16 | climateprediction.net | Project requested delay of 3636 seconds
31/10/2024 10:07:18 | climateprediction.net | Started download of wah2_nz25_11bf_209405_25_1028_012345634.zip
31/10/2024 10:07:18 | climateprediction.net | Started download of generic_phase1_spinup_nz25_global_faaaca_0.gz
31/10/2024 10:07:19 | climateprediction.net | Finished download of wah2_nz25_11bf_209405_25_1028_012345634.zip (17124 bytes)
31/10/2024 10:07:19 | climateprediction.net | Started download of generic_phase1_spinup_nz25_regional_faaaca_0.gz
31/10/2024 10:07:20 | climateprediction.net | Finished download of generic_phase1_spinup_nz25_global_faaaca_0.gz (29926082 bytes)
31/10/2024 10:07:20 | climateprediction.net | Started download of ic19610311_14_N96.gz
31/10/2024 10:07:21 | climateprediction.net | Finished download of generic_phase1_spinup_nz25_regional_faaaca_0.gz (45316285 bytes)
31/10/2024 10:07:21 | climateprediction.net | Finished download of ic19610311_14_N96.gz (1314153 bytes)
31/10/2024 10:07:21 | climateprediction.net | Started download of HAPPI15C_ancil_146months_OSTIA_sst_MMM_2088-12-01_2101-01-30.gz
31/10/2024 10:07:21 | climateprediction.net | Started download of HAPPI_15k_SIC_208912_210111.gz
31/10/2024 10:07:22 | climateprediction.net | Finished download of HAPPI_15k_SIC_208912_210111.gz (15403151 bytes)
31/10/2024 10:07:22 | climateprediction.net | Started download of so2dms_rcp26_N96_2089_2100.gz
31/10/2024 10:07:24 | climateprediction.net | Finished download of HAPPI15C_ancil_146months_OSTIA_sst_MMM_2088-12-01_2101-01-30.gz (48005111 bytes)
31/10/2024 10:07:24 | climateprediction.net | Finished download of so2dms_rcp26_N96_2089_2100.gz (26235530 bytes)
31/10/2024 10:07:24 | climateprediction.net | Started download of oxi.addfa.gz
31/10/2024 10:07:24 | climateprediction.net | Started download of ozone_rcp26_N96_2089_2100v2.gz
31/10/2024 10:07:25 | climateprediction.net | Finished download of ozone_rcp26_N96_2089_2100v2.gz (1415721 bytes)
31/10/2024 10:07:25 | climateprediction.net | Started download of wah2_nz25_10qy_209205_25_1028_012344897.zip
31/10/2024 10:07:27 | climateprediction.net | Finished download of wah2_nz25_10qy_209205_25_1028_012344897.zip (17094 bytes)
31/10/2024 10:07:27 | climateprediction.net | Started download of ic19610627_12_N96.gz
31/10/2024 10:07:28 | climateprediction.net | Finished download of ic19610627_12_N96.gz (1312403 bytes)
31/10/2024 10:07:28 | climateprediction.net | Started download of wah2_nz25_104l_209005_25_1028_012344092.zip
31/10/2024 10:07:29 | climateprediction.net | Finished download of oxi.addfa.gz (82651774 bytes)
31/10/2024 10:07:29 | climateprediction.net | Finished download of wah2_nz25_104l_209005_25_1028_012344092.zip (17501 bytes)
31/10/2024 10:07:29 | climateprediction.net | Started download of ic19610820_14_N96.gz
31/10/2024 10:07:29 | climateprediction.net | Started download of wah2_nz25_101d_209005_25_1028_012343976.zip
31/10/2024 10:07:30 | climateprediction.net | Finished download of ic19610820_14_N96.gz (1313070 bytes)
31/10/2024 10:07:30 | climateprediction.net | Finished download of wah2_nz25_101d_209005_25_1028_012343976.zip (17501 bytes)
31/10/2024 10:07:30 | climateprediction.net | Started download of ic19611104_16_N96.gz
31/10/2024 10:07:30 | climateprediction.net | Started download of wah2_nz25_122z_209705_25_1028_012346626.zip
31/10/2024 10:07:30 | climateprediction.net | Starting task wah2_nz25_10qy_209205_25_1028_012344897_1
31/10/2024 10:07:30 | climateprediction.net | Starting task wah2_nz25_11bf_209405_25_1028_012345634_1
31/10/2024 10:07:30 | climateprediction.net | Starting task wah2_nz25_104l_209005_25_1028_012344092_1
31/10/2024 10:07:31 | climateprediction.net | Finished download of ic19611104_16_N96.gz (1309372 bytes)
31/10/2024 10:07:31 | climateprediction.net | Finished download of wah2_nz25_122z_209705_25_1028_012346626.zip (17108 bytes)
31/10/2024 10:07:31 | climateprediction.net | Started download of ic19610108_12_N96.gz
31/10/2024 10:07:31 | climateprediction.net | Started download of wah2_nz25_11md_209605_25_1028_012346028.zip
31/10/2024 10:07:32 | climateprediction.net | Starting task wah2_nz25_101d_209005_25_1028_012343976_1
31/10/2024 10:07:33 | climateprediction.net | Finished download of ic19610108_12_N96.gz (1312640 bytes)
31/10/2024 10:07:33 | climateprediction.net | Finished download of wah2_nz25_11md_209605_25_1028_012346028.zip (17115 bytes)
31/10/2024 10:07:33 | climateprediction.net | Started download of ic19611205_16_N96.gz
31/10/2024 10:07:33 | climateprediction.net | Starting task wah2_nz25_122z_209705_25_1028_012346626_1
31/10/2024 10:07:34 | climateprediction.net | Finished download of ic19611205_16_N96.gz (1310676 bytes)
31/10/2024 10:07:34 | climateprediction.net | Starting task wah2_nz25_11md_209605_25_1028_012346028_1

---

Yes, I saw a lot of download errors in the logs late last night. I have just connected a new 8.0.2 client and successfully downloaded a task.

This is going to be a complicated one, and I may be barking up the wrong tree - handle with caution - bit here goes.

The download errors are all for application files, not model data. Applications are only downloaded once, when a new version is released.

Yesterday, I noticed the word 'cloudflare' in Glenn's opening log post in the 'clients can't connect' thread. They both occur just after a HTTP/2 error code - 308 in the first case, 500 in the second.

As I understand it, cloudflare provides a transparent caching service, which helps projects' bandwidth greatly when multiple copies of the same file have to be downloaded in a short time period - exactly the situation with a new application release. Could the two symptoms be related?

Things are getting messy here: some machines are running dev test tasks, some have picked up batch 2020 timeout/resends, some are locked on a daily quota of 1, and some have downloaded batch 2028 data and apps and are working on them. But I'll try and find a machine to reproduce the app download error on, and generate a debug log.

There are no new application versions, the hosts already had the existing applications, there was no need to download them !

How long have they been using cloudfare ?

Anyone who has attached a new machine recently, or who got caught up in the master file address switcheroo, will need a fresh copy of this particular app version.

The download errors are all for application files, not model data.

Richard, that's not correct. If you refer back to TLD's earlier post the log shows that it had problems downloading the wah2_*_data*.zip file too. This batch uses the 8.24 WaH app, which has not been changed for years. A URL change, or disconnect/reconnect to CPDN would trigger the app download.

Whatever the problem was it seems to have gone away. I've been looking at the database this morning. Of 3150 workunits sent out, we've had 48 tasks fail, 90% of those due to download issues. There are currently 2400 running workunits.

---

---
CPDN Visiting Scientist

It hasn't completely gone. I've just fired up the little Windows 10 Celeron, and deliberately downgraded it to BOINC v7.16.20

The debug log ends:

31/10/2024 11:02:09 | climateprediction.net | [http] [ID#1] Info:  We are completely uploaded and fine
31/10/2024 11:02:09 | climateprediction.net | [http] [ID#1] Received header from server: HTTP/1.1 500 Internal Server Error
31/10/2024 11:02:09 | climateprediction.net | [http] [ID#1] Received header from server: Date: Thu, 31 Oct 2024 11:02:26 GMT
31/10/2024 11:02:09 | climateprediction.net | [http] [ID#1] Received header from server: Content-Length: 0
31/10/2024 11:02:09 | climateprediction.net | [http] [ID#1] Received header from server: Connection: keep-alive
31/10/2024 11:02:09 | climateprediction.net | [http] [ID#1] Received header from server: CF-Ray: 8db3271fcdd7bd7f-LHR
31/10/2024 11:02:09 | climateprediction.net | [http] [ID#1] Received header from server: CF-Cache-Status: DYNAMIC
31/10/2024 11:02:09 | climateprediction.net | [http] [ID#1] Received header from server: x-powered-by: ASP.NET
31/10/2024 11:02:09 | climateprediction.net | [http] [ID#1] Received header from server: Vary: Accept-Encoding
31/10/2024 11:02:09 | climateprediction.net | [http] [ID#1] Received header from server: Server: cloudflare
31/10/2024 11:02:09 | climateprediction.net | [http] [ID#1] Received header from server: alt-svc: h3=":443"; ma=86400
31/10/2024 11:02:09 | climateprediction.net | [http] [ID#1] Received header from server:
31/10/2024 11:02:09 | climateprediction.net | [http] [ID#1] Info:  Connection #13 to host cpdn.org left intact
31/10/2024 11:02:10 | climateprediction.net | Scheduler request failed: HTTP internal server error

I'll upgrade it incrementally, to try and work out when it starts working again.

It hasn't completely gone. I've just fired up the little Windows 10 Celeron, and deliberately downgraded it to BOINC v7.16.20

And with 8.0.4 I just had four tasks fail because some of the files didn't download. When project backoff allows if there are any left, I will try again with http-debug enabled.

I'll upgrade it incrementally, to try and work out when it starts working again.

7.22.2 (x86) fails to connect.
Do we want to move it out of this thread ?

New thread to clear the announcement thread.