climateprediction.net (CPDN) home page
Thread 'project back off'

Thread 'project back off'

Message boards : Number crunching : project back off
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
antkin

Send message
Joined: 18 Feb 20
Posts: 7
Credit: 25,949,462
RAC: 205,235
Message 64105 - Posted: 2 Jul 2021, 9:08:35 UTC

I have 2 PC's that both have downloading problems and display project back off on the 5 listed segments. These are running hours on end with no progress. Noticed the problem on Wednesday 30th still casing issues today. These PC's are running 24/7 and still it does not clear.
ID: 64105 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 64106 - Posted: 2 Jul 2021, 10:01:31 UTC - in response to Message 64105.  

I have 2 PC's that both have downloading problems and display project back off on the 5 listed segments. These are running hours on end with no progress. Noticed the problem on Wednesday 30th still casing issues today. These PC's are running 24/7 and still it does not clear.


Almost certainly connected with the maintenance work being done on the Oxford IT system on Wednesday. Might be worth suspending network activity using BOINC manager and or exiting BOINC and then starting it again. If that doesn't help, abort the tasks and then new ones should download normally. Richard reported similar problems in the thread adjacent to this one Downtime
ID: 64106 · Report as offensive     Reply Quote
aad

Send message
Joined: 4 Jan 06
Posts: 4
Credit: 133,864,295
RAC: 3,322
Message 64107 - Posted: 2 Jul 2021, 10:24:55 UTC
Last modified: 2 Jul 2021, 10:29:18 UTC

I have problems downloading too

vr 02 jul 2021 12:15:39 CEST | climateprediction.net | Started download of VOLC38_LR.gz
vr 02 jul 2021 12:15:40 CEST |  | Project communication failed: attempting access to reference site
vr 02 jul 2021 12:15:40 CEST | climateprediction.net | Temporarily failed download of VOLC38_LR.gz: transient HTTP error
vr 02 jul 2021 12:15:40 CEST | climateprediction.net | Backing off 02:04:16 on download of VOLC38_LR.gz
vr 02 jul 2021 12:15:41 CEST |  | Internet access OK - project servers may be temporarily down.
vr 02 jul 2021 12:15:47 CEST | climateprediction.net | update requested by user
vr 02 jul 2021 12:15:51 CEST | climateprediction.net | Sending scheduler request: Requested by user.
vr 02 jul 2021 12:15:51 CEST | climateprediction.net | Not requesting tasks: some download is stalled
vr 02 jul 2021 12:15:53 CEST | climateprediction.net | Scheduler request completed
vr 02 jul 2021 12:15:53 CEST | climateprediction.net | Project requested delay of 3636 seconds

ID: 64107 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 64108 - Posted: 2 Jul 2021, 13:10:00 UTC - in response to Message 64106.  

I have 2 PC's that both have downloading problems and display project back off on the 5 listed segments. These are running hours on end with no progress. Noticed the problem on Wednesday 30th still casing issues today. These PC's are running 24/7 and still it does not clear.



Almost certainly connected with the maintenance work being done on the Oxford IT system on Wednesday. Might be worth suspending network activity using BOINC manager and or exiting BOINC and then starting it again. If that doesn't help, abort the tasks and then new ones should download normally. Richard reported similar problems in the thread adjacent to this one


Me too. Part of Event Log:
Fri 02 Jul 2021 06:24:41 AM EDT |  | Internet access OK - project servers may be temporarily down.
Fri 02 Jul 2021 06:35:19 AM EDT | climateprediction.net | Started download of ic_N216_2003_05_000016.nc.gz
Fri 02 Jul 2021 06:35:19 AM EDT | climateprediction.net | Started download of so2dms_rcp45_N216_1999_2010.gz
Fri 02 Jul 2021 06:35:21 AM EDT |  | Project communication failed: attempting access to reference site
Fri 02 Jul 2021 06:35:21 AM EDT | climateprediction.net | Temporarily failed download of ic_N216_2003_05_000016.nc.gz: transient HTTP error
Fri 02 Jul 2021 06:35:21 AM EDT | climateprediction.net | Backing off 00:07:06 on download of ic_N216_2003_05_000016.nc.gz
Fri 02 Jul 2021 06:35:21 AM EDT | climateprediction.net | Temporarily failed download of so2dms_rcp45_N216_1999_2010.gz: transient HTTP error
Fri 02 Jul 2021 06:35:21 AM EDT | climateprediction.net | Backing off 00:04:40 on download of so2dms_rcp45_N216_1999_2010.gz
Fri 02 Jul 2021 06:35:23 AM EDT |  | Internet access OK - project servers may be temporarily down.
Fri 02 Jul 2021 07:27:03 AM EDT | climateprediction.net | Started download of ic_N216_2003_05_000016.nc.gz
Fri 02 Jul 2021 07:27:03 AM EDT | climateprediction.net | Started download of so2dms_rcp45_N216_1999_2010.gz
Fri 02 Jul 2021 07:27:05 AM EDT |  | Project communication failed: attempting access to reference site
Fri 02 Jul 2021 07:27:05 AM EDT | climateprediction.net | Temporarily failed download of ic_N216_2003_05_000016.nc.gz: transient HTTP error
Fri 02 Jul 2021 07:27:05 AM EDT | climateprediction.net | Backing off 00:12:45 on download of ic_N216_2003_05_000016.nc.gz
Fri 02 Jul 2021 07:27:05 AM EDT | climateprediction.net | Temporarily failed download of so2dms_rcp45_N216_1999_2010.gz: transient HTTP error
Fri 02 Jul 2021 07:27:05 AM EDT | climateprediction.net | Backing off 00:15:21 on download of so2dms_rcp45_N216_1999_2010.gz
Fri 02 Jul 2021 07:27:07 AM EDT |  | Internet access OK - project servers may be temporarily down.


When I look at Project Status, everything seems to be up.
Problem first noticed July 1. I aborted the two tasks that had downloaded some stuff, but got stuck for many many hours. I then went to bed, and got one task downloaded and two more stuck. I propose to wait and see today.
ID: 64108 · Report as offensive     Reply Quote
antkin

Send message
Joined: 18 Feb 20
Posts: 7
Credit: 25,949,462
RAC: 205,235
Message 64109 - Posted: 2 Jul 2021, 19:53:31 UTC

I have aborted the projects and restarted Boinc and the problem is still the same after attempting to download new work units
ID: 64109 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 64111 - Posted: 2 Jul 2021, 21:58:43 UTC

I sent an email, and received this reply:

*****************

Hi Les,

We have been having issues with the consistency of the large-scale storage we used, so I have now repointed the download directory to the files on another server.

Best wishes,

Andy

*****************

So now it's back to the magic word for this project: Patience.
(In Big Friendly Letters, as it said in the Hitch Hiker's Guide to the Galaxy.)
ID: 64111 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 64112 - Posted: 2 Jul 2021, 22:40:00 UTC - in response to Message 64111.  

Does not seem to have helped. I tried retrying one o those, but it failed as usual.

Fri 02 Jul 2021 06:30:29 PM EDT | climateprediction.net | Started download of ic_N216_2003_05_000016.nc.gz
Fri 02 Jul 2021 06:30:29 PM EDT | climateprediction.net | Started download of so2dms_rcp45_N216_1999_2010.gz
Fri 02 Jul 2021 06:30:31 PM EDT |  | Project communication failed: attempting access to reference site
Fri 02 Jul 2021 06:30:31 PM EDT | climateprediction.net | Temporarily failed download of ic_N216_2003_05_000016.nc.gz: transient HTTP error
Fri 02 Jul 2021 06:30:31 PM EDT | climateprediction.net | Backing off 01:34:28 on download of ic_N216_2003_05_000016.nc.gz
Fri 02 Jul 2021 06:30:31 PM EDT | climateprediction.net | Temporarily failed download of so2dms_rcp45_N216_1999_2010.gz: transient HTTP error
Fri 02 Jul 2021 06:30:31 PM EDT | climateprediction.net | Backing off 01:22:33 on download of so2dms_rcp45_N216_1999_2010.gz
Fri 02 Jul 2021 06:30:31 PM EDT | climateprediction.net | Started download of ozone_rcp45_N216L38_1999_2010v2.gz
Fri 02 Jul 2021 06:30:31 PM EDT | climateprediction.net | Started download of VOLC38_LR.gz
Fri 02 Jul 2021 06:30:33 PM EDT |  | Internet access OK - project servers may be temporarily down.
Fri 02 Jul 2021 06:30:33 PM EDT | climateprediction.net | Temporarily failed download of ozone_rcp45_N216L38_1999_2010v2.gz: transient HTTP error
Fri 02 Jul 2021 06:30:33 PM EDT | climateprediction.net | Backing off 00:06:18 on download of ozone_rcp45_N216L38_1999_2010v2.gz
Fri 02 Jul 2021 06:30:33 PM EDT | climateprediction.net | Temporarily failed download of VOLC38_LR.gz: transient HTTP error
Fri 02 Jul 2021 06:30:33 PM EDT | climateprediction.net | Backing off 00:05:45 on download of VOLC38_LR.gz

ID: 64112 · Report as offensive     Reply Quote
KAMasud

Send message
Joined: 6 Oct 06
Posts: 204
Credit: 7,608,986
RAC: 0
Message 64113 - Posted: 3 Jul 2021, 4:25:53 UTC

I have two WU's trying to download for the last 36 hours. Patience may be a virtue on CPDN but will these WU's fall into the void of some black hole or will we ever get them.
There are three WU's validation pending with zero credit from 2010? Those three also vanished into the void of Hyper- Internet(space). The Marvels and Mysteries of the Internet Age.
ID: 64113 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 64117 - Posted: 3 Jul 2021, 8:06:39 UTC - in response to Message 64113.  

Sorry, I meant that it's the weekend, and "everyone's gone fishing", so no more will get done until next week. :)
ID: 64117 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 64118 - Posted: 3 Jul 2021, 11:45:30 UTC
Last modified: 3 Jul 2021, 11:51:00 UTC

Another email has gone ready to be read and actioned on Monday.
Three tasks stuck in Download at the moment with just four files failing to download:

volc34LR.gz
HAPPI_1.5_ice_N216_2095-10-01_2096-0430.gz
HAPPI_1.5_sst_N216_2095-10-01_2096-0430.gz
ic_N216_2003_11_000042.nc.gz


However mine are failing with a tranient http error which implies the files are in the location they are now being looked for. I will try enabling http debug before trying the downloads again to see if there is any useful information.

Edit: The only line which looks like it may be relevant is

Sat 03 Jul 2021 12:48:08 BST |  | [http] [ID#0] Received header from server: p3p: CP="This is not a P3P policy! See g.co/p3phelp for more info."
ID: 64118 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 64119 - Posted: 3 Jul 2021, 12:50:18 UTC - in response to Message 64118.  

Here is the end of my Event log. I find it interesting that uploads seem to work OK.
Fri 02 Jul 2021 09:17:08 PM EDT | climateprediction.net | Sending scheduler request: To send trickle-up message.
Fri 02 Jul 2021 09:17:08 PM EDT | climateprediction.net | Not requesting tasks: some download is stalled
Fri 02 Jul 2021 09:17:10 PM EDT | climateprediction.net | Scheduler request completed
Fri 02 Jul 2021 09:17:10 PM EDT | climateprediction.net | Project requested delay of 3636 seconds
Fri 02 Jul 2021 09:17:39 PM EDT | climateprediction.net | Started upload of hadam4h_21c4_209905_5_903_012081191_3_r356604824_2.zip
Fri 02 Jul 2021 09:17:59 PM EDT | climateprediction.net | Finished upload of hadam4h_21c4_209905_5_903_012081191_3_r356604824_2.zip
Sat 03 Jul 2021 12:14:31 AM EDT | climateprediction.net | Started download of ic_N216_2003_05_000016.nc.gz
Sat 03 Jul 2021 12:14:31 AM EDT | climateprediction.net | Started download of so2dms_rcp45_N216_1999_2010.gz
Sat 03 Jul 2021 12:14:34 AM EDT |  | Project communication failed: attempting access to reference site
Sat 03 Jul 2021 12:14:34 AM EDT | climateprediction.net | Temporarily failed download of ic_N216_2003_05_000016.nc.gz: transient HTTP error
Sat 03 Jul 2021 12:14:34 AM EDT | climateprediction.net | Backing off 05:05:30 on download of ic_N216_2003_05_000016.nc.gz
Sat 03 Jul 2021 12:14:34 AM EDT | climateprediction.net | Temporarily failed download of so2dms_rcp45_N216_1999_2010.gz: transient HTTP error
Sat 03 Jul 2021 12:14:34 AM EDT | climateprediction.net | Backing off 05:40:55 on download of so2dms_rcp45_N216_1999_2010.gz
Sat 03 Jul 2021 12:14:36 AM EDT |  | Internet access OK - project servers may be temporarily down.
Sat 03 Jul 2021 05:10:31 AM EDT | climateprediction.net | Started download of ozone_rcp45_N216L38_1999_2010v2.gz
Sat 03 Jul 2021 05:10:31 AM EDT | climateprediction.net | Started download of VOLC38_LR.gz
Sat 03 Jul 2021 05:10:33 AM EDT |  | Project communication failed: attempting access to reference site
Sat 03 Jul 2021 05:10:33 AM EDT | climateprediction.net | Temporarily failed download of ozone_rcp45_N216L38_1999_2010v2.gz: transient HTTP error
Sat 03 Jul 2021 05:10:33 AM EDT | climateprediction.net | Backing off 00:22:20 on download of ozone_rcp45_N216L38_1999_2010v2.gz
Sat 03 Jul 2021 05:10:33 AM EDT | climateprediction.net | Temporarily failed download of VOLC38_LR.gz: transient HTTP error
Sat 03 Jul 2021 05:10:33 AM EDT | climateprediction.net | Backing off 00:23:06 on download of VOLC38_LR.gz
Sat 03 Jul 2021 05:10:35 AM EDT |  | Internet access OK - project servers may be temporarily down.

ID: 64119 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 64120 - Posted: 3 Jul 2021, 14:17:07 UTC

Here is the end of my Event log. I find it interesting that uploads seem to work OK.


Uploads go to a different server so that isn't any great surprise.
ID: 64120 · Report as offensive     Reply Quote
antkin

Send message
Joined: 18 Feb 20
Posts: 7
Credit: 25,949,462
RAC: 205,235
Message 64121 - Posted: 3 Jul 2021, 17:01:26 UTC

VOLC38_LR.gz
this file is repeatedly not downloading and this is becoming a real pain.
50% of my downloads on CPN are having to be aborted manually.
ID: 64121 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 64122 - Posted: 3 Jul 2021, 18:11:20 UTC - in response to Message 64121.  

VOLC38_LR.gz
this file is repeatedly not downloading and this is becoming a real pain.
50% of my downloads on CPN are having to be aborted manually.


No point in downloading more till this is fixed. I am waiting till Monday when I expect Andy to sort this out. If you abort tasks better to set project to no new tasks as the failed download counts as one of the five strikes before tasks are aborted.
ID: 64122 · Report as offensive     Reply Quote
KAMasud

Send message
Joined: 6 Oct 06
Posts: 204
Credit: 7,608,986
RAC: 0
Message 64124 - Posted: 3 Jul 2021, 19:42:15 UTC - in response to Message 64118.  

Another email has gone ready to be read and actioned on Monday.
Three tasks stuck in Download at the moment with just four files failing to download:

volc34LR.gz
HAPPI_1.5_ice_N216_2095-10-01_2096-0430.gz
HAPPI_1.5_sst_N216_2095-10-01_2096-0430.gz
ic_N216_2003_11_000042.nc.gz


However mine are failing with a tranient http error which implies the files are in the location they are now being looked for. I will try enabling http debug before trying the downloads again to see if there is any useful information.

Edit: The only line which looks like it may be relevant is

Sat 03 Jul 2021 12:48:08 BST |  | [http] [ID#0] Received header from server: p3p: CP="This is not a P3P policy! See g.co/p3phelp for more info."

_________________
I am having the same problem. Four files failing to download. The rest have been downloaded.
ID: 64124 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 64130 - Posted: 5 Jul 2021, 17:32:34 UTC
Last modified: 5 Jul 2021, 19:08:41 UTC

The four files that were stuck on my system have now downloaded. So it looks like the problem has been resolved.

Edit: Since posting I looked at Andy's email telling me he had found the problem, sorted it and tested downloads were working.
ID: 64130 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 64131 - Posted: 5 Jul 2021, 17:36:26 UTC - in response to Message 64130.  

The four files that were stuck on my system have now downloaded. So it looks like the problem has been resolved.


The eight iles that were stuck on my system have now downloaded. So it looks like the problem has been resolved.
ID: 64131 · Report as offensive     Reply Quote
antkin

Send message
Joined: 18 Feb 20
Posts: 7
Credit: 25,949,462
RAC: 205,235
Message 64132 - Posted: 5 Jul 2021, 19:21:05 UTC

Back to normal files downloading. Thanks everybody.
ID: 64132 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,716,561
RAC: 8,355
Message 64133 - Posted: 6 Jul 2021, 7:34:43 UTC

Yes, I had three successful downloads this morning.
ID: 64133 · Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 15 Jul 17
Posts: 99
Credit: 18,701,746
RAC: 318
Message 64438 - Posted: 9 Sep 2021, 7:52:47 UTC

And history repeats.
ID: 64438 · Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : project back off

©2024 cpdn.org