Message boards : Number crunching : Download errors: Permanent HTTP error (PNW)
Message board moderation
Author | Message |
---|---|
Send message Joined: 28 Mar 09 Posts: 126 Credit: 9,825,980 RAC: 0 |
Got the following happening on one rig: 29/07/2012 9:27:26 PM | climateprediction.net | Started download of hadam3p_pnw_bkyu_1975_1_008108679.zip Looks to me like the file isn't available for some reason or an incorrect file name/path BOINC blog |
Send message Joined: 5 Aug 04 Posts: 1283 Credit: 15,824,334 RAC: 0 |
Looks to me like the file isn't available for some reason or an incorrect file name/path The files for a batch of work were missing from the download server. Andy thinks he's dealt with (i.e. deleted) all of the affected workunits. "The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer |
Send message Joined: 28 Mar 09 Posts: 126 Credit: 9,825,980 RAC: 0 |
Another one... 7/08/2012 9:56:20 PM | climateprediction.net | Started download of atmos_byeb_1980_1_008106649_0.gz 7/08/2012 9:56:22 PM | climateprediction.net | Giving up on download of hadam3p_pnw_byeb_1980_1_008106649.zip: permanent HTTP error 7/08/2012 9:56:22 PM | climateprediction.net | Giving up on download of atmos_byeb_1980_1_008106649_0.gz: permanent HTTP error 7/08/2012 9:56:23 PM | climateprediction.net | Giving up on download of pnw_byeb_1980_1_008106649_0.gz: permanent HTTP error Link to task here I am the 3rd person to get it. The 1st one crashed with the replanca error and the 2nd with Regional yearly means requires 12 input files got 0 So its a dud one anyway, probably no point worrying about it BOINC blog |
Send message Joined: 28 Mar 09 Posts: 126 Credit: 9,825,980 RAC: 0 |
And another one that failed to download...
Actually aren't all the hadam3p_pnw_b... work units the old (dud) ones? In which case we already know about them BOINC blog |
Send message Joined: 5 Aug 04 Posts: 1496 Credit: 95,522,203 RAC: 0 |
Three download files, like those reported above, produce similar HTTP errors in the new PNW batch. EDIT: Jonathan notified by PM. "We have met the enemy and he is us." -- Pogo Greetings from coastal Washington state, the scenic US Pacific Northwest. |
Send message Joined: 15 Jan 11 Posts: 175 Credit: 6,242,691 RAC: 699 |
I got a string of the following error messages yesterday after allowing new tasks. I eventually aborted the downloads and stopped getting new tasks. Temporarily failed download of hadam3p_eu_6e9h_2008_1_008222710.zip: HTTP error Backing off 1 min 0 sec on download of hadam3p_eu_6e9h_2008_1_008222710.zip Temporarily failed download of atmos_6e9h_2008_1_008222710_0.gz: HTTP error Backing off 1 min 0 sec on download of atmos_6e9h_2008_1_008222710_0.gz Is there any connection with this problem and 'Permanent HTTP error' or is it something different. I couldn't find any postings regarding this precise situation.. |
Send message Joined: 5 Aug 04 Posts: 1283 Credit: 15,824,334 RAC: 0 |
Is there any connection with this problem and 'Permanent HTTP error' or is it something different. There's no connection Dave. The 'Temporarily failed download' message indicates there was no response from the download server. Having said that, the workunit for your task (hadam3p_eu_6e9h_2008_1_008222710) is a bit strange:
"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer |
Send message Joined: 1 Mar 12 Posts: 1 Credit: 1,247,658 RAC: 0 |
I'm getting very similar errors: Mon 08 Oct 2012 04:14:53 PM BST | climateprediction.net | Started download of hadam3p_eu_6.09_i686-pc-linux-gnu Mon 08 Oct 2012 04:14:53 PM BST | climateprediction.net | Started download of hadam3p_eu_um_6.09_i686-pc-linux-gnu.zip Mon 08 Oct 2012 04:14:56 PM BST | climateprediction.net | Giving up on download of hadam3p_eu_6.09_i686-pc-linux-gnu: permanent HTTP error Mon 08 Oct 2012 04:14:56 PM BST | climateprediction.net | Giving up on download of hadam3p_eu_um_6.09_i686-pc-linux-gnu.zip: permanent HTTP error Mon 08 Oct 2012 04:14:56 PM BST | climateprediction.net | Started download of hadrm3p_eu_um_6.09_i686-pc-linux-gnu.zip Mon 08 Oct 2012 04:14:56 PM BST | climateprediction.net | Started download of hadam3p_eu_graphics_6.09_i686-pc-linux-gnu Mon 08 Oct 2012 04:14:57 PM BST | climateprediction.net | Giving up on download of hadrm3p_eu_um_6.09_i686-pc-linux-gnu.zip: permanent HTTP error Mon 08 Oct 2012 04:14:57 PM BST | climateprediction.net | Giving up on download of hadam3p_eu_graphics_6.09_i686-pc-linux-gnu: permanent HTTP error Mon 08 Oct 2012 04:14:57 PM BST | climateprediction.net | Started download of hadam3p_eu_data_6.09_i686-pc-linux-gnu.zip Mon 08 Oct 2012 04:14:57 PM BST | climateprediction.net | Started download of hadam3p_eu_se_6.09_i686-pc-linux-gnu.zip Mon 08 Oct 2012 04:14:58 PM BST | climateprediction.net | Giving up on download of hadam3p_eu_data_6.09_i686-pc-linux-gnu.zip: permanent HTTP error Mon 08 Oct 2012 04:14:58 PM BST | climateprediction.net | Giving up on download of hadam3p_eu_se_6.09_i686-pc-linux-gnu.zip: permanent HTTP error Mon 08 Oct 2012 04:14:58 PM BST | climateprediction.net | Started download of hadam3p_eu_2u3d_1982_1_008223305.zip Mon 08 Oct 2012 04:14:58 PM BST | climateprediction.net | Started download of atmos_2u3d_1982_1_008223305_0.gz Mon 08 Oct 2012 04:15:00 PM BST | climateprediction.net | Giving up on download of hadam3p_eu_2u3d_1982_1_008223305.zip: permanent HTTP error Mon 08 Oct 2012 04:15:00 PM BST | climateprediction.net | Giving up on download of atmos_2u3d_1982_1_008223305_0.gz: permanent HTTP error Mon 08 Oct 2012 04:15:00 PM BST | climateprediction.net | Started download of eu_2u3d_1982_1_008223305_0.gz Mon 08 Oct 2012 04:15:00 PM BST | climateprediction.net | Started download of HadISST_SST_N96_1982_12_1985_01f.gz Mon 08 Oct 2012 04:15:02 PM BST | climateprediction.net | Giving up on download of eu_2u3d_1982_1_008223305_0.gz: permanent HTTP error Mon 08 Oct 2012 04:15:02 PM BST | climateprediction.net | Started download of HadISST_SI_N96_1982_12_1985_01f.gz Mon 08 Oct 2012 04:15:17 PM BST | climateprediction.net | Finished download of HadISST_SI_N96_1982_12_1985_01f.gz Mon 08 Oct 2012 04:15:17 PM BST | climateprediction.net | Started download of so2dms_N96_1982_12_1985_02.gz Mon 08 Oct 2012 04:15:25 PM BST | climateprediction.net | Finished download of HadISST_SST_N96_1982_12_1985_01f.gz Mon 08 Oct 2012 04:15:28 PM BST | climateprediction.net | Finished download of so2dms_N96_1982_12_1985_02.gz Any ideas? |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
|
Send message Joined: 30 Jul 07 Posts: 2 Credit: 4,164,420 RAC: 0 |
Here we have 20th October and this problem still occurs even after re-attach to the project. |
Send message Joined: 29 Sep 04 Posts: 2363 Credit: 14,611,758 RAC: 0 |
Many members are having download problems, usually just certain files from each model, not all the files. I have three EU files stuck in Transfers trying to download. We're seeing all sorts of error messages: HTTP errors, transient HTTP errors, permanent HTTP errors and more. The problem must be with the server but as it's the weekend the programmers aren't there to fix what's wrong. At the moment please don't abort models or reset the project or press the Update button in BOINC manager as these actions cannot fix a problem that lies in the server(?). We just have to be patient. If your computer needs work because it can't get CPDN models at the moment, attach to another project. Einstein and Simap have tasks and there are lots of other good projects. We will post in the News and Announcements thread at the top of Number Crunching when we know more. Cpdn news |
Send message Joined: 16 May 07 Posts: 10 Credit: 2,368,487 RAC: 0 |
At the moment please don't abort models or reset the project or press the Update button in BOINC manager as these actions cannot fix a problem that lies in the server(?). We just have to be patient. I didn't abort but Boinc 7.0.28 did. It tried from the 16th (hadam3p_eu_61d8_2002_1_008225846_0 - Workunit: 8380970) & today( 22nd) gave up. Boinc should be patient not we. :) 21/10/2012 22:33:10 | climateprediction.net | Started download of hadam3p_eu_61d8_2002_1_008225846.zip 21/10/2012 22:33:10 | climateprediction.net | Started download of atmos_61d8_2002_1_008225846_0.gz 21/10/2012 22:33:15 | climateprediction.net | Temporarily failed download of hadam3p_eu_61d8_2002_1_008225846.zip: transient HTTP error 21/10/2012 22:33:15 | climateprediction.net | Backing off 4 hr 8 min 31 sec on download of hadam3p_eu_61d8_2002_1_008225846.zip 21/10/2012 22:33:15 | climateprediction.net | Temporarily failed download of atmos_61d8_2002_1_008225846_0.gz: transient HTTP error 21/10/2012 22:33:15 | climateprediction.net | Backing off 5 hr 15 min 10 sec on download of atmos_61d8_2002_1_008225846_0.gz 21/10/2012 22:33:17 | climateprediction.net | Started download of eu_61d8_2002_1_008225846_0.gz 21/10/2012 22:33:18 | climateprediction.net | Temporarily failed download of eu_61d8_2002_1_008225846_0.gz: transient HTTP error 21/10/2012 22:33:18 | climateprediction.net | Backing off 3 hr 24 min 6 sec on download of eu_61d8_2002_1_008225846_0.gz 22/10/2012 01:57:25 | climateprediction.net | Started download of eu_61d8_2002_1_008225846_0.gz 22/10/2012 01:57:27 | climateprediction.net | Temporarily failed download of eu_61d8_2002_1_008225846_0.gz: transient HTTP error 22/10/2012 01:57:27 | climateprediction.net | Backing off 4 hr 26 min 28 sec on download of eu_61d8_2002_1_008225846_0.gz 22/10/2012 02:41:47 | climateprediction.net | Started download of hadam3p_eu_61d8_2002_1_008225846.zip 22/10/2012 02:41:49 | climateprediction.net | Temporarily failed download of hadam3p_eu_61d8_2002_1_008225846.zip: transient HTTP error 22/10/2012 02:41:49 | climateprediction.net | Backing off 4 hr 23 min 27 sec on download of hadam3p_eu_61d8_2002_1_008225846.zip 22/10/2012 03:48:27 | climateprediction.net | Started download of atmos_61d8_2002_1_008225846_0.gz 22/10/2012 03:48:29 | climateprediction.net | Temporarily failed download of atmos_61d8_2002_1_008225846_0.gz: transient HTTP error 22/10/2012 03:48:29 | climateprediction.net | Backing off 3 hr 3 min 37 sec on download of atmos_61d8_2002_1_008225846_0.gz 22/10/2012 06:23:56 | climateprediction.net | Started download of eu_61d8_2002_1_008225846_0.gz 22/10/2012 06:23:58 | climateprediction.net | Temporarily failed download of eu_61d8_2002_1_008225846_0.gz: transient HTTP error 22/10/2012 06:23:58 | climateprediction.net | Backing off 5 hr 11 min 55 sec on download of eu_61d8_2002_1_008225846_0.gz 22/10/2012 09:50:44 | climateprediction.net | Started download of hadam3p_eu_61d8_2002_1_008225846.zip 22/10/2012 09:50:44 | climateprediction.net | Started download of atmos_61d8_2002_1_008225846_0.gz 22/10/2012 09:50:45 | climateprediction.net | Temporarily failed download of hadam3p_eu_61d8_2002_1_008225846.zip: transient HTTP error 22/10/2012 09:50:45 | climateprediction.net | Backing off 4 hr 24 min 24 sec on download of hadam3p_eu_61d8_2002_1_008225846.zip 22/10/2012 09:50:45 | climateprediction.net | Temporarily failed download of atmos_61d8_2002_1_008225846_0.gz: transient HTTP error 22/10/2012 09:50:45 | climateprediction.net | Backing off 5 hr 38 min 52 sec on download of atmos_61d8_2002_1_008225846_0.gz 22/10/2012 14:19:58 | climateprediction.net | Started download of hadam3p_eu_61d8_2002_1_008225846.zip 22/10/2012 14:19:58 | climateprediction.net | Started download of eu_61d8_2002_1_008225846_0.gz 22/10/2012 14:20:01 | climateprediction.net | Giving up on download of hadam3p_eu_61d8_2002_1_008225846.zip: permanent HTTP error 22/10/2012 14:20:01 | climateprediction.net | Giving up on download of eu_61d8_2002_1_008225846_0.gz: permanent HTTP error 22/10/2012 14:21:57 | climateprediction.net | Sending scheduler request: To report completed tasks. 22/10/2012 14:21:57 | climateprediction.net | Reporting 1 completed tasks, not requesting new tasks 22/10/2012 14:22:02 | climateprediction.net | Scheduler request completed Any ideas on how to prevent this from happening again? |
Send message Joined: 15 Jan 11 Posts: 175 Credit: 6,242,691 RAC: 699 |
I might be wrong but isn't a reasonable solution to suspend the project and wait until server problems are sorted out. That way, network activity isn't affected on other projects. I did that a while ago when there were similar problems. I checked each day to see if it was worth a try. Worked for me and stopped possible loss of results. We can't get any more work at the moment anyway. |
Send message Joined: 16 May 07 Posts: 10 Credit: 2,368,487 RAC: 0 |
I might be wrong but isn't a reasonable solution to suspend the project and wait until server problems are sorted out. That way, network activity isn't affected on other projects. As you probably know what is in the transfers tab is not affected by the projects suspended on the projects tab or only that particular WU suspended. In the previous problem with the server running out of disk space, I had both the WUs and the project itself suspended and no new work but the uploads did try to upload. There is no pause/stop button in the transfers tab unfortunately, only abort & retry now. My point was to show the CPDN people a new twist for the problems they have with the server. And mo.v wrote before my post to not abort the models. That particular model had started to download on the 16th when only the uploads were affected, not the downloads and it kept trying for 6 days when Boinc decided to abort the WU this morning (22nd) because of too many download errors & retries. The first file of that model (starting with atmos in the file name) was around 36 KB and the other two were between 12MB to 15 MB. None of the model's needed 3 files were able to download, so the model didn't start yet. It wasn't a case for suspending a particular WU so not to produce more files which wouldn't upload. It was a case for not being able to download the complete model. |
Send message Joined: 15 Jan 11 Posts: 175 Credit: 6,242,691 RAC: 699 |
OK, thanks, I didn't know that. Since the BOINC definition of the Suspend command is :- "Suspend: Suspends ANY further processing of this project", I had assumed that this included uploads as well as downloads, since it certainly stops downloads. (It's obvious that 'No new tasks' is to stop downloads only) Well, one lives & learns. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
New News post up the top of this section. About the only thing that can be done on computers, is to set the Network activity off. But then it needs to be manually watched for those people with multiple projects with short completion times. Perhaps once an hour have a short on, and then off again when the other projects have uploaded. pioneer1 BOINC keeps a diary, and every time there's a failed transfer, it makes a note. When there's enough failures, it gives up and aborts the WU as being a waste of time. Backups: Here |
Send message Joined: 29 Sep 04 Posts: 2363 Credit: 14,611,758 RAC: 0 |
Dave, several years ago a previous moderator, MikeMarsUK, did ask in a Trac ticket for a project-by-project network suspend button for the Transfers tab. Trac tickets are the commonest way of making new requests. David Anderson in Berkeley refused the request even though many of us really wanted it at the time; his way of thinking was to keep BOINC Manager as simple as possible and avoid the proliferation of new buttons. At that time files could only remain in the Transfers tab for two weeks after the first upload attempt. After that BOINC aborted the file transfer. That BOINC rule caused a couple of really scary panics after which DA relented in response to our pleas and increased the transfer waiting time to two or three months. So now we never need to worry about this problem. Referring to what Les said, I think the number of upload attempts that BOINC allows for each file is 100. The backoffs that BOINC imposes make it very unlikely that this limit will be reached, but this is why I advised members not to repeatedly press the Retry now button. Abracadabra! My stuck uploads remain stuck but my three stuck downloads have downloaded and that model has begun to crunch! Cpdn news |
Send message Joined: 16 May 07 Posts: 10 Credit: 2,368,487 RAC: 0 |
@Dave Roberts Well, one lives & learns. +100 I'm old enough (not only age wise but BOINC wise as well) to know a bit more/better. I'm in this BOINC business when I joined the original SETI@Home (and I still crunch for it) in June 1999 before BOINC was even conceived. From BOINC 1.x to the latest 7.x version. @Les & mo.v Thanks for the explanation. @mo.v You were lucky with your downloads unlike me :( How many times for the downloads? Avoid the proliferation of buttons? You know how many buttons some projects like to add, don't you? CPDN puts ONLY six, Einstein thirteen!!!!!! |
Send message Joined: 17 Aug 04 Posts: 289 Credit: 44,103,664 RAC: 0 |
I would just like to report the following: in case it would give Andy and Jonathan some info and/or clues on downloads. my fastest computer ... just ... within the last few hours ... downloaded the following four (4) Workunit: all ... failed within a few minuets - Error while computing
|
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
Better still is the real error: Model crashed: REPLANCA: Non-standard period for periodic data I'll report it. SIGH |
©2024 cpdn.org