climateprediction.net (CPDN) home page
Thread 'Download error for hadam3p_anz'

Thread 'Download error for hadam3p_anz'

Message boards : Number crunching : Download error for hadam3p_anz
Message board moderation

To post messages, you must log in.

AuthorMessage
ed2353

Send message
Joined: 15 Feb 06
Posts: 137
Credit: 35,337,237
RAC: 12,975
Message 51103 - Posted: 3 Jan 2015, 11:15:35 UTC

Here is the log entry:

03/01/2015 09:37:59 | climateprediction.net | Scheduler request completed: got 1 new tasks
03/01/2015 09:38:01 | climateprediction.net | Started download of hadam3p_anz_se_6.10_windows_intelx86.zip
03/01/2015 09:38:01 | climateprediction.net | Started download of hadam3p_anz_f2kl_2012_1_009296865.zip
03/01/2015 09:38:03 | climateprediction.net | Finished download of hadam3p_anz_f2kl_2012_1_009296865.zip
03/01/2015 09:38:03 | climateprediction.net | Started download of ic19610815_16_N96.gz
03/01/2015 09:38:04 | climateprediction.net | Finished download of hadam3p_anz_se_6.10_windows_intelx86.zip
03/01/2015 09:38:04 | climateprediction.net | Finished download of ic19610815_16_N96.gz
03/01/2015 09:38:04 | climateprediction.net | [error] File hadam3p_anz_se_6.10_windows_intelx86.zip has wrong size: expected 259472, got 1167827
03/01/2015 09:38:04 | climateprediction.net | [error] Checksum or signature error for hadam3p_anz_se_6.10_windows_intelx86.zip

Any ideas on how to correct this checksum error?
ID: 51103 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,718,239
RAC: 8,054
Message 51104 - Posted: 3 Jan 2015, 11:47:45 UTC - in response to Message 51103.  

This is very curious. The copy of hadam3p_anz_se_6.10_windows_intelx86.zip I have in my project folder (downloaded 25/03/2014) is 259,472 bytes, and contains a single file (hadam3p_anz_se_6.10_windows_intelx86.dll).

The test copy I've just downloaded is 1,167,827 bytes - both figures match your 'expected' and 'got' figures, respectively - and contains (apart from the same DLL) a whole bunch of graphics resource files (two jpegs and 29 fonts).

This looks like a server configuration/deployment error - somebody has changed the files without doing a proper version increment, which is not allowed by BOINC. I'll send them an email.

The only workround would be to copy the older, smaller, version of the ZIP file from another machine, and place it in the project folder before trying to download another ANZ model. But at this point we don't know what other changes have been made, and whether anything - apart from the graphics display - will break without the resource files.
ID: 51104 · Report as offensive     Reply Quote
ed2353

Send message
Joined: 15 Feb 06
Posts: 137
Credit: 35,337,237
RAC: 12,975
Message 51105 - Posted: 3 Jan 2015, 13:06:35 UTC - in response to Message 51104.  

Thanks Richard.

I've found a copy of the older, smaller file and replaced the larger one.

I'll now have to wait until my computer tries to download an ANZ model again before we can see if that solves the problem.
ID: 51105 · Report as offensive     Reply Quote
ed2353

Send message
Joined: 15 Feb 06
Posts: 137
Credit: 35,337,237
RAC: 12,975
Message 51106 - Posted: 3 Jan 2015, 14:20:05 UTC - in response to Message 51104.  

That failed because when the new task downloaded, it also downloaded the larger version of the hadam3p_anz_se_6.10_windows_intelx86.zip.
That then was reported as the same checksum failure.
I'll not try for any ANZ tasks until that gets fixed.
ID: 51106 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,718,239
RAC: 8,054
Message 51110 - Posted: 3 Jan 2015, 19:58:17 UTC

I downloaded four ANZ tasks this afternoon without any problem, but it didn't even attempt to re-download the generic application files - the set I had already must have been complete and properly registered.

I suspect the file reference for the file that failed to download may have been removed from your state file. A possible way of recovering the situation might be to request a new ANZ job, and immediately disable BOINC's networking as soon as the task is allocated. Then, you have time to place the small version of the zip in the project folder before re-allowing networking. That should let BOINC skip the fresh download ('file already present - skipping', or words to that effect).
ID: 51110 · Report as offensive     Reply Quote
ed2353

Send message
Joined: 15 Feb 06
Posts: 137
Credit: 35,337,237
RAC: 12,975
Message 51805 - Posted: 10 Apr 2015, 22:15:00 UTC - in response to Message 51110.  

Now that the ANZ tasks are available for Windows, (I run 64bit v8.1) I've tried again to request these tasks, but the failure is still with me.

These were my log entries:

10/04/2015 01:01:44 | | Resetting file projects/climateprediction.net/hadam3p_anz_se_6.10_windows_intelx86.zip: wrong size

10/04/2015 01:01:46 | climateprediction.net | Started download of hadam3p_anz_se_6.10_windows_intelx86.zip
10/04/2015 01:01:49 | climateprediction.net | Finished download of hadam3p_anz_se_6.10_windows_intelx86.zip
10/04/2015 01:01:49 | climateprediction.net | [error] File hadam3p_anz_se_6.10_windows_intelx86.zip has wrong size: expected 259472, got 1167827
10/04/2015 01:01:49 | climateprediction.net | [error] Checksum or signature error for hadam3p_anz_se_6.10_windows_intelx86.zip


This resulted in download failures for ANZ tasks (of course).

I no longer even have a copy of the "old" smaller file anywhere.

Unless I can find a solution, since the ANZ tasks are the only current Windows specific tasks, I will run out of work.
ID: 51805 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,718,239
RAC: 8,054
Message 51806 - Posted: 10 Apr 2015, 22:40:41 UTC - in response to Message 51805.  

I'm running two of the 'new' ANZ models, still with the same small .zip file as we discussed back in January.

I've uploaded it to http://1drv.ms/1Pu9hKz
ID: 51806 · Report as offensive     Reply Quote
ed2353

Send message
Joined: 15 Feb 06
Posts: 137
Credit: 35,337,237
RAC: 12,975
Message 51807 - Posted: 10 Apr 2015, 23:28:59 UTC - in response to Message 51806.  

Many thanks Richard. I've downloaded it and will try it later today.
ID: 51807 · Report as offensive     Reply Quote
ed2353

Send message
Joined: 15 Feb 06
Posts: 137
Credit: 35,337,237
RAC: 12,975
Message 51810 - Posted: 11 Apr 2015, 11:02:21 UTC - in response to Message 51806.  

Well, that did not work.

I inserted the smaller size file to replace the larger one.

However, when a task was requested, this is the result:
11/04/2015 11:47:05 | climateprediction.net | Scheduler request completed: got 1 new tasks
11/04/2015 11:47:07 | climateprediction.net | Started download of hadam3p_anz_se_6.10_windows_intelx86.zip
11/04/2015 11:47:07 | climateprediction.net | Started download of hadam3p_anz_c12u_2013_1_009717144.zip
11/04/2015 11:47:09 | climateprediction.net | Finished download of hadam3p_anz_se_6.10_windows_intelx86.zip
11/04/2015 11:47:09 | climateprediction.net | Finished download of hadam3p_anz_c12u_2013_1_009717144.zip
11/04/2015 11:47:09 | climateprediction.net | Started download of atmos_restart_c12u_ENSO.day.gz
11/04/2015 11:47:09 | climateprediction.net | Started download of so2dms_N96_2013_12_2015_02f.gz
11/04/2015 11:47:09 | climateprediction.net | [error] File hadam3p_anz_se_6.10_windows_intelx86.zip has wrong size: expected 259472, got 1167827
11/04/2015 11:47:09 | climateprediction.net | [error] Checksum or signature error for hadam3p_anz_se_6.10_windows_intelx86.zip

As you can see, the smaller file was ignored and the larger file was downloaded to replace it, with the usual failure for wrong size.
ID: 51810 · Report as offensive     Reply Quote
ed2353

Send message
Joined: 15 Feb 06
Posts: 137
Credit: 35,337,237
RAC: 12,975
Message 51811 - Posted: 11 Apr 2015, 11:12:34 UTC - in response to Message 51810.  

As you can also see, within 2 seconds of the task being allocated, the large file started to download, so I did not get time to stop networking. In any case, the anz_se file started and finished before the task zip.

ID: 51811 · Report as offensive     Reply Quote
ed2353

Send message
Joined: 15 Feb 06
Posts: 137
Credit: 35,337,237
RAC: 12,975
Message 51812 - Posted: 11 Apr 2015, 11:38:14 UTC - in response to Message 51811.  

I'm now trying a different approach.

I've found the reference to this file in my Client_State file:

<file>
<name>hadam3p_anz_se_6.10_windows_intelx86.zip</name>
<nbytes>259472.000000</nbytes>
<max_nbytes>0.000000</max_nbytes>
<status>-200</status>
<executable/>
<signature_required/>
<file_signature>
4736ce2b7657db242ded67bef2b588a15c5bde0ec3cc05713f1a9b12ad13e717
88e3de3c0fe04c0041c8dd2d3d27ffa03e4e3e3ffb03a648ac2f66470166612d
0fd787f382cc88fc9b30a286e813e5ce84d2a2f32ad6d7b5971a68ddbd75a843
0ac8c5eca1626f8bb659e1cebdad8642a2979ba7ec160f6642d217955634ff01
.
</file_signature>
<download_url>http://climateapps2.oerc.ox.ac.uk/cpdnboinc/download/mirror.php?file=/hadam3p_anz_se_6.10_windows_intelx86.zip</download_url>

I've edited the <nbytes>259472 to read 1167827, which is the size of the file that it keeps wanting to download. Hopefully, it will now believe it is the correct size.
ID: 51812 · Report as offensive     Reply Quote
ed2353

Send message
Joined: 15 Feb 06
Posts: 137
Credit: 35,337,237
RAC: 12,975
Message 51813 - Posted: 11 Apr 2015, 12:43:29 UTC - in response to Message 51812.  

That did not work either.
Once again:

11/04/2015 13:29:57 | climateprediction.net | Scheduler request completed: got 1 new tasks
11/04/2015 13:29:59 | climateprediction.net | Started download of hadam3p_anz_se_6.10_windows_intelx86.zip[/b]
11/04/2015 13:29:59 | climateprediction.net | Started download of hadam3p_anz_m8go_2013_1_009743275.zip
11/04/2015 13:30:00 | climateprediction.net | Finished download of hadam3p_anz_se_6.10_windows_intelx86.zip
11/04/2015 13:30:00 | climateprediction.net | Finished download of hadam3p_anz_m8go_2013_1_009743275.zip
11/04/2015 13:30:00 | climateprediction.net | Started download of atmos_restart_m8go_ENSO.day.gz
11/04/2015 13:30:00 | climateprediction.net | Started download of region_restart_m8go_ENSO.day.gz
11/04/2015 13:30:00 | climateprediction.net | [error] File hadam3p_anz_se_6.10_windows_intelx86.zip has wrong size: expected 259472, got 1167827
11/04/2015 13:30:00 | climateprediction.net | [error] Checksum or signature error for hadam3p_anz_se_6.10_windows_intelx86.zip

The Client_State file entry was reverted to the smaller file size (259472) when the task started to download.

Am I the only one with this problem?
ID: 51813 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,718,239
RAC: 8,054
Message 51814 - Posted: 11 Apr 2015, 13:04:19 UTC - in response to Message 51812.  

I'm now trying a different approach.

I've found the reference to this file in my Client_State file:

<file>
<name>hadam3p_anz_se_6.10_windows_intelx86.zip</name>
<nbytes>259472.000000</nbytes>
<max_nbytes>0.000000</max_nbytes>
<status>-200</status>
<executable/>
<signature_required/>
<file_signature>
4736ce2b7657db242ded67bef2b588a15c5bde0ec3cc05713f1a9b12ad13e717
88e3de3c0fe04c0041c8dd2d3d27ffa03e4e3e3ffb03a648ac2f66470166612d
0fd787f382cc88fc9b30a286e813e5ce84d2a2f32ad6d7b5971a68ddbd75a843
0ac8c5eca1626f8bb659e1cebdad8642a2979ba7ec160f6642d217955634ff01
.
</file_signature>
<download_url>http://climateapps2.oerc.ox.ac.uk/cpdnboinc/download/mirror.php?file=/hadam3p_anz_se_6.10_windows_intelx86.zip</download_url>

I've edited the <nbytes>259472 to read 1167827, which is the size of the file that it keeps wanting to download. Hopefully, it will now believe it is the correct size.

Another suggestion: stop BOINC (completely).

Leave the file size at 259472
Edit the status from -200 to 1 (digit 'one')
Put the small download file in the project directory
Check in File Properties that Windows hasn't put a security block on opening it
Start BOINC again.
ID: 51814 · Report as offensive     Reply Quote
ed2353

Send message
Joined: 15 Feb 06
Posts: 137
Credit: 35,337,237
RAC: 12,975
Message 51815 - Posted: 11 Apr 2015, 19:09:14 UTC - in response to Message 51814.  

Richard, I followed your instructions exactly (I did have to Unblock the file), but unfortunately that suggestion did not work either.

When the new task was requested, the client_state file was renewed with the original status of -200.

Once again the anz_se file was reported as the wrong size.
ID: 51815 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,718,239
RAC: 8,054
Message 51816 - Posted: 11 Apr 2015, 19:24:20 UTC - in response to Message 51815.  

Are you sure the BOINC client was shut down, as well as the manager?
ID: 51816 · Report as offensive     Reply Quote
ed2353

Send message
Joined: 15 Feb 06
Posts: 137
Credit: 35,337,237
RAC: 12,975
Message 51817 - Posted: 11 Apr 2015, 20:18:17 UTC - in response to Message 51816.  

Mine is set so that when I shut down the manager, it stops running any tasks.

I assumed that meant that the Client was shut down, am I wrong?
ID: 51817 · Report as offensive     Reply Quote

Message boards : Number crunching : Download error for hadam3p_anz

©2024 cpdn.org