climateprediction.net (CPDN) home page
Thread 'Project file upload handler is missing.'

Thread 'Project file upload handler is missing.'

Message boards : Number crunching : Project file upload handler is missing.
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 43730 - Posted: 2 Feb 2012, 12:43:36 UTC

Just now I looked @ the advanced/event log on BOINC manager and saw the following messages,
Thu 02 Feb 2012 08:32:09 GMT | climateprediction.net | Project file upload handler is missing
Thu 02 Feb 2012 08:32:09 GMT | climateprediction.net | Backing off 10 hr 33 min 4 sec on upload of hadam3p_eu_8h04_2000_1_007687181_0_4.zip

Don't know if this needs to be passed to anyone or if it will just sort itself out next time my machine tries to contact the project?

Dave
ID: 43730 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 43733 - Posted: 2 Feb 2012, 15:17:00 UTC - in response to Message 43730.  

Old problem, which won't go away.
The "handler" is missing, because the text string has become corrupted in client_state.xml, and needs to be edited.
It only happens to Linux machines

A fix has been posted several times on our php board, and this post covers it in detail.


Backups: Here
ID: 43733 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 43734 - Posted: 2 Feb 2012, 15:27:14 UTC - in response to Message 43733.  

Thanks Les, I will look at your link.

Dave
ID: 43734 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 43735 - Posted: 3 Feb 2012, 8:53:26 UTC - in response to Message 43734.  

Went through the instructions with search and replace putting handler in for any instances of handlr or handlrr, still no joy, also latest messages

Fri 03 Feb 2012 08:26:12 GMT | climateprediction.net | Started upload of hadam3p_eu_8i3c_2004_1_007687026_0_7.zip
Fri 03 Feb 2012 08:28:13 GMT | | Project communication failed: attempting access to reference site
Fri 03 Feb 2012 08:28:13 GMT | climateprediction.net | Temporarily failed upload of hadam3p_eu_8i3c_2004_1_007687026_0_7.zip: HTTP error
Fri 03 Feb 2012 08:28:13 GMT | climateprediction.net | Backing off 14 min 35 sec on upload of hadam3p_eu_8i3c_2004_1_007687026_0_7.zip
Fri 03 Feb 2012 08:28:14 GMT | | Internet access OK - project servers may be temporarily down.
Fri 03 Feb 2012 08:42:49 GMT | climateprediction.net | Started upload of hadam3p_eu_8i3c_2004_1_007687026_0_7.zip
Fri 03 Feb 2012 08:44:50 GMT | | Project communication failed: attempting access to reference site
Fri 03 Feb 2012 08:44:50 GMT | climateprediction.net | Temporarily failed upload of hadam3p_eu_8i3c_2004_1_007687026_0_7.zip: HTTP error
Fri 03 Feb 2012 08:44:50 GMT | climateprediction.net | Backing off 38 min 59 sec on upload of hadam3p_eu_8i3c_2004_1_007687026_0_7.zip
I note this is on the other task I am running. I will look further at your link Les and see if I just jumped to conclusions and there is more I should be doing to the clientstate.xml. I did remember to shut down BOINC before editing.

Dave
ID: 43735 · Report as offensive     Reply Quote
wateroakley

Send message
Joined: 6 Aug 04
Posts: 195
Credit: 28,374,828
RAC: 10,749
Message 43736 - Posted: 3 Feb 2012, 10:23:19 UTC - in response to Message 43735.  

Dave, one of the upload servers is off-line at the moment. uploader1.atm. This is affecting hadam3p uploads. The messages that you report look 'normal' for an off-line upload server. The uploads should back off with increasing time-outs.
ID: 43736 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 43737 - Posted: 3 Feb 2012, 10:33:39 UTC - in response to Message 43734.  

Went through the instructions with search and replace putting handler in for any instances of handlr or handlrr, still no joy, also latest messages

Fri 03 Feb 2012 08:26:12 GMT | climateprediction.net | Started upload of hadam3p_eu_8i3c_2004_1_007687026_0_7.zip
Fri 03 Feb 2012 08:28:13 GMT | | Project communication failed: attempting access to reference site
Fri 03 Feb 2012 08:28:13 GMT | climateprediction.net | Temporarily failed upload of hadam3p_eu_8i3c_2004_1_007687026_0_7.zip: HTTP error
Fri 03 Feb 2012 08:28:13 GMT | climateprediction.net | Backing off 14 min 35 sec on upload of hadam3p_eu_8i3c_2004_1_007687026_0_7.zip
Fri 03 Feb 2012 08:28:14 GMT | | Internet access OK - project servers may be temporarily down.
Fri 03 Feb 2012 08:42:49 GMT | climateprediction.net | Started upload of hadam3p_eu_8i3c_2004_1_007687026_0_7.zip
Fri 03 Feb 2012 08:44:50 GMT | | Project communication failed: attempting access to reference site
Fri 03 Feb 2012 08:44:50 GMT | climateprediction.net | Temporarily failed upload of hadam3p_eu_8i3c_2004_1_007687026_0_7.zip: HTTP error
Fri 03 Feb 2012 08:44:50 GMT | climateprediction.net | Backing off 38 min 59 sec on upload of hadam3p_eu_8i3c_2004_1_007687026_0_7.zip
I note this is on the other task I am running. I will look further at your link Les and see if I just jumped to conclusions and there is more I should be doing to the clientstate.xml. I did remember to shut down BOINC before editing.

Dave
ID: 43737 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 43738 - Posted: 3 Feb 2012, 10:34:59 UTC - in response to Message 43736.  

Thanks,

may mean that I have sorted out the problem, just to be faced with another temporary one lol.

Dave
ID: 43738 · Report as offensive     Reply Quote
ProfileIain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1084
Credit: 7,827,799
RAC: 5,038
Message 43739 - Posted: 3 Feb 2012, 10:47:47 UTC

... faulty air conditioning unit in the server room apparently. Being fixed.
ID: 43739 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 43740 - Posted: 3 Feb 2012, 13:08:43 UTC - in response to Message 43739.  

All but one of my uploads have now gone through, the other is backed off by 5 hours so I assume will work then. Looks like the one that had the upload handler problem has now gone through. Thanks all.

Dave
ID: 43740 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 43741 - Posted: 3 Feb 2012, 14:42:47 UTC - in response to Message 43740.  

Or so I thought,
I have just been through a copy of clientstate.xml without finding a misspelling of handler. I am still getting the message Project file upload handler is missing.
I have tracked down the zip file in question in the .xml file but am afraid it makes little sense to me, other than that the file is not transferring which I could tell by looking @ the transfers tab.

I am quite happy for someone to point out something in the portion of the file which is bleeding obvious, even if not to me.

<upload_url>http://uploader1.atm.ox.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
</file>
<file>
<name>hadam3p_eu_8h04_2000_1_007687181_0_4.zip</name>
<nbytes>13743083.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>41130e8681805ab6432ca43cea075478</md5_cksum>
<status>0</status>
<upload_url>http://uploader1.atm.ox.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
<persistent_file_xfer>
<num_retries>14</num_retries>
<first_request_time>1327526537.473585</first_request_time>
<next_request_time>1328311850.488157</next_request_time>
<time_so_far>295.883478</time_so_far>
<last_bytes_xferred>0.000000</last_bytes_xferred>
<is_upload>1</is_upload>
</persistent_file_xfer>

Dave
ID: 43741 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 43742 - Posted: 3 Feb 2012, 23:38:30 UTC - in response to Message 43741.  

I don't think that that is the section you should be looking for. It should be in a file info section like this



<file_info>
<name>hadam3p_eu_80lm_1999_1_007685643_0_8.zip</name>
<nbytes>0.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<generated_locally/>
<status>0</status>
<upload_when_present/>
<url>http://uploader1.atm.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
</file_info>


Do another search for that upload file name and see what handler is spelled like in that section.
ID: 43742 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 43743 - Posted: 4 Feb 2012, 9:50:15 UTC - in response to Message 43742.  

This is the only instance of the file name in clientstate.xml

<upload_url>http://uploader1.atm.ox.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
</file>
<file>
<name>hadam3p_eu_8h04_2000_1_007687181_0_4.zip</name>
<nbytes>13743083.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>41130e8681805ab6432ca43cea075478</md5_cksum>
<status>0</status>
<upload_url>http://uploader1.atm.ox.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
<persistent_file_xfer>
<num_retries>14</num_retries>
<first_request_time>1327526537.473585</first_request_time>
<next_request_time>1328311850.488157</next_request_time>
<time_so_far>295.883478</time_so_far>
<last_bytes_xferred>0.000000</last_bytes_xferred>
<is_upload>1</is_upload>
</persistent_file_xfer>
</file>

Not sure where this leaves me, subsequent uploads from task have gone through ok. I will let the model finish and keep looking.

Dave
ID: 43743 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 43744 - Posted: 4 Feb 2012, 10:34:54 UTC - in response to Message 43743.  

You may have a section missing from the xml.

Note these lines in George's post:

<generated_locally/>

<upload_when_present/>


They're not in the lines that you quoted.


Backups: Here
ID: 43744 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,718,239
RAC: 8,054
Message 43748 - Posted: 4 Feb 2012, 15:28:10 UTC - in response to Message 43744.  

You may have a section missing from the xml.

Note these lines in George's post:

<generated_locally/>

<upload_when_present/>

They're not in the lines that you quoted.

No problem there, that's just the difference between the BOINC 7.x.x format (Dave's) and the older BOINC v6.x.x format (George's)
ID: 43748 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 43749 - Posted: 4 Feb 2012, 18:06:45 UTC - in response to Message 43748.  

:)
That thought has just occurred to me too.
Nice to have it confirmed.

I'm afraid, Dave, that people using the test version of BOINC may well be on their own, in trying to solve problems such as these. The best advice that I can give, is to watch the BOINC dev boards about releases, and to keep up to date.

Ahh. Another thought. Perhaps the server software version isn't sufficiently up to date to deal with the version 7 clients, at least in relation to this problem.


Backups: Here
ID: 43749 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 43750 - Posted: 4 Feb 2012, 19:35:17 UTC

I've had further thoughts on the server side part. (It's still very early in the morning, so not really awake yet.) :)

I've started a new topic in the moderators section of the php board, to see what others think. But, it's the weekend, (as usual with these things), so a while before there's a reasonable prospect of hearing from the project people.


Backups: Here
ID: 43750 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 43751 - Posted: 4 Feb 2012, 20:18:00 UTC - in response to Message 43750.  

Thanks Les,
It is likely to be another week at least till the task finishes so I am not in any rush. I will look at the xml again myself tomorrow but given my ignorance about such things don't have a lot of hope of sorting it without further help.

Dave
ID: 43751 · Report as offensive     Reply Quote
Ingleside

Send message
Joined: 5 Aug 04
Posts: 127
Credit: 24,498,085
RAC: 21,454
Message 43752 - Posted: 5 Feb 2012, 3:29:15 UTC - in response to Message 43741.  
Last modified: 5 Feb 2012, 3:29:56 UTC

Or so I thought,
I have just been through a copy of clientstate.xml without finding a misspelling of handler. I am still getting the message Project file upload handler is missing.
I have tracked down the zip file in question in the .xml file but am afraid it makes little sense to me, other than that the file is not transferring which I could tell by looking @ the transfers tab.

I am quite happy for someone to point out something in the portion of the file which is bleeding obvious, even if not to me.

Hmm, is it the computer running v6.13.10?

If so, the 1st. step is to upgrade to v7, since v6.13.10 has some major bugs, among others with handling of trickle-uploads.


If after the upgrade to v7 this file is still stuck without uploading, try changing the status-part from zero to 1, as shown below:

<upload_url>http://uploader1.atm.ox.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
</file>
<file>
<name>hadam3p_eu_8h04_2000_1_007687181_0_4.zip</name>
<nbytes>13743083.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>41130e8681805ab6432ca43cea075478</md5_cksum>
<status>1</status>
<upload_url>http://uploader1.atm.ox.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
<persistent_file_xfer>
<num_retries>14</num_retries>
<first_request_time>1327526537.473585</first_request_time>
<next_request_time>1328311850.488157</next_request_time>
<time_so_far>295.883478</time_so_far>
<last_bytes_xferred>0.000000</last_bytes_xferred>
<is_upload>1</is_upload>
</persistent_file_xfer>

Dave
ID: 43752 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 43753 - Posted: 5 Feb 2012, 8:40:35 UTC - in response to Message 43752.  

I will download 7.x and see what happens.

Thanks

Dave
ID: 43753 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 43754 - Posted: 5 Feb 2012, 9:34:08 UTC - in response to Message 43753.  

Using 7.0 got the following message
Sun 05 Feb 2012 08:48:54 GMT | climateprediction.net | Restarting task hadam3p_eu_8i3c_2004_1_007687026_0 using hadam3p_eu version 609
Sun 05 Feb 2012 08:48:54 GMT | climateprediction.net | Restarting task hadam3p_eu_8h04_2000_1_007687181_0 using hadam3p_eu version 609
Sun 05 Feb 2012 08:48:55 GMT | climateprediction.net | [error] File transfer for hadam3p_eu_8h04_2000_1_007687181_0_4.zip not found
Sun 05 Feb 2012 08:48:55 GMT | climateprediction.net | Giving up on upload of hadam3p_eu_8h04_2000_1_007687181_0_4.zip: file not found

Looking at results - trickles all seem to have gone up ok at expected timesteps.

does this mean the zip had gone ok and the problem was with the reporting back or is it lost?

Anyway, thanks for all those who helped. &.0 has also got rid of the error messages in the terminal I launch manager from when I use it to open a browser window to get to the cpdn site.

Dave
ID: 43754 · Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : Project file upload handler is missing.

©2024 cpdn.org