climateprediction.net (CPDN) home page
Thread 'Another Upload Problem'

Thread 'Another Upload Problem'

Message boards : Number crunching : Another Upload Problem
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
DaveG27

Send message
Joined: 8 Nov 06
Posts: 18
Credit: 2,425,895
RAC: 0
Message 40666 - Posted: 14 Sep 2010, 20:27:57 UTC

I have got stuck on one of my computers in the transfer tab 9 uploads all with the same problem "Project file upload handler is missing"
This has been going on for several days but has only come to light since the upload server came back on line.
This a new one on me any idea's
hadam3p_pnw_v52t_1964_1_006680211_1
hadam3p_saf_v8k5_1965_1_006723864_0


Tue 14 Sep 2010 20:47:21 BST climateprediction.net Started upload of hadam3p_pnw_v52t_1964_1_006680211_1_2.zip
Tue 14 Sep 2010 20:47:21 BST climateprediction.net Started upload of hadam3p_pnw_v52t_1964_1_006680211_1_4.zip
Tue 14 Sep 2010 20:47:25 BST climateprediction.net Project file upload handler is missing
Tue 14 Sep 2010 20:47:25 BST climateprediction.net Backing off 3 hr 1 min 58 sec on upload of hadam3p_pnw_v52t_1964_1_006680211_1_2.zip
Tue 14 Sep 2010 20:47:25 BST climateprediction.net Project file upload handler is missing
Tue 14 Sep 2010 20:47:25 BST climateprediction.net Backing off 3 hr 36 min 38 sec on upload of hadam3p_pnw_v52t_1964_1_006680211_1_4.zip


Dave
ID: 40666 · Report as offensive     Reply Quote
DaveG27

Send message
Joined: 8 Nov 06
Posts: 18
Credit: 2,425,895
RAC: 0
Message 40667 - Posted: 14 Sep 2010, 22:34:59 UTC - in response to Message 40666.  

hadam3p_saf_v8k5_1965_1_006723864_0 has now managed to up load it self cannot find what its real problem was as the messages are very mixed up with it trying to upload so many.
ID: 40667 · Report as offensive     Reply Quote
Profilemo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 40668 - Posted: 15 Sep 2010, 2:17:53 UTC

I'm glad some of the files have uploaded. Could you please list the model name(s) and file numbers of the ones that are still stuck?
Cpdn news
ID: 40668 · Report as offensive     Reply Quote
DaveG27

Send message
Joined: 8 Nov 06
Posts: 18
Credit: 2,425,895
RAC: 0
Message 40669 - Posted: 15 Sep 2010, 2:45:33 UTC

They are 7 monthly uploads for hadam3p_pnw_v52t_1964_1_006680211_1
the trickles get through
screen shot off transfer tab
ID: 40669 · Report as offensive     Reply Quote
Profilemo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 40671 - Posted: 15 Sep 2010, 10:50:24 UTC

Thanks, Dave. AFAIK all these files upload to the server in Oregon which is shown on the Server status page as up and running. But there was a previous occasion when it was shown as up when in fact it was down.

Has anyone else got a CPDN PNW model and can tell us whether it's uploading its monthly files or not? I have one but it's a Beta model which uploads to the Beta server, so that's no good for comparison.
Cpdn news
ID: 40671 · Report as offensive     Reply Quote
Profileold_user610281
Avatar

Send message
Joined: 15 Jan 10
Posts: 3
Credit: 25,028
RAC: 0
Message 40672 - Posted: 15 Sep 2010, 11:57:47 UTC
Last modified: 15 Sep 2010, 12:00:59 UTC

I've just uploaded my 2nd month here. It is not claiming credits however?
ID: 40672 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 40673 - Posted: 15 Sep 2010, 14:16:04 UTC - in response to Message 40672.  
Last modified: 15 Sep 2010, 14:16:37 UTC

The credits program only runs once per day, so you may have to wait a while to see them.
Backups: Here
ID: 40673 · Report as offensive     Reply Quote
old_user616860

Send message
Joined: 12 Mar 10
Posts: 4
Credit: 455,298
RAC: 0
Message 40675 - Posted: 15 Sep 2010, 21:04:12 UTC - in response to Message 40671.  

Hi there

I have a set of 12 that are not uploading. Check my post to the "Upload Problem" thread. The 13th and final file uploaded to Oxford. The others are for http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler at Oregon State and not uploading. The first file has been waiting 3 weeks. I have had to suspend getting new tasks from this project as 75% of my available disk is now locked up holding data/results.

I would appreciate any assistance in getting these files off my system.

Thanks


Greg
ID: 40675 · Report as offensive     Reply Quote
Profilemo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 40676 - Posted: 15 Sep 2010, 23:26:39 UTC

Les has reported the problem with the Oregon server to Milo who should read it on Thursday morning.
Cpdn news
ID: 40676 · Report as offensive     Reply Quote
ProfileMilo Thurston
Volunteer moderator
Volunteer developer

Send message
Joined: 2 Mar 06
Posts: 253
Credit: 363,646
RAC: 0
Message 40679 - Posted: 16 Sep 2010, 8:20:02 UTC

I have been able to ssh into the Oregon server. The file_upload_handler is clearly working as files are coming in and the upload logs agree. The result templates have the correct URLs for the file_upload_handler on this system. Therefore, I can't find any obvious problem for me to fix.

Are those of you having problems able to see a response from this URL if you check in a browser?


http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler

You should see some XML like this:

<data_server_reply>
    <status>1</status>
    <message>no command</message>
</data_server_reply>
ID: 40679 · Report as offensive     Reply Quote
DaveG27

Send message
Joined: 8 Nov 06
Posts: 18
Credit: 2,425,895
RAC: 0
Message 40680 - Posted: 16 Sep 2010, 8:57:30 UTC

I just found one of my other computers is running a "pnw" job and has no problems in uploading.
Response good from "url".
Now got 9 monthly uploads stuck with "Project file upload handler is missing".
Looks like something went wrong with original download and might have to abort this one which I will hate doing as I do not like loosing models.

Dave
ID: 40680 · Report as offensive     Reply Quote
old_user616860

Send message
Joined: 12 Mar 10
Posts: 4
Credit: 455,298
RAC: 0
Message 40710 - Posted: 18 Sep 2010, 5:20:28 UTC - in response to Message 40679.  

Hi there

I do get the XML as stated when the URL is accessed via a browser.

I have been digging around in the client_status.xml file and found that the file_info for the files contains the URL address:
http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_hnndler
and
http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler

Record in full:
<file_info>
<name>hadam3p_pnw_v45i_1965_1_006679012_0_1.zip</name>
<nbytes>6019650.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>5f068c2ee7c52cea65b42df9d262d844</md5_cksum>
<generated_locally/>
<status>1</status>
<upload_when_present/>
<url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_hnndler</url>
<persistent_file_xfer>
<num_retries>134</num_retries>
<first_request_time>1282977978.207387</first_request_time>
<next_request_time>1284787088.206869</next_request_time>
<time_so_far>387.274133</time_so_far>
<last_bytes_xferred>323.000000</last_bytes_xferred>
</persistent_file_xfer>
<signed_xml>
<name>hadam3p_pnw_v45i_1965_1_006679012_0_1.zip</name>
<generated_locally/>
<upload_when_present/>
<max_nbytes>150000000</max_nbytes>
<url> http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler </url>
</signed_xml>
<xml_signature>
7dd6e8fab2790603cdbc8c132edafe94a092efffb77251f54bbf2795b8495aa1
a1acd5f88b5bf6a4054b676a33edb9924bc0e165434f6957592b9a360fbdbea5
12b1f1163457d3a8275a2814d1f923e3f0477c37f176dd1c7f869d2169332d41
a3dade8c7b748b31bbb545f1daa1ef0e84e0ff30c8093015368cbeef8a732e7d
.
</xml_signature>
</file_info>

I'm not sure how to fix this.


Greg
ID: 40710 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 40711 - Posted: 18 Sep 2010, 6:22:05 UTC - in response to Message 40710.  

Ahh. The mysterious "handler" mis-spelling.

I think that it may be fixable by editing the xml file. Carefully!

If you want the minimum amount of re-calculating, then:
In the Projects tab, set climateprediction to No new work
In the Tasks tab:
Click on a climate model
Click on the Show graphics button.
Wait until the count down timer reaches zero and returns to the maximum value.
Wait until the timer has started counting down again.
Click on Suspend to the left of the task names.

Repeat this for each model.

In the menu, Suspend BOINC.
(Note: I don't know what effect this will have on tasks for other projects.)
Click on Exit.

Now copy client_state.xml, and paste in somewhere else so that you have a copy of "before" in case something goes wrong.

Use a plain text editor to go through the original file, changing all occurrences of a mis-spelled "handler".
Save the file, WITHOUT adding any other extension to the name!
Re-start BOINC.
Carefully check the xml file again to make sure that handler is still spelt correct. There have been reports that the mis-spelling returned.
Re-start all of the models, and try the upload again.


Backups: Here
ID: 40711 · Report as offensive     Reply Quote
old_user616860

Send message
Joined: 12 Mar 10
Posts: 4
Credit: 455,298
RAC: 0
Message 40714 - Posted: 18 Sep 2010, 12:00:27 UTC - in response to Message 40711.  

Hi there

Correcting the spelling in the XML file eventually worked after shutting down the boinc-client daemon. The files have now uploaded. Thanks for the assistance.

Have a good day.


Greg
ID: 40714 · Report as offensive     Reply Quote
DaveG27

Send message
Joined: 8 Nov 06
Posts: 18
Credit: 2,425,895
RAC: 0
Message 40715 - Posted: 18 Sep 2010, 15:02:25 UTC

Thanks Greg
Managed to upload files after you pointed out the error
Was trying to find a missing file did not think of a spelling error although this had been mentioned on these forums.
Now all uploaded and I can now get some peace and not fret over a failed model.
Perhaps we should have a wip round to buy Oxford a spell checker!
ID: 40715 · Report as offensive     Reply Quote
old_user56130

Send message
Joined: 21 Feb 05
Posts: 3
Credit: 73,761
RAC: 0
Message 40717 - Posted: 19 Sep 2010, 11:02:02 UTC - in response to Message 40673.  

Hi Les,
Which day does it run? as my modest trickles have not been credited since 16/09/10. Maybe it needs a nudge.
ID: 40717 · Report as offensive     Reply Quote
Darmok

Send message
Joined: 29 Dec 09
Posts: 34
Credit: 18,395,130
RAC: 0
Message 40719 - Posted: 19 Sep 2010, 13:33:19 UTC - in response to Message 40717.  

Same here since 16/09. Everything else works fine.
ID: 40719 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 40725 - Posted: 19 Sep 2010, 20:17:37 UTC

As I posted somewhere else, no one's at home at the moment. So, for the next 2 weeks, if something breaks it will stay broken for a while.
It looks like the credits script is the first thing. :(


Backups: Here
ID: 40725 · Report as offensive     Reply Quote
Darmok

Send message
Joined: 29 Dec 09
Posts: 34
Credit: 18,395,130
RAC: 0
Message 40732 - Posted: 20 Sep 2010, 10:27:21 UTC - in response to Message 40725.  

Thanks Les.
To let U know that suddenly 4 days were credited today.:)
ID: 40732 · Report as offensive     Reply Quote
old_user56130

Send message
Joined: 21 Feb 05
Posts: 3
Credit: 73,761
RAC: 0
Message 40733 - Posted: 20 Sep 2010, 16:40:51 UTC

Mine recovered 4 days (16th-20th) today also. Cheers

ID: 40733 · Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : Another Upload Problem

©2024 cpdn.org