climateprediction.net (CPDN) home page
Thread 'Can't upload for 12 days'

Thread 'Can't upload for 12 days'

Message boards : Number crunching : Can't upload for 12 days
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 · Next

AuthorMessage
sonthakit

Send message
Joined: 16 Jan 08
Posts: 5
Credit: 7,055
RAC: 0
Message 41348 - Posted: 23 Dec 2010, 19:28:27 UTC

I can't upload data from 12 Dec (for 12 days)
The first 2 zip file upload success famous_vbim_1599_200_006700692_4_1.zip and famous_vbim_1599_200_006700692_4_2.zip) but after that from famous_vbim_1599_200_006700692_4_3.zip to famous_vbim_1599_200_006700692_4_16.zip the upload fail
This job is nearly to finish. (62 hours to finish)
I am suspected that my job will finish before I can upload or may be I cannot upload forever

12/24/2010 2:16:35 AM climateprediction.net Started upload of famous_vbim_1599_200_006700692_4_4.zip
12/24/2010 2:16:35 AM climateprediction.net Started upload of famous_vbim_1599_200_006700692_4_6.zip
12/24/2010 2:16:38 AM Project communication failed: attempting access to reference site
12/24/2010 2:16:38 AM climateprediction.net Temporarily failed upload of famous_vbim_1599_200_006700692_4_4.zip: HTTP error
12/24/2010 2:16:38 AM climateprediction.net Backing off 3 hr 51 min 27 sec on upload of famous_vbim_1599_200_006700692_4_4.zip
12/24/2010 2:16:38 AM climateprediction.net Temporarily failed upload of famous_vbim_1599_200_006700692_4_6.zip: HTTP error
12/24/2010 2:16:38 AM climateprediction.net Backing off 3 hr 30 min 56 sec on upload of famous_vbim_1599_200_006700692_4_6.zip
12/24/2010 2:16:38 AM climateprediction.net Started upload of famous_vbim_1599_200_006700692_4_7.zip
12/24/2010 2:16:38 AM climateprediction.net Started upload of famous_vbim_1599_200_006700692_4_8.zip
12/24/2010 2:16:39 AM Internet access OK - project servers may be temporarily down.
12/24/2010 2:16:41 AM Project communication failed: attempting access to reference site
12/24/2010 2:16:41 AM climateprediction.net Temporarily failed upload of famous_vbim_1599_200_006700692_4_7.zip: HTTP error
12/24/2010 2:16:41 AM climateprediction.net Backing off 1 hr 4 min 16 sec on upload of famous_vbim_1599_200_006700692_4_7.zip
12/24/2010 2:16:41 AM climateprediction.net Temporarily failed upload of famous_vbim_1599_200_006700692_4_8.zip: HTTP error
12/24/2010 2:16:41 AM climateprediction.net Backing off 40 min 19 sec on upload of famous_vbim_1599_200_006700692_4_8.zip
12/24/2010 2:16:43 AM Internet access OK - project servers may be temporarily down.
12/24/2010 2:17:42 AM climateprediction.net Started upload of famous_vbim_1599_200_006700692_4_9.zip
12/24/2010 2:17:42 AM climateprediction.net Started upload of famous_vbim_1599_200_006700692_4_10.zip
12/24/2010 2:17:45 AM Project communication failed: attempting access to reference site
12/24/2010 2:17:45 AM climateprediction.net Temporarily failed upload of famous_vbim_1599_200_006700692_4_9.zip: HTTP error
12/24/2010 2:17:45 AM climateprediction.net Backing off 2 hr 29 min 7 sec on upload of famous_vbim_1599_200_006700692_4_9.zip
12/24/2010 2:17:45 AM climateprediction.net Temporarily failed upload of famous_vbim_1599_200_006700692_4_10.zip: HTTP error
12/24/2010 2:17:45 AM climateprediction.net Backing off 13 min 27 sec on upload of famous_vbim_1599_200_006700692_4_10.zip
12/24/2010 2:17:47 AM Internet access OK - project servers may be temporarily down.

Please help.
It is too long for this upload error.
ID: 41348 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 41350 - Posted: 23 Dec 2010, 21:44:44 UTC - in response to Message 41348.  
Last modified: 23 Dec 2010, 21:45:20 UTC

If you have upload errors for 2 or 3 days, then is the time to ask, not after a couple of weeks. :)

As for your problem, it may simply be due to the server down time, which has been posted about in the News thread.
Some of the upload servers are unavailable from about 2 am to 11.30 am UK time.

Are you trying to upload all of the time, or only during certain hours?

And it may be best to set the project for No new taks in the projects tab, and then to Suspend the model from further work, otherwise you risk losing all of the unsent trickles, if the model completes before they are sent.

Once you've solved the problem, then you can re-start the model.
Backups: Here
ID: 41350 · Report as offensive     Reply Quote
sonthakit

Send message
Joined: 16 Jan 08
Posts: 5
Credit: 7,055
RAC: 0
Message 41352 - Posted: 23 Dec 2010, 23:28:06 UTC

I am running it in 24/7
Upload is try again and again all the time.
The upload pending zip file is growing again.
Now it is famous_vbim_1599_200_006700692_4_3.zip to famous_vbim_1599_200_006700692_4_17.zip
ID: 41352 · Report as offensive     Reply Quote
sonthakit

Send message
Joined: 16 Jan 08
Posts: 5
Credit: 7,055
RAC: 0
Message 41353 - Posted: 24 Dec 2010, 0:01:49 UTC

This is the Log file that I have log from proxomitron.
I am running other project in another core CPU at the same time (my computer is dual CPU), a lot of different project.
They seem no problem.
The upload problem is only climateprediction.

Here is the log file

New Message Log Window....

+++GET 1+++
Using Proxy - 172.20.9.1:8080
POST http://kraken.oerc.ox.ac.uk/cgi-bin/file_upload_handler HTTP/1.1
User-Agent: BOINC client (windows_intelx86 6.10.58)
Host: kraken.oerc.ox.ac.uk
Accept: */*
Accept-Encoding: deflate, gzip
Content-Type: application/x-www-form-urlencoded
Content-Length: 293
Connection: keep-alive
Proxy-Authorization: Basic ************************

+++GET 2+++
Using Proxy - 172.20.9.1:8080
POST http://kraken.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler HTTP/1.1
User-Agent: BOINC client (windows_intelx86 6.10.58)
Host: kraken.oerc.ox.ac.uk
Accept: */*
Accept-Encoding: deflate, gzip
Content-Type: application/x-www-form-urlencoded
Content-Length: 293
Connection: keep-alive
Proxy-Authorization: Basic ************************
Posting 293 bytes...
Posting 293 bytes...

+++RESP 1+++
HTTP/1.1 200 OK
Date: Thu, 23 Dec 2010 23:37:36 GMT
Server: Apache
Content-Type: text/plain
X-Cache: MISS from cache.childrenhospital.go.th
Proxy-Connection: close

+++RESP 2+++
HTTP/1.1 200 OK
Date: Thu, 23 Dec 2010 23:37:36 GMT
Server: Apache
Content-Type: text/plain
X-Cache: MISS from cache.childrenhospital.go.th
Proxy-Connection: close
+++CLOSE 1+++
+++CLOSE 2+++

+++GET 3+++
Using Proxy - 172.20.9.1:8080
POST http://kraken.oerc.ox.ac.uk/cgi-bin/file_upload_handler HTTP/1.1
User-Agent: BOINC client (windows_intelx86 6.10.58)
Host: kraken.oerc.ox.ac.uk
Accept: */*
Accept-Encoding: deflate, gzip
Content-Type: application/x-www-form-urlencoded
Content-Length: 5509276
Expect: 100-continue
Connection: keep-alive
Proxy-Authorization: Basic ************************

+++GET 4+++
Using Proxy - 172.20.9.1:8080
POST http://kraken.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler HTTP/1.1
User-Agent: BOINC client (windows_intelx86 6.10.58)
Host: kraken.oerc.ox.ac.uk
Accept: */*
Accept-Encoding: deflate, gzip
Content-Type: application/x-www-form-urlencoded
Content-Length: 5514277
Expect: 100-continue
Connection: keep-alive
Proxy-Authorization: Basic ************************
Posting 5509276 bytes...
Posting 5514277 bytes...
+++CLOSE 4+++
+++CLOSE 3+++
Bad Request...
[ˆ/|ҝá¥æ‡€Ñ—VY†äS.Hn=ƒéÇ!dÆ’:\#R0u}7Ø÷‚øyx"üî‡Ãýô0Å“WU½üz@Kî#ðÿð^oUᒏØÕð’ãÛ$#Q¨Ôj>§‚öz&

]
ID: 41353 · Report as offensive     Reply Quote
ProfileMilo Thurston
Volunteer moderator
Volunteer developer

Send message
Joined: 2 Mar 06
Posts: 253
Credit: 363,646
RAC: 0
Message 41355 - Posted: 24 Dec 2010, 11:51:18 UTC

If you put this URL into your browser:

http://kraken.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler


...and you then see this:

<data_server_reply>
    <status>1</status>
    <message>no command</message>
</data_server_reply>


Then all is working as it should.
That machine is definitely accepting uploads - huge quantities of data are coming in. By the time my successor finally arrives they'll have a lot of data to shift.
ID: 41355 · Report as offensive     Reply Quote
old_user26115
Avatar

Send message
Joined: 21 Oct 04
Posts: 24
Credit: 207,633
RAC: 0
Message 41357 - Posted: 25 Dec 2010, 19:27:41 UTC
Last modified: 25 Dec 2010, 19:32:01 UTC

Very good tip, but kraken does not respond , because (IMO) he has crashed again.

when I suspend FAMOUS WU's, Boincmgr continous to try to upload. Is the uploadtry time infinite or will this WU's crashing by to many upload errors?

I think at this problem because of the christmas holidays and Kraken is mot online before next year.

message: (time is UTC+1), that means the upload try was at 13:00 UK time
25.12.2010 13:54:05 climateprediction.net Started upload of famous_v9by_1599_200_006697860_6_17.zip
25.12.2010 13:57:15 Project communication failed: attempting access to reference site
25.12.2010 13:57:15 climateprediction.net Temporarily failed upload of famous_v9by_1599_200_006697860_6_17.zip: HTTP error

greetz littleBouncer
ID: 41357 · Report as offensive     Reply Quote
ProfileMilo Thurston
Volunteer moderator
Volunteer developer

Send message
Joined: 2 Mar 06
Posts: 253
Credit: 363,646
RAC: 0
Message 41358 - Posted: 25 Dec 2010, 20:17:06 UTC - in response to Message 41357.  

Very good tip, but kraken does not respond , because (IMO) he has crashed again.


It certainly looks like that, as I can't get in to that machine, although it was up yesterday. I note that two other machines in the same rack are also down, which suggests that there may be a more widespread problem than just one machine crashing - perhaps a loss of power to that particular rack.
If I get chance to go in during the holidays I will do so, although I'm not in Oxford at the moment and can't do so immediately.
ID: 41358 · Report as offensive     Reply Quote
sonthakit

Send message
Joined: 16 Jan 08
Posts: 5
Credit: 7,055
RAC: 0
Message 41360 - Posted: 26 Dec 2010, 13:41:19 UTC

Progress...
Now I have 3-19.zip files, only 16 hours to finish the work
It is too late to abort this work, I just want it to finish.
Hope that I can upload in the future.

On 24 Dec I type
http://kraken.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler
in the browser, the response is good, it show

<data_server_reply>
<status>1</status>
<message>no command</message>
</data_server_reply>

But I still cannot upload. If you see proxomitron log, it show that I can contact to upload server (GET1 and GET2) but the upload (post) fail (GET3 and GET4). I don't know this can help you or not, hope this information should.

Anyway, today (26 Dec) I temporally move the computer to another location, this location connect the internet with different ISP and without proxy. But unfortunately, the upload server is down, so I cannot prove that it is my error or server error.

Plan... I still run this application to finish, wait for upload. I don't get any new work until upload success.

Merry X Mas and Happy new year to all of you
ID: 41360 · Report as offensive     Reply Quote
Ingleside

Send message
Joined: 5 Aug 04
Posts: 127
Credit: 24,498,085
RAC: 21,454
Message 41361 - Posted: 26 Dec 2010, 23:05:39 UTC - in response to Message 41357.  

Very good tip, but kraken does not respond , because (IMO) he has crashed again.

when I suspend FAMOUS WU's, Boincmgr continous to try to upload. Is the uploadtry time infinite or will this WU's crashing by to many upload errors?

The number of failed attempts isn't important, but any file-transfer will error-out if 90 days after it's 1st. attempt it still fails. Please note, with v6.6.xx and earlier clients the limit was only 14 days.

ID: 41361 · Report as offensive     Reply Quote
old_user26115
Avatar

Send message
Joined: 21 Oct 04
Posts: 24
Credit: 207,633
RAC: 0
Message 41367 - Posted: 27 Dec 2010, 20:26:19 UTC - in response to Message 41361.  


The number of failed attempts isn't important, but any file-transfer will error-out if 90 days after it's 1st. attempt it still fails. Please note, with v6.6.xx and earlier clients the limit was only 14 days.



THX Ingleside, this machine uses BOINCMgr 6.10.58 , I suspended CPDN before the WU got the next -.zip file. I will restart work when kraken and 'his fellows' will be online...perhaps next year.

so have nice holidays and a happy new year^^

littleBouncer
ID: 41367 · Report as offensive     Reply Quote
old_user463488

Send message
Joined: 27 Jul 07
Posts: 1
Credit: 41,898
RAC: 0
Message 41389 - Posted: 30 Dec 2010, 16:44:58 UTC

Same problem here. Have not been able to upload for a few days.
Any updates on this issue from the project staff?

Thu 30 Dec 2010 08:50:05 AM CST climateprediction.net Started upload of famous_xu1u_799_200_007100777_0_5.zip
Thu 30 Dec 2010 08:50:28 AM CST Project communication failed: attempting access to reference site
Thu 30 Dec 2010 08:50:28 AM CST climateprediction.net Temporarily failed upload of famous_xu1u_799_200_007100777_0_5.zip: connect() failed
Thu 30 Dec 2010 08:50:28 AM CST climateprediction.net Backing off 2 hr 37 min 26 sec on upload of famous_xu1u_799_200_007100777_0_5.zip
Thu 30 Dec 2010 08:50:30 AM CST Internet access OK - project servers may be temporarily down.
ID: 41389 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 41390 - Posted: 30 Dec 2010, 17:36:02 UTC - in response to Message 41389.  

Same problem here. Have not been able to upload for a few days.
Any updates on this issue from the project staff?

Check the News thread at the top of this Number Crunching topic.

"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 41390 · Report as offensive     Reply Quote
ProfileMilo Thurston
Volunteer moderator
Volunteer developer

Send message
Joined: 2 Mar 06
Posts: 253
Credit: 363,646
RAC: 0
Message 41392 - Posted: 30 Dec 2010, 18:37:34 UTC - in response to Message 41389.  


Any updates on this issue from the project staff?


Not from project staff, but I have updated the news thread as mentioned in the post above.
I might be able to get in to Oxford tomorrow, and if the problem is something that does not require spare parts or infrastructure changes then some machines should subsequently start running again.
ID: 41392 · Report as offensive     Reply Quote
sonthakit

Send message
Joined: 16 Jan 08
Posts: 5
Credit: 7,055
RAC: 0
Message 41420 - Posted: 2 Jan 2011, 15:22:45 UTC

I just finish the job and success upload all the result.
Thank you very much.
ID: 41420 · Report as offensive     Reply Quote
ProfileLeprechaun

Send message
Joined: 5 Aug 04
Posts: 6
Credit: 554,572
RAC: 0
Message 41435 - Posted: 5 Jan 2011, 11:38:56 UTC

What is now? Christmas is over and still nobody upload possibly.
ID: 41435 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 41436 - Posted: 5 Jan 2011, 12:08:39 UTC

All FAMOUS should now be uploading successfully. Are you having a problem uploading another type of model?
ID: 41436 · Report as offensive     Reply Quote
Belfry

Send message
Joined: 19 Apr 08
Posts: 179
Credit: 4,306,992
RAC: 0
Message 41437 - Posted: 5 Jan 2011, 13:07:08 UTC

My hadcm3 models require http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler, which remains down.
ID: 41437 · Report as offensive     Reply Quote
ProfileMilo Thurston
Volunteer moderator
Volunteer developer

Send message
Joined: 2 Mar 06
Posts: 253
Credit: 363,646
RAC: 0
Message 41438 - Posted: 5 Jan 2011, 13:51:50 UTC - in response to Message 41437.  

I've almost got uploader.oerc back up again - hopefully it will not be much more than another day.
ID: 41438 · Report as offensive     Reply Quote
Belfry

Send message
Joined: 19 Apr 08
Posts: 179
Credit: 4,306,992
RAC: 0
Message 41439 - Posted: 5 Jan 2011, 14:49:33 UTC - in response to Message 41438.  
Last modified: 5 Jan 2011, 14:51:55 UTC

Thanks Milo for your help with the CPDN servers. I'm in no rush because I'm on BOINC 6.10.58, which allows uploads to stay in the queue for ninety days, but it might be an issue for others with older clients and their fourteen day limit. Happy New Year to you and all the CPDN support crew.
ID: 41439 · Report as offensive     Reply Quote
ProfileLeprechaun

Send message
Joined: 5 Aug 04
Posts: 6
Credit: 554,572
RAC: 0
Message 41440 - Posted: 5 Jan 2011, 16:43:31 UTC - in response to Message 41435.  
Last modified: 5 Jan 2011, 16:48:00 UTC

Yes, Model hadam3p_eu have a problem.

05.01.2011 17:46:32 climateprediction.net Started upload of hadam3p_eu_xuy0_1983_1_007045312_0_4.zip
05.01.2011 17:46:35 Project communication failed: attempting access to reference site
05.01.2011 17:46:35 climateprediction.net Temporarily failed upload of hadam3p_eu_xuy0_1983_1_007045312_0_4.zip: connect() failed
05.01.2011 17:46:35 climateprediction.net Backing off 1 min 0 sec on upload of hadam3p_eu_xuy0_1983_1_007045312_0_4.zip
05.01.2011 17:46:36 Internet access OK - project servers may be temporarily down.
ID: 41440 · Report as offensive     Reply Quote
1 · 2 · 3 · 4 · Next

Message boards : Number crunching : Can't upload for 12 days

©2024 cpdn.org