climateprediction.net (CPDN) home page
Thread 'Can't upload for 12 days'

Thread 'Can't upload for 12 days'

Message boards : Number crunching : Can't upload for 12 days
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · Next

AuthorMessage
ProfileMilo Thurston
Volunteer moderator
Volunteer developer

Send message
Joined: 2 Mar 06
Posts: 253
Credit: 363,646
RAC: 0
Message 41444 - Posted: 6 Jan 2011, 10:33:59 UTC

Sorry, but unfortunately uploader.oerc is still not ready; it is being much slower than I expected.
I will, of course, bring it back on line as soon as I am able.
ID: 41444 · Report as offensive     Reply Quote
Bill H

Send message
Joined: 11 May 07
Posts: 36
Credit: 1,485,638
RAC: 0
Message 41445 - Posted: 6 Jan 2011, 11:35:12 UTC - in response to Message 41348.  

I had all four climate prediction jobs terminate unexpectedly and had to start new ones.

Even so I have the same problem with uploading. I have 6 x hadam3p queuing up for upload for over a week...

Any ideas on when the server will be back on-line?

Bill H
ID: 41445 · Report as offensive     Reply Quote
old_user294426

Send message
Joined: 20 Feb 06
Posts: 158
Credit: 1,251,176
RAC: 0
Message 41446 - Posted: 6 Jan 2011, 15:51:42 UTC - in response to Message 41445.  
Last modified: 6 Jan 2011, 15:53:56 UTC

Bill

Where are the 6 tasks "queueing up"?
Are they zip files in the Transfers page?
You seem to have 4 tasks in progress and all others have been uploaded.
No doubt these are the ones you have just downloaded after the unexpectedly terminating tasks.

Keith
ID: 41446 · Report as offensive     Reply Quote
old_user294426

Send message
Joined: 20 Feb 06
Posts: 158
Credit: 1,251,176
RAC: 0
Message 41448 - Posted: 6 Jan 2011, 20:27:17 UTC

Bill

Are you looking at the "Pending Credits"?

It has been mentioned many times that CPDN does not use or amend the Pending Credits, and they should not be displayed by BOINC Manager when running CPDN, and deleting that display is an amendment that is overdue.

Keith
ID: 41448 · Report as offensive     Reply Quote
copycat

Send message
Joined: 24 Feb 05
Posts: 28
Credit: 121,749
RAC: 0
Message 41562 - Posted: 30 Jan 2011, 12:58:04 UTC

I've got 4 zips waiting in transfers in my Linux-setup and another 4 in my Win 7-setup, all backing off and reporting the project servers are down when trying to upload. Trickles report without a problem. The Win 7-setup has its deadline in 15 days.
ID: 41562 · Report as offensive     Reply Quote
ProfileAaron Doucett

Send message
Joined: 1 Oct 05
Posts: 12
Credit: 10,041,430
RAC: 0
Message 41563 - Posted: 30 Jan 2011, 19:19:51 UTC
Last modified: 30 Jan 2011, 19:20:50 UTC

I understand this has been discussed before, but I believe I am having a similar issue. Unfortunately, because the famous models that have completed will not upload, the finished hadam3p models and trickels are getting stuck in the queue and can't upload either (If there are only Hadam3p models present, they upload fine as the FAMOUS ones are not stuck in front of them.

This has led to having a major backlog of models on several of my machines. I am hoping the models will be able to upload normally soon, but I am considering aborting the finished models if much more time goes by without them going through.


This is a screenshot showing my upload Transfer page in the BOINC manager



Current tasks:



Any ideas on if/when uploading functionality would be restored, or any possible solutions on my end?

Note: this is not a localized problem on one machine. Every single PC I've checked that I have running models is not able to upload FAMOUS at this time. [/url]
ID: 41563 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 41565 - Posted: 30 Jan 2011, 23:39:52 UTC - in response to Message 41563.  

The upload server for FAMOUS models, Kraken, was getting full some time ago, and data was in the process of being transferred, when the OeRC department at the University of Oxford changed their IP addresses. This change was long planned, but the timing was unexpected on "our" part. Among the servers affected was Kraken, so no more data transferring was possible until the IP issue was resolved.

As there are no programmers with the project at present, as mentioned in several other places, problems are being dealt with after hours by Milo, and by another software engineer who is trying to look after cpdn until the new programmers arrive which will be some time in February.

As to when models will once again be uploading, the best guess is that this will occur "sometime in the future". Hopefully the 'near' future.



Backups: Here
ID: 41565 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 41571 - Posted: 31 Jan 2011, 20:45:11 UTC

Update:

Milo found that the firewall for Kraken hadn't been updated after the change of IP.
This has now been fixed.


Backups: Here
ID: 41571 · Report as offensive     Reply Quote
ProfileAaron Doucett

Send message
Joined: 1 Oct 05
Posts: 12
Credit: 10,041,430
RAC: 0
Message 41579 - Posted: 1 Feb 2011, 0:15:43 UTC
Last modified: 1 Feb 2011, 0:23:56 UTC

Good news, everyone! For the first time in many days, my famous models are uploading! Thanks everyone at CPDN who helped to fix the problem.

Now I wish I hadn't cancelled several finished famous models that were "clogging the tubes" so to speak.

Lets just hope the server doesn't get hit too hard from the surge of people now trying to upload models...
ID: 41579 · Report as offensive     Reply Quote
marpes

Send message
Joined: 11 Nov 04
Posts: 8
Credit: 15,267,364
RAC: 0
Message 41607 - Posted: 8 Feb 2011, 15:18:50 UTC
Last modified: 8 Feb 2011, 15:29:10 UTC

Hi,
I have a problem with uploading some of the *. zip files. These files are from the old WUs, and also from the newer. For example, for one of the PC it is more than 30 files from 12 WUs.
This problem affects only CPDN project.
Repeated transfers some files take up to several hours, but still without success. Overall it is a 5 PCs that are connected through a proxy server. This problem has persisted for several months. To improve the transmission does not help either in setting file cc_config:
- <cc_config>
- <options>
<http_1_0> 1 </ http_1_0>
</ options>
</ cc_config>

Other PC, attached outside the proxy, the problem with uploading files do not.

Can someone help?
ID: 41607 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 41609 - Posted: 8 Feb 2011, 20:14:36 UTC - in response to Message 41607.  
Last modified: 8 Feb 2011, 20:18:12 UTC

It's possible that a different cc_config option will help. See this post by Thyme Lawn on our php board for info.

This problem has persisted for several months.
After 3 months BOINC gives up and aborts the work units, so then you won't have a problem. :)

PS
Kraken, the file server for the zip files from FAMOUS models, is down at the moment, as per the post in News and Announcements.
Backups: Here
ID: 41609 · Report as offensive     Reply Quote
marpes

Send message
Joined: 11 Nov 04
Posts: 8
Credit: 15,267,364
RAC: 0
Message 41614 - Posted: 9 Feb 2011, 15:24:52 UTC

I tried, but unsuccessfully
ID: 41614 · Report as offensive     Reply Quote
ProfileJIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,363,583
RAC: 5,022
Message 41677 - Posted: 26 Feb 2011, 5:46:50 UTC
Last modified: 26 Feb 2011, 5:51:00 UTC

Is there some problem with the servers? Server status shows all are up and running, but, hadam3p_pnw_ze5s_1975_1_006958472_0 can’t upload zip.13. Is kraken.oerc overloaded again?
ID: 41677 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 41678 - Posted: 26 Feb 2011, 6:55:58 UTC - in response to Message 41677.  

Kraken has been uploading fine for me. Don't know about the other upload servers.
ID: 41678 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 41682 - Posted: 27 Feb 2011, 16:45:34 UTC

Uploader1 is down and is now the destination for PNW #13 zip files. (Three loiter on one of my machines.)

"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 41682 · Report as offensive     Reply Quote
Christoph

Send message
Joined: 9 Dec 05
Posts: 1
Credit: 174,159
RAC: 0
Message 41712 - Posted: 6 Mar 2011, 20:33:40 UTC

My machines are unable to upload since almost 2 weeks now. Do we still have to reset the upload deadline as described here, or has this limit of 14 days been increased in BOINC?
ID: 41712 · Report as offensive     Reply Quote
ProfileIain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1084
Credit: 7,827,799
RAC: 5,038
Message 41713 - Posted: 6 Mar 2011, 22:10:39 UTC - in response to Message 41712.  

If you are using BOINC Manager 6.10.58, which you are, then the deadline for uploading is very long - 90 days or something similar.
ID: 41713 · Report as offensive     Reply Quote
old_user30961
Avatar

Send message
Joined: 21 Nov 04
Posts: 6
Credit: 902,269
RAC: 0
Message 41714 - Posted: 6 Mar 2011, 23:54:22 UTC
Last modified: 6 Mar 2011, 23:56:53 UTC

All but the #13s (as expected) are uploading fine for me.

Chuck
ID: 41714 · Report as offensive     Reply Quote
Profilemo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 41715 - Posted: 7 Mar 2011, 0:45:35 UTC
Last modified: 7 Mar 2011, 0:46:21 UTC

Things have been much less traumatic since the Boinc upload timeout limit was increased from 2 weeks to 90 days. Remember when Milo had 3 upload servers out of action within days of each other and then just days before the deadline a replacement he ordered was delivered to the wrong address?

Chuck, what does your avatar show? Is that a shop?
Cpdn news
ID: 41715 · Report as offensive     Reply Quote
BarryAZ

Send message
Joined: 13 Jul 05
Posts: 125
Credit: 11,778,421
RAC: 0
Message 41716 - Posted: 7 Mar 2011, 4:25:34 UTC - in response to Message 41715.  

Just wondering, are the lost credits (I reverted back to where I was around 2/21) going to be found in the restore efforts?

Also, I for one am hoping that a large chunk of the massive data store you folks have was moved to near line storage so that it doesn't have to be backed up with your back up routines. With the multiple TB of data you were trying to backup every day, the backup routine was starting to get like a counterinsurgency operation -- 'sir, we had to destroy the village to save it'.

ID: 41716 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · Next

Message boards : Number crunching : Can't upload for 12 days

©2024 cpdn.org