climateprediction.net (CPDN) home page
Thread 'Several jobs uploads in project backoff'

Thread 'Several jobs uploads in project backoff'

Message boards : Number crunching : Several jobs uploads in project backoff
Message board moderation

To post messages, you must log in.

Previous · 1 · 2

AuthorMessage
Art Masson
Avatar

Send message
Joined: 16 Oct 11
Posts: 254
Credit: 15,954,577
RAC: 0
Message 46138 - Posted: 1 May 2013, 1:33:41 UTC - in response to Message 46133.  

My jobs uploaded sometime in the last 12 hours also....something got "fixed" ???
ID: 46138 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 46140 - Posted: 1 May 2013, 3:42:38 UTC - in response to Message 46138.  

Apache was restarted.


Backups: Here
ID: 46140 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,012,300
RAC: 21,119
Message 46141 - Posted: 1 May 2013, 7:22:05 UTC

Just to day that I still have the problem on 2 EU uploads from computer ID: 1253464 Uploads get to 100 % before I get the error message about unable to open file in event log. I have again suspended network activity for this machine.
ID: 46141 · Report as offensive     Reply Quote
Professor Desty Nova
Avatar

Send message
Joined: 19 Sep 04
Posts: 92
Credit: 2,011,637
RAC: 351
Message 46142 - Posted: 1 May 2013, 7:33:14 UTC

I seems the upload server of this WU http://climateapps2.oerc.ox.ac.uk/cpdnboinc/workunit.php?wuid=8480442 is not working well. It goes to 100% them it gives the following error:

01/05/2013 08:09:15 | climateprediction.net | Started upload of hadam3p_eu_q4z2_2004_1_008329581_1_1.zip
01/05/2013 08:14:53 | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/incoming/uploader/hadam3p_eu_q4z2_2004_1_008329581_1_1.zip: No such file or directory
01/05/2013 08:14:53 | climateprediction.net | Temporarily failed upload of hadam3p_eu_q4z2_2004_1_008329581_1_1.zip: transient upload error
01/05/2013 08:14:53 | climateprediction.net | Backing off 4 hr 9 min 39 sec on upload of hadam3p_eu_q4z2_2004_1_008329581_1_1.zip

I've suspended the WU until this uploads well.

PS: From the BOINC files the upload server is http://cpdn-upload2.oerc.ox.ac.uk



Professor Desty Nova
Researching Karma the Hard Way
ID: 46142 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,012,300
RAC: 21,119
Message 46143 - Posted: 1 May 2013, 10:36:38 UTC

No need to suspend the work unit, just network activity to save bandwidth and the remote possibility of too many upload attempts. - It will I think still try and upload periodically even if the work unit is suspended. If you have other projects that need to upload, you can just limit when network activity is available which will stop it making too many attempts, then the others can upload during the window.
ID: 46143 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,012,300
RAC: 21,119
Message 46146 - Posted: 2 May 2013, 16:26:58 UTC - in response to Message 46143.  

Didn't go this morning but both plus one other have gone this afternoon so all back to normal. Thanks mods and techies who sorted it all out.
ID: 46146 · Report as offensive     Reply Quote
Profile[B@H] Ray
Avatar

Send message
Joined: 19 Aug 05
Posts: 104
Credit: 1,866,495
RAC: 0
Message 46147 - Posted: 2 May 2013, 17:37:27 UTC - in response to Message 46146.  

Was traveling so I did not check for 3 days, but I see that my units uploaded all trickels this morning. I must have been the reboot of Apache that did it.
Keep on crunching Pizza@Home
ID: 46147 · Report as offensive     Reply Quote
Professor Desty Nova
Avatar

Send message
Joined: 19 Sep 04
Posts: 92
Credit: 2,011,637
RAC: 351
Message 46148 - Posted: 2 May 2013, 18:57:34 UTC

The zip file of my WU uploaded fine just now.


Professor Desty Nova
Researching Karma the Hard Way
ID: 46148 · Report as offensive     Reply Quote
Ingleside

Send message
Joined: 5 Aug 04
Posts: 127
Credit: 24,447,557
RAC: 24,147
Message 46151 - Posted: 3 May 2013, 15:56:32 UTC - in response to Message 46099.  
Last modified: 3 May 2013, 15:57:01 UTC

The time limit for uploading files from any project was extended. I can't remember whether the limit is now two or three months, but in any case it's far longer than we need.

It's 90 days.

But, but, but... each file is still only allowed 100 upload attempts, after which it expires. That's the BOINC rule. 100 is plenty but please don't use up the files' lives by repeatedly pressing the Retry now button in the Transfers tab. The files come to no harm while they wait.

I've never seen anything to a "100 upload attempts"-rule, and seeing how a file can easily reach this limit in 4 days (assuming re-tries once per hour), it wouldn't make any sence to increase the limit from 14-day to 90 days in this case.

To do a little test, blocked internet-connection and hit "retry" on a SIMAP-upload 110 times... no problem. Did a little editing, and, as BoincTask happily shows, it's now retried... 1234567 times, hits retry, 1234568 times, 1234569 times, 1234570 times, 1234571 times...

Since 1234567 >> 100 I didn't see anything to any 100-retry-limit on uploads...
ID: 46151 · Report as offensive     Reply Quote
Profilemo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 46152 - Posted: 3 May 2013, 17:24:52 UTC

I'm sure you're right. Apparently Nicol�s also thought the limit was 100 and looked in the BOINC code but couldn't find any limiting number of attempts. There are certain things that BOINC only allows 100 times and some of us must have assumed that the same limit applied to uploads without ever seeing the code.

You have exploded an urban myth!


Cpdn news
ID: 46152 · Report as offensive     Reply Quote
Ingleside

Send message
Joined: 5 Aug 04
Posts: 127
Credit: 24,447,557
RAC: 24,147
Message 46153 - Posted: 3 May 2013, 22:17:46 UTC - in response to Message 46152.  

You have exploded an urban myth!

Well, some myths are easy to bust...


ID: 46153 · Report as offensive     Reply Quote
Previous · 1 · 2

Message boards : Number crunching : Several jobs uploads in project backoff

©2024 cpdn.org