climateprediction.net (CPDN) home page
Thread 'Credits accruing but no trickles sent????'

Thread 'Credits accruing but no trickles sent????'

Message boards : Number crunching : Credits accruing but no trickles sent????
Message board moderation

To post messages, you must log in.

AuthorMessage
old_user294426

Send message
Joined: 20 Feb 06
Posts: 158
Credit: 1,251,176
RAC: 0
Message 41362 - Posted: 26 Dec 2010, 23:19:44 UTC
Last modified: 26 Dec 2010, 23:27:01 UTC

How is it that the credits are all getting accrued on the Statistics page, but the trickles are still remaining awaiting upload in the Transfer page?

At present I have 16 trickles outstanding on 2 tasks (2 x 8).
None have been uploaded for 4 days now, but the credits graph has resorted to a normal straight line during the last 5 days, even though it had been very erratic since December 2nd.

Keith

(Must be something to do with the kraken.oerc being down)
ID: 41362 · Report as offensive     Reply Quote
skgiven
Avatar

Send message
Joined: 5 Jun 06
Posts: 28
Credit: 2,790,048
RAC: 0
Message 41364 - Posted: 27 Dec 2010, 16:53:06 UTC - in response to Message 41362.  

I noticed a few trickle update pending messages a few days ago and then finished tasks stopped uploading. The cause is a crashed upload server (power outage). Things tend to behave strangely when they are not working properly.

I checked my pending credit and it suggests quite a lot of work to add to the tally,

http://climateapps2.oucs.ox.ac.uk/cpdnboinc/pending.php

Result ID Workunit ID Host ID Claimed credit
8182465 6249578 794294 226.80
8182772 6249640 794294 151.20
8338165 6274938 798383 2,570.40
9231729 6488047 981208 1,995.84
9422923 6528706 981208 2,081.77
9422975 6531095 981208 2,081.77
9422976 6532521 981208 2,081.77
9490809 6575330 981208 2,081.77
9516615 6587782 981208 2,081.77
9991674 6568525 981208 2,081.77
9992330 6551093 981208 2,081.77
10815674 6781676 981208 2,081.77
10815686 6781682 981208 2,081.77
10847538 6746957 981208 83.16
10896103 6429409 981208 2,081.77
11734809 6898261 1117464 6,176.41
11734833 6898265 1117464 5,280.84
11734840 6898267 1117464 6,176.41
11800772 6911453 1117464 6,176.41
11893960 6928697 981208 7,145.52
11893976 6928699 981208 5,656.87
12420807 7292459 1117464 617.72
12421592 7262840 1117464 988.30
12422027 7293668 1117464 1,019.18
12422951 7294582 1117464 1,358.88

Pending credit: 66,441.64

No doubt the techs will sort out their upload server and the database when they get back from their holidays.
ID: 41364 · Report as offensive     Reply Quote
skgiven
Avatar

Send message
Joined: 5 Jun 06
Posts: 28
Credit: 2,790,048
RAC: 0
Message 41413 - Posted: 1 Jan 2011, 15:20:21 UTC - in response to Message 41364.  

Some tasks reported back today - good to see progress.

Pending credit is now only 48,493 (down from 66,441), but total credit only went up by under 1000 since 5 days ago. RAC is around 1K per day.

This WU alone should get 7K.

Hopefully it's just a matter of updating the credit database.
ID: 41413 · Report as offensive     Reply Quote
old_user294426

Send message
Joined: 20 Feb 06
Posts: 158
Credit: 1,251,176
RAC: 0
Message 41416 - Posted: 2 Jan 2011, 2:58:24 UTC
Last modified: 2 Jan 2011, 3:13:37 UTC

skgiven

It has been mentioned several times that BOINC's "pending credit" figure is not used by CPDN, so it is irrelevant.

As for RAC, I have long given up any credence to that figure. It means nothing, having absolutely no relevance to the meaning of "average". It was reported to have been "spiced up" to make it more interesting, but now is completely useless for any monitoring purpose.

I just wonder if this deviance from the normal BOINC routines might have some contribution to the problems being experienced with the servers being overloaded - but probably not.

I have suspended network access until the servers come back again. There are only 2 upload servers now still red on the server status page, and my cache is now exhausted, working on the last 2 tasks. I am hoping that we will soon be back to normality so I can upload all my zip files and download more tasks before the one of these last two tasks completes in 4 days time (or, of course, it hits yet another "calculation error").

I am still restricted to FAMOUS only on the Mac, and that seems to be still in an experimental stage, as I understand it, to see if it complies with known history of weather patterns in the past. All these "calculation errors" are soul destroying.

Keith
ID: 41416 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 41417 - Posted: 2 Jan 2011, 6:10:06 UTC

Keith,

Upload server 'kraken' is up again. It's been up and down today (Saturday at my patch of the planet) as Milo works (on his holiday) to set things aright. Uploaded all my lurking work. Then posted in 'News' thread that all was well. Premature as it turned out, so I later hid the post.

Well 'kraken' came up again and stayed up a long time (still up as I write this) and I notified a friend on the other side of the Coast Range to check server status, that she might be able to upload her lot. She did, and she did. ... Still, I'm reluctant to re-post in the 'News' thread. Better, perhaps, to wait until Milo is sure 'kraken' is well in hand.

Meanwhile two other Oxford servers remain down -- and the U.Bern server went down again. (Let's hear it for long holidays ...!)
"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 41417 · Report as offensive     Reply Quote
ProfileMilo Thurston
Volunteer moderator
Volunteer developer

Send message
Joined: 2 Mar 06
Posts: 253
Credit: 363,646
RAC: 0
Message 41418 - Posted: 2 Jan 2011, 12:05:17 UTC

Kraken has been up, but is being hammered by a large quantity of uploads, hence the erratic response.

uploader.oerc has had ~2TB out of ~4.5TB removed and will come back up when finished. This copy is proceeding in a slow but orderly manner.

climateapps1 is proving more problematic, but I have another plan to try this afternoon.
ID: 41418 · Report as offensive     Reply Quote
old_user294426

Send message
Joined: 20 Feb 06
Posts: 158
Credit: 1,251,176
RAC: 0
Message 41419 - Posted: 2 Jan 2011, 13:37:24 UTC
Last modified: 2 Jan 2011, 13:44:21 UTC

I lost my cache of tasks to Calculation Errors, so lost patience and resumed Network Activity.

I was surprised to see all zip files disappear from the Transfers page, but suspect some went worryingly quickly. That might well have been for the tasks that had suffered a "Calculation Error", which could possibly be a normal occurence.

More importantly, I did get a download of more FAMOUS tasks, and am still rationed to 2 per day!!! That's with no other CPDN alternative.

What has concerned me is that I seem to be short of about 10,000 credits between 26 Dec and 2 Jan. The concern is restricted to the possibility of results having gone astray and the consequent waste of computing time for the project. (I do not worry where I am in the rankings)

But it may be that the missing 10,000 are safe and will register when we get to the end of the day today. Hopefully everything OK now.

THANKS AGAIN FOR YOUR HELP MILO.

Keith
ID: 41419 · Report as offensive     Reply Quote
old_user294426

Send message
Joined: 20 Feb 06
Posts: 158
Credit: 1,251,176
RAC: 0
Message 41421 - Posted: 3 Jan 2011, 8:21:51 UTC
Last modified: 3 Jan 2011, 8:22:46 UTC

My 10,000 credits have been made good and the Statistics graph locus is back on it's correct line. So, I am reassured that my Mac's work on the FAMOUS tasks over the Christmas/NewYear has not been wasted, even though most of the tasks were still being terminated by Calculation Errors. And I have a cache now of 4 FAMOUS tasks - back to what appears to be normal.

THANKS YET AGAIN FOR YOUR EFFORTS MILO.

I see that Kracken is "Cracking on" now and Uploader is the only server Not Running.
ID: 41421 · Report as offensive     Reply Quote
Darmok

Send message
Joined: 29 Dec 09
Posts: 34
Credit: 18,395,130
RAC: 0
Message 41422 - Posted: 3 Jan 2011, 12:10:05 UTC - in response to Message 41418.  

All good for the Famous files and trickles though the Hadcm zip files have been stuck for over a week. Could this be an "unrelated" problem as the models, which have not stopped running, have not created any further zip files since, but should have. My concern is these models will end in 4-5 days and I hope they will be usable as there is no quorum on these: I am the only cruncher running 2 out 3 models.
ID: 41422 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 41423 - Posted: 3 Jan 2011, 19:55:59 UTC - in response to Message 41422.  

the Hadcm zip files have been stuck for over a week

One of the upload servers is still not working.

the models, which have not stopped running, have not created any further zip files since,

That would be a problem with your computer, not the servers.

There IS no quorum with climate models. It's just that sometimes several copies of a data set are made available for any of several reasons, related to what the researchers are doing.


Backups: Here
ID: 41423 · Report as offensive     Reply Quote
ProfileIain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1084
Credit: 7,827,799
RAC: 5,038
Message 41429 - Posted: 4 Jan 2011, 13:29:53 UTC - in response to Message 41422.  

[Darmok wrote:]... the Hadcm zip files have been stuck for over a week. Could this be an "unrelated" problem as the models, which have not stopped running, have not created any further zip files since, but should have.
Unfortunately, it isn't possible to see anything about the Zip files. The models seem to be trickling alright, though nothing has come through today.

If you turn network activity off then any new Zip file will be held back and become visible in the Transfers tab: it's possible that new Zip files were generated but uploaded to other servers fine, leaving only the Zip files for which no upload server is currently available - giving the impression that no new files had been generated.
ID: 41429 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 41432 - Posted: 4 Jan 2011, 19:42:20 UTC

Darmok

Apparently you're offended by my recent reply to one of your posts.
It was brief and to the point for two reasons:

1) The answers were all obvious to people who have been watching the news thread, and in the case of "quorum", I didn't feel that it needed a long rambling reply.

2) Health reasons, which I wasn't going to mention in public forums.
In early December I became infected with shingles on the right hand side of my head. Once this had run it's course, Postherpetic neuralgia set in over a larger area, extending down the back of my neck to my shoulders, and down the right hand side of my face.
This resulted in prickly pains, deep, stabbing pains right down into my head, and an effect similar to as if my head and face was badly sun burnt.
For a couple of weeks the area around my eye was so swollen that I couldn't open it. Then when I could, I found that I still had vision in that eye, but couldn't see with it. Eventually, I was able to see for 2-3 seconds at a time before it started watering badly, and becoming irritated.
It was at this point that I made a few brief posts to help out, as there were only 2-3 other people left to do so.

For the past day or so, I've been able to see fairly normally, although I still have trouble reading, even with glasses. And I'm still getting a lot of pain.

As you find my posts offensive, I won't be answering any further posts from you.


ID: 41432 · Report as offensive     Reply Quote
Profilemo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 41434 - Posted: 5 Jan 2011, 6:08:43 UTC
Last modified: 5 Jan 2011, 6:09:50 UTC

Hi Darmok

CPDN has been seriously short-staffed recently. The two programmers have left and we are lucky that one of them, Milo, is still in the same place albeit in a new job and is helping out with problems. Which there has been no shortage of with so many servers out of action over the Christmas period.

In addition, several of the half-dozen currently active moderators have been away over the holidays (Geophi, Thyme Lawn and me). And Les fell ill weeks before Christmas. So it isn't surprising that his first post to you was brief. I am absolutely certain that he never intended to belittle or disparage you or any of the points you had made. Please reread what he said taking the circumstances into account.



By the way, when Milo's successor joins CPDN (in February?) has settled I hope he will be able to hide at least some of the Boinc phrases like quorum that don't apply to CPDN and must be extremely confusing, especially for new members. This job may, however, need to be deferred until CPDN installs a new Boinc version.

Although the concept of quorum is irrelevant to CPDN, very often in the case of a single computer running a model, if it crashes on that machine it will be sent out to another, and if that's a disaster to a third. FAMOUS is being organised like this at the moment.

Can you give us a link to the web pages of any models you have running that should have created files but haven't.
Cpdn news
ID: 41434 · Report as offensive     Reply Quote

Message boards : Number crunching : Credits accruing but no trickles sent????

©2024 cpdn.org