climateprediction.net (CPDN) home page
Thread 'New Ranking Scheme suggestion'

Thread 'New Ranking Scheme suggestion'

Questions and Answers : Wish list : New Ranking Scheme suggestion
Message board moderation

To post messages, you must log in.

AuthorMessage
old_user23856

Send message
Joined: 9 Oct 04
Posts: 2
Credit: 34,537
RAC: 0
Message 19213 - Posted: 12 Jan 2006, 19:27:49 UTC

Hi all!

Apart from the two existing ranking schemes for users and teams (total credit and recent average credit), I would also like to suggest a third one: the number of successufully completed results.

This would be great because:
* It would reflect the actual contribution a member is doing to the project (unfinished or erroneous data sets don\'t really help the project, right?)
* It would encourage people to care for the data sets (like doing regular backups of the BOINC directory and restoring everything in case of an error, keeping their computer in good shape, etc.) and provide a way to \"reward\" people who have already been doing so.

This third ranking scheme could be displayed along with the two existing ones. There are two choices here:

1) Count the number of successfully finished results (but this would put equal weight on hadsm and sulphur)
2) Display the total amount of credit received from successfully finished results

Cheers,
Stefan.
ID: 19213 · Report as offensive     Reply Quote
ProfilePooh Bear 27
Avatar

Send message
Joined: 5 Feb 05
Posts: 465
Credit: 1,914,189
RAC: 0
Message 19215 - Posted: 12 Jan 2006, 19:57:03 UTC

This is not a good number. Since the old WUs were only 72 trickles, the new ones are 120 trickles, and there may be some other different sized ones later. They are not all the same size, so I think that it\'s not a good number.

Plus, there have been some bad released WUs (I had one) that only went so far and failed. These were complete to the point they could be complete, but not finished. I got credit for this WU up to the point it stopped. So, those 24-30 trickles are good, and the data they received for the WU is good, but it\'s not complete.

The HASDM ones had(have) a trickle rate of about 94.5 * 72 trickles, the current Sulpher ones have 160.68 * 120. So it does not make sense to count each WU as 1 is not a good idea IMHO. The \"old\" SETI thinking has got to go away. I do not think any project will ever adopt that idea, again.

It seems they do not clear the WUs from your account, so you can always count your own.


ID: 19215 · Report as offensive     Reply Quote
old_user23856

Send message
Joined: 9 Oct 04
Posts: 2
Credit: 34,537
RAC: 0
Message 19216 - Posted: 12 Jan 2006, 20:27:13 UTC - in response to Message 19215.  

This is not a good number. Since the old WUs were only 72 trickles, the new ones are 120 trickles, and there may be some other different sized ones later. They are not all the same size, so I think that it\'s not a good number.

Plus, there have been some bad released WUs (I had one) that only went so far and failed. These were complete to the point they could be complete, but not finished. I got credit for this WU up to the point it stopped. So, those 24-30 trickles are good, and the data they received for the WU is good, but it\'s not complete.



Yes, I completely agree, just adding together all of them seems stupid. That\'s why I was suggesting displaying the credit due to successful results.



The HASDM ones had(have) a trickle rate of about 94.5 * 72 trickles, the current Sulpher ones have 160.68 * 120. So it does not make sense to count each WU as 1 is not a good idea IMHO. The \"old\" SETI thinking has got to go away. I do not think any project will ever adopt that idea, again.



:)) I\'m not aware of the \"old\" SETI thinking, I have only participated in CPDN.



It seems they do not clear the WUs from your account, so you can always count your own.



What I wanted to point out is that there should be some way to reflect the actual contribution a user has made to the project. Right now, a user can obtain credits, start a new result every once a week due to errors, without providing any useful results to the project at all.

Of course, it\'s ok to let him earn credit for this (it will encourage him to continue), but, I suggest that there should also be a third ranking for seeing how much useful work one has done. Again, I agree, it should rather be CREDITS than NUMBER of successful results.

Regards,
Stefan.
ID: 19216 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 19217 - Posted: 12 Jan 2006, 20:32:05 UTC

I have to agree with Pooh Bear on this.

And there IS a third list: that of Top Computers.
(In which I was doing OK, until I moved sideways to a hidden project. But when the credits finally get transferred to the main stats, some of us are going to get a BIG credit spike. 26.10 credits per trickle, one trickle per model month, 200 years per model.)

ID: 19217 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 19219 - Posted: 12 Jan 2006, 20:41:37 UTC

I think it would be a good thing to be able to see on the userID pages,

Completed slab...
Completed sulphur...
Completed whatever...

followed by the number of runs of each. The number of completed models (even if imperfect because of glitches) was available as a stat (non-rankable) in CPDN Classic for each participant. For some of us with several PCs who have been in it from the start of BOINC, you can\'t readily get this from the Results pages, and it takes forever from the individual PC pages. Also, a \"Total Credits in Completed Runs\" ranking wouldn\'t be bad either.

But while both of those IMO would be nice to have, the likelihood of it happening seems low given project IT people workloads and priorities. No harm in suggesting it though.
ID: 19219 · Report as offensive     Reply Quote
ProfileAnanas
Volunteer moderator

Send message
Joined: 31 Oct 04
Posts: 336
Credit: 3,316,482
RAC: 0
Message 19226 - Posted: 12 Jan 2006, 22:46:42 UTC - in response to Message 19219.  
Last modified: 12 Jan 2006, 22:53:00 UTC

I think it would be a good thing to be able to see on the userID pages,

Completed slab...
Completed sulphur...
Completed whatever...

followed by the number of runs of each. ....


I would like to have that, a full run in CPDN is something special and doesn\'t happen everyday.

The credits do not reflect the full runs as crashed models can have credits too.

(I will hopefully have my first full Sulphur run within the next few days and I\'m already really excited and nervous)
ID: 19226 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 19237 - Posted: 13 Jan 2006, 0:46:38 UTC - in response to Message 19226.  

(I will hopefully have my first full Sulphur run within the next few days and I\'m already really excited and nervous)

Good luck!
ID: 19237 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 19238 - Posted: 13 Jan 2006, 0:47:39 UTC - in response to Message 19226.  

(I will hopefully have my first full Sulphur run within the next few days and I\'m already really excited and nervous)

Good luck!
ID: 19238 · Report as offensive     Reply Quote
ProfilePooh Bear 27
Avatar

Send message
Joined: 5 Feb 05
Posts: 465
Credit: 1,914,189
RAC: 0
Message 19241 - Posted: 13 Jan 2006, 2:25:56 UTC - in response to Message 19219.  

I think it would be a good thing to be able to see on the userID pages,

Completed slab...
Completed sulphur...
Completed whatever...

followed by the number of runs of each. The number of completed models (even if imperfect because of glitches)... (rest of the post deleted)


It\'s sometimes hard to tell if a WU was killed because of being a bad WU or a faulty machine. So the WUs that have crashed would be hard to count.

It is an interesting idea, though.


ID: 19241 · Report as offensive     Reply Quote
old_user21637

Send message
Joined: 28 Sep 04
Posts: 36
Credit: 268,150
RAC: 0
Message 19256 - Posted: 13 Jan 2006, 13:21:52 UTC - in response to Message 19219.  

I think it would be a good thing to be able to see on the userID pages,

Completed slab...
Completed sulphur...
Completed whatever...

followed by the number of runs of each. The number of completed models (even if imperfect because of glitches) was available as a stat (non-rankable) in CPDN Classic for each participant. For some of us with several PCs who have been in it from the start of BOINC, you can\'t readily get this from the Results pages, and it takes forever from the individual PC pages. Also, a \"Total Credits in Completed Runs\" ranking wouldn\'t be bad either.

But while both of those IMO would be nice to have, the likelihood of it happening seems low given project IT people workloads and priorities. No harm in suggesting it though.


Yes, that was what I had in mind (although I thught having a separate stat for slab, sulphur, etc. was too much to ask). Good to see some of you guys feel the same :))

By the way, my previous posts were made using my little brother\'s acount, sorry about that...

Cheers,
Stefan.

ID: 19256 · Report as offensive     Reply Quote
ProfileKeck_Komputers
Avatar

Send message
Joined: 5 Aug 04
Posts: 426
Credit: 2,426,069
RAC: 0
Message 19290 - Posted: 14 Jan 2006, 12:32:45 UTC

I believe that cross project problems will prevent this from being implemented.

I personally think that a count of successful runs makes sense here, but would not work well with other projects.
BOINC WIKI

BOINCing since 2002/12/8
ID: 19290 · Report as offensive     Reply Quote
ProfileAnanas
Volunteer moderator

Send message
Joined: 31 Oct 04
Posts: 336
Credit: 3,316,482
RAC: 0
Message 19397 - Posted: 17 Jan 2006, 19:02:44 UTC
Last modified: 17 Jan 2006, 19:03:53 UTC

It\'s not for scoring, it\'s just for personal enjoyment :-)

*enjoyingfirstsulphurrun*
ID: 19397 · Report as offensive     Reply Quote

Questions and Answers : Wish list : New Ranking Scheme suggestion

©2024 cpdn.org