I was under the impression credit was handed out weekly, and in the past I've seen my score jump up once a week. In trying to determine what day of the week that was, I checked the stats here: https://www.boincstats.com/stats/2/project/detail/lastDays But this shows credit being added almost every day. I have also finished a task about 5 days ago, but it shows zero credit, even though it also says valid: https://www.cpdn.org/results.php?hostid=1539015&offset=0&show_names=0&state=4&appid= Can somebody explain?

I was under the impression credit was handed out weekly, and in the past I've seen my score jump up once a week. In trying to determine what day of the week that was, I checked the stats here: https://www.boincstats.com/stats/2/project/detail/lastDays But this shows credit being added almost every day. I have also finished a task about 5 days ago, but it shows zero credit, even though it also says valid: https://www.cpdn.org/results.php?hostid=1539015&offset=0&show_names=0&state=4&appid= Can somebody explain?

Usually the credit script completes sometime Saturday afternoon/evening according to my recent experience. Certainly that is when my credit jumps have all occurred.

Why does my link to Boincstats show the credit going up so often then?

Why does my link to Boincstats show the credit going up so often then?

I have no idea. I never look there. I can only go by when the credit goes up on my CPDN account.

I've asked over there: https://www.boincstats.com/forum/7/12894,1#154599

I was under the impression credit was handed out weekly, and in the past I've seen my score jump up once a week. In trying to determine what day of the week that was, I checked the stats here: https://www.boincstats.com/stats/2/project/detail/lastDays But this shows credit being added almost every day. I have also finished a task about 5 days ago, but it shows zero credit, even though it also says valid: https://www.cpdn.org/results.php?hostid=1539015&offset=0&show_names=0&state=4&appid= Can somebody explain?


Usually the credit script completes sometime Saturday afternoon/evening according to my recent experience. Certainly that is when my credit jumps have all occurred.

On the CPDN web site, my credits go up whenever they are earned (and pass validation).
In the distant past, Boincstats increased once a week, usually Saturday or Sunday (when I notice them, not necessarily when they first appear).

Now lately I got credit for a huge number of tasks all at once, -- about 6 million credits, and they appeared immediately on the CPDN web site, and soon thereafter on the Boincmanager Projects screen, so some of these services seem to be finding out about the new credits. But the Boincstats screen, which will appear below, is way way low. Much more behind than just a week or so now.

Is this a problem with Boincstats or CPDN?

---

I was under the impression credit was handed out weekly, and in the past I've seen my score jump up once a week. In trying to determine what day of the week that was, I checked the stats here: https://www.boincstats.com/stats/2/project/detail/lastDays But this shows credit being added almost every day. I have also finished a task about 5 days ago, but it shows zero credit, even though it also says valid: https://www.cpdn.org/results.php?hostid=1539015&offset=0&show_names=0&state=4&appid= Can somebody explain?

Some time ago, Andy changed the script on the testing site to test it. The intention always was to roll the new credit script out to the main site. Clearly he has now done that. Probably at the same time as doing the upgrade to the BOINC server version.

Unusually, I don't recall seeing an email about this but I could have missed it or not read it fully.

Even if a project shows updated credits (users, hosts, teams) on it's own website, external stats pages usually try to download them from certain locations.
In case of CPDN this should be:
https://www.cpdn.org/stats/user.gz
https://www.cpdn.org/stats/host.gz
https://www.cpdn.org/stats/team.gz

What you get here are 3 files with this content:

bad URL

It looks like that reply is generated on the fly by a script.
If so, you may need to copy the real stats files to the correct server location and disable the script.

Usually the credit script completes sometime Saturday afternoon/evening according to my recent experience. Certainly that is when my credit jumps have all occurred.

Two of my tasks completed this morning. Another one should complete tomorrow morning. And the last one I have should complete in about a week. The credit the completed onesI will receive are shown already.

Computing
Total credit 	16,122,716
Recent average credit 	64,189.32

22318271 	12139315 	21 May 2023, 3:25:25 UTC 	31 May 2023, 15:06:07 UTC 	Completed 	903,640.12 	893,050.70 	33,854.34 	UK Met Office HadAM4 at N216 resolution v8.52 i686-pc-linux-gnu
22318255 	12138767 	21 May 2023, 2:24:44 UTC 	31 May 2023, 13:24:01 UTC 	Completed 	900,943.67 	890,380.70 	33,854.34 	UK Met Office HadAM4 at N216 resolution v8.52 i686-pc-linux-gnu

Normally, I would expect these credits to appear this coming Sunday or Monday on Boinkstats but so far only a bunch on April 21 has appeared on their web site and no more since then.

---

What you get here are 3 files with this content:

bad URL

It looks like that reply is generated on the fly by a script.
If so, you may need to copy the real stats files to the correct server location and disable the script.

Up to a point. The files expected by the external sites are generated from the internal database by a standard BOINC server tool - db_dump, now documented at https://github.com/BOINC/boinc/wiki/DbDump (all the documentation has moved recently). I'd suggest that either the program hasn't been configured to run on the new server yet, or the final locations haven't been created yet.

But it would still be wise to get to the bottom of the mysterious doubling of the existing stats before exposing them to the world.

What you get here are 3 files with this content:

bad URL

It looks like that reply is generated on the fly by a script.
If so, you may need to copy the real stats files to the correct server location and disable the script.

Up to a point. The files expected by the external sites are generated from the internal database by a standard BOINC server tool - db_dump, now documented at https://github.com/BOINC/boinc/wiki/DbDump (all the documentation has moved recently). I'd suggest that either the program hasn't been configured to run on the new server yet, or the final locations haven't been created yet.

But it would still be wise to get to the bottom of the mysterious doubling of the existing stats before exposing them to the world.

Richard can your take a 2nd try with the URL .... ?

Thanks
Bill F

Richard can your take a 2nd try with the URL .... ?

Thanks
Bill F

In the general scheme of things, the generic '/stats/' folder is open for public scrutiny - see, for example, https://numberfields.asu.edu/NumberFields/stats/: you can see the size and datestamp of the individual files. That gives the first clue as to how often a project is generating the raw data for the external analysis sites to use. They still have to download, unpack, and process the raw data: that takes time, and each site has its own timetable for doing that. Users can even do it for themselves, but it takes a lot of time, disk space and database grunt. I've done it, but it's not recommended.

Other projects, like Einstein, take a much stricter interpretation of user privacy and the GDPR. They limit access to machines which have been pre-authorised as having a genuine purpose for requiring the data.

But here (currently) the folder seems simply not to exist - let alone the files which would normally live in it. Only the project staff can explain that.

But here (currently) the folder seems simply not to exist - let alone the files which would normally live in it. Only the project staff can explain that.

This shows it's been unavailable for just over a month:
https://www.boincstats.com/stats/2/project/detail/

Last update user XML	2023-05-01 19:00:17 UTC (33 days 18:34:07 old)
Last update host XML	2023-04-30 18:50:17 UTC (34 days 18:44:07 old)
Last update team XML	2023-05-01 19:00:17 UTC (33 days 18:34:07 old)

For some reason the host XML disappeared first?

But here (currently) the folder seems simply not to exist - let alone the files which would normally live in it. Only the project staff can explain that.

This shows it's been unavailable for just over a month:
https://www.boincstats.com/stats/2/project/detail/

Last update user XML	2023-05-01 19:00:17 UTC (33 days 18:34:07 old)
Last update host XML	2023-04-30 18:50:17 UTC (34 days 18:44:07 old)
Last update team XML	2023-05-01 19:00:17 UTC (33 days 18:34:07 old)

For some reason the host XML disappeared first?

Unless CPDN is exporting to a different location the time stamps above show that CPDN is not exporting Credit Stat's Daily or even Weekly. Most Projects Export Daily and the information contained is updated on a time line set up by those who write the Scripts.

Bill F

Unless CPDN is exporting to a different location the time stamps above show that CPDN is not exporting Credit Stat's Daily or even Weekly. Most Projects Export Daily and the information contained is updated on a time line set up by those who write the Scripts.

Correct. My guess is that it wont be started again till the issue with stats having doubled is resolved.

Unless CPDN is exporting to a different location the time stamps above show that CPDN is not exporting Credit Stat's Daily or even Weekly. Most Projects Export Daily and the information contained is updated on a time line set up by those who write the Scripts.

Correct. My guess is that it wont be started again till the issue with stats having doubled is resolved.

Dave it has been another six weeks and we are now past 114 days without an export of stat's. I know that you have suspected that everything is hinging on the internal credit problem and it may be. But the amount of time that has passed is getting a little silly and is now someone should be slightly embarrassed.

Last update user XML 2023-05-01 19:00:17 UTC (114 days 19:39:23 old)
Last update host XML 2023-04-30 18:50:17 UTC (115 days 19:49:23 old)
Last update team XML 2023-05-01 19:00:17 UTC (114 days 19:39:23 old)

Can you bump the bucket and or stir the pot ?

Thanks
Bill F

Dodgy credit is better than no credit. We don't care if it's not accurate. Plenty projects have uneven credit, like GPU/CPU projects where the CPU only people can't hope to compete.

I've emailed Andy to remind him. Part of the delay is due to CPDN folk taking summer leave.

Unless CPDN is exporting to a different location the time stamps above show that CPDN is not exporting Credit Stat's Daily or even Weekly. Most Projects Export Daily and the information contained is updated on a time line set up by those who write the Scripts.

Correct. My guess is that it wont be started again till the issue with stats having doubled is resolved.

Dave it has been another six weeks and we are now past 114 days without an export of stat's. I know that you have suspected that everything is hinging on the internal credit problem and it may be. But the amount of time that has passed is getting a little silly and is now someone should be slightly embarrassed.

Last update user XML 2023-05-01 19:00:17 UTC (114 days 19:39:23 old)
Last update host XML 2023-04-30 18:50:17 UTC (115 days 19:49:23 old)
Last update team XML 2023-05-01 19:00:17 UTC (114 days 19:39:23 old)

Can you bump the bucket and or stir the pot ?

Thanks
Bill F

It will be looked at next week when Andy is back from a break.

It looks as though the credit script has run and the extra points have been released to the stats sites.

For the next 60 days my totals are going to look very small on the charts :-)