climateprediction.net (CPDN) home page
Thread 'Is s/TS a running average...'

Thread 'Is s/TS a running average...'

Message boards : Number crunching : Is s/TS a running average...
Message board moderation

To post messages, you must log in.

AuthorMessage
old_user802

Send message
Joined: 11 Aug 04
Posts: 22
Credit: 273,912
RAC: 0
Message 3923 - Posted: 11 Sep 2004, 18:36:18 UTC

Is s/TS a running average since the beginning of the WU or since the start of the current TS?

ID: 3923 · Report as offensive     Reply Quote
old_user3708

Send message
Joined: 30 Aug 04
Posts: 29
Credit: 35,656
RAC: 0
Message 3932 - Posted: 11 Sep 2004, 21:37:49 UTC

It seems to me that the s/ts measurement is averaged two different ways: as a running average between trickles, and also as a total average for the entire WU. This is only what I've inferred from observation, though, so I couldn't tell you for sure. Carl could probably shed some light on it for us.
ID: 3932 · Report as offensive     Reply Quote
old_user1
Avatar

Send message
Joined: 5 Aug 04
Posts: 907
Credit: 299,864
RAC: 0
Message 3935 - Posted: 11 Sep 2004, 22:14:43 UTC - in response to Message 3932.  

well it's basically a running average, when you see it in the program or on a finished WU it would be the CPU time of the result divided by the maximum timestep reached. But in the "trickle detail" listing it is simply the "running average" up to that trickle point, so it can rise or fall on later trickles etc.
ID: 3935 · Report as offensive     Reply Quote
old_user802

Send message
Joined: 11 Aug 04
Posts: 22
Credit: 273,912
RAC: 0
Message 3941 - Posted: 12 Sep 2004, 0:17:52 UTC - in response to Message 3935.  

That's Carl
ID: 3941 · Report as offensive     Reply Quote
old_user3708

Send message
Joined: 30 Aug 04
Posts: 29
Credit: 35,656
RAC: 0
Message 3953 - Posted: 12 Sep 2004, 4:46:34 UTC
Last modified: 12 Sep 2004, 4:47:00 UTC

Well, at least I was half right :-D

*AMD Athlon XP 3000+ 2.17 Ghz, crunching @ ~2.5 s/ts
*Intel Pentium III 500 Mhz, crunching @ ~10.3 s/ts
ID: 3953 · Report as offensive     Reply Quote
old_user1749

Send message
Joined: 26 Aug 04
Posts: 15
Credit: 75,623
RAC: 0
Message 3969 - Posted: 12 Sep 2004, 15:50:49 UTC

I also have a question on the s/ts.
I have a p4 3.00GHz with HT running 2 models/Wu's and there is a big difference in s/ts:
First wu: between 1.9 s/ts and 2.2s/ts
Second wu: between 3.0 s/ts and 3.3 s/ts

I don't know if this matters but then first wu is running all the time, the second gets pre-empted (but remains in memory), sharing CPU time with seti

Is this normal?
ID: 3969 · Report as offensive     Reply Quote
old_user1
Avatar

Send message
Joined: 5 Aug 04
Posts: 907
Credit: 299,864
RAC: 0
Message 3971 - Posted: 12 Sep 2004, 16:23:20 UTC - in response to Message 3969.  
Last modified: 12 Sep 2004, 16:24:26 UTC

> I also have a question on the s/ts.
> I have a p4 3.00GHz with HT running 2 models/Wu's and there is a big
> difference in s/ts:
> First wu: between 1.9 s/ts and 2.2s/ts
> Second wu: between 3.0 s/ts and 3.3 s/ts
>
> I don't know if this matters but then first wu is running all the time, the
> second gets pre-empted (but remains in memory), sharing CPU time with seti
>
> Is this normal?

It's probably normal if you think about hyperthreading --- two CPDN's running at once are probably really "competing" for memory bandwidth and FPU, but perhaps when it's one cpdn running with one seti there's not as much "competition" for the same resources (probably more so when it's memory bw as I imagine SETI is FPU-intensive! :-)

So when it's 1 CPDN WU running along with 1 SETI WU they "get along" better. I guess to prove this you'd have to see if CPDN WU#1 gets better sec/timstep avg in the intervals when it's running alongside SETI; but when it's two CPDN WU's at once they both are probably 3s/ts.

But this is all nice when you think that we different BOINC projects live in peace and harmony, and these nasty CPDN climate models just fight amongst themselves! ;-)

ID: 3971 · Report as offensive     Reply Quote
ChinookFoehn

Send message
Joined: 7 Aug 04
Posts: 83
Credit: 410,895
RAC: 0
Message 3972 - Posted: 12 Sep 2004, 16:41:29 UTC - in response to Message 3971.  
Last modified: 18 Dec 2004, 8:11:05 UTC

ID: 3972 · Report as offensive     Reply Quote
old_user1749

Send message
Joined: 26 Aug 04
Posts: 15
Credit: 75,623
RAC: 0
Message 4143 - Posted: 15 Sep 2004, 11:03:22 UTC - in response to Message 3971.  

> > I also have a question on the s/ts.
> > I have a p4 3.00GHz with HT running 2 models/Wu's and there is a big
> > difference in s/ts:
> > First wu: between 1.9 s/ts and 2.2s/ts
> > Second wu: between 3.0 s/ts and 3.3 s/ts
> >
> > I don't know if this matters but then first wu is running all the time,
> the
> > second gets pre-empted (but remains in memory), sharing CPU time with
> seti
> >
> > Is this normal?
>
> It's probably normal if you think about hyperthreading --- two CPDN's running
> at once are probably really "competing" for memory bandwidth and FPU, but
> perhaps when it's one cpdn running with one seti there's not as much
> "competition" for the same resources (probably more so when it's memory bw as
> I imagine SETI is FPU-intensive! :-)
>
> So when it's 1 CPDN WU running along with 1 SETI WU they "get along" better.
> I guess to prove this you'd have to see if CPDN WU#1 gets better sec/timstep
> avg in the intervals when it's running alongside SETI; but when it's two CPDN
> WU's at once they both are probably 3s/ts.
>
> But this is all nice when you think that we different BOINC projects live in
> peace and harmony, and these nasty CPDN climate models just fight amongst
> themselves! ;-)
>

Thaks for the reply

I've trying to force the scheduler in doing what I want, but playing with the resource share doesn't help. Any help would be welcome.

What I've been able to do is changing the scheduler period and now there is one CPDN and one Seti running, before that there were 2 seti wu's running:
2 seti wu's: between 3:00 and 3:10/WU (or maybe just short wu)
1 seti to 1 CPDN => seti between 3:30 and 3:40/WU

For now I conclude that CPDN is dominant over seti
ID: 4143 · Report as offensive     Reply Quote
old_user1749

Send message
Joined: 26 Aug 04
Posts: 15
Credit: 75,623
RAC: 0
Message 4192 - Posted: 16 Sep 2004, 13:02:28 UTC
Last modified: 16 Sep 2004, 13:03:02 UTC

Update:

those seti wu were just short wu's, but still, if 2 seti wu are running they get a time close to 3:30, one seti and one cpu get a time close or over 3:40

With the changed scheduler period, now the projects get 4 hours of work before switching and for over 24 hour the scheduler work on one project at a time (4 hours seti then 4 hours CPDN)and the s/ts have remain (very) different:


Latest Trickles For This Host
Result ID | Phase | Timestep |CPU Time (sec)| Average (sec/TS)

139759 | 2 | 64812 | 810458 | 2.5010
201550 | 1 | 54010 | 175261 | 3.2450

ID: 4192 · Report as offensive     Reply Quote
Profileold_user346

Send message
Joined: 6 Aug 04
Posts: 2
Credit: 156,464
RAC: 0
Message 10161 - Posted: 1 Mar 2005, 20:37:16 UTC - in response to Message 3971.  

> > I also have a question on the s/ts.
> > I have a p4 3.00GHz with HT running 2 models/Wu's and there is a big
> > difference in s/ts:
> > First wu: between 1.9 s/ts and 2.2s/ts
> > Second wu: between 3.0 s/ts and 3.3 s/ts
> >
> > I don't know if this matters but then first wu is running all the time,
> the
> > second gets pre-empted (but remains in memory), sharing CPU time with
> seti
> >
> > Is this normal?
>
> It's probably normal if you think about hyperthreading --- two CPDN's running
> at once are probably really "competing" for memory bandwidth and FPU, but
> perhaps when it's one cpdn running with one seti there's not as much
> "competition" for the same resources (probably more so when it's memory bw as
> I imagine SETI is FPU-intensive! :-)
>
> So when it's 1 CPDN WU running along with 1 SETI WU they "get along" better.
> I guess to prove this you'd have to see if CPDN WU#1 gets better sec/timstep
> avg in the intervals when it's running alongside SETI; but when it's two CPDN
> WU's at once they both are probably 3s/ts.
>
> But this is all nice when you think that we different BOINC projects live in
> peace and harmony, and these nasty CPDN climate models just fight amongst
> themselves! ;-)
>
>
>Thanks Carl, that almost answered my own question, or rather one that was asked in our teams forum. http://www.wwseti.net/forum/viewtopic.php?p=51258#51258
ID: 10161 · Report as offensive     Reply Quote

Message boards : Number crunching : Is s/TS a running average...

©2024 cpdn.org