climateprediction.net (CPDN) home page
Thread 'Off topic posts.'

Thread 'Off topic posts.'

Message boards : Cafe CPDN : Off topic posts.
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · Next

AuthorMessage
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4537
Credit: 19,001,532
RAC: 21,726
Message 66039 - Posted: 3 Sep 2022, 6:37:04 UTC

I accept it is very easy to post something one finds interesting that is related at least in one's own mind to a discussion thread. However as has been noted, this can very quickly make it difficult to follow the actual topic in a thread. I am going to be stricter both with myself and others. So if as a community we don't improve our discipline in what we post, expect to see a lot of posts moving here.
ID: 66039 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,432,494
RAC: 17,331
Message 66484 - Posted: 16 Nov 2022, 20:50:52 UTC - in response to Message 66481.  

Way back when I first started, running Linux with a two-processor, 4 thread machine running at 3.06GHz, we had CPDN tasks that took several months to run. Luckily we did not have to worry about rebooting in those days. The CPDN work units would resume from where they left off (perhaps, since the most recent checkpoint?).
That would have been the multi-year climate runs. Unfortunately the complexity of today's climate models puts them beyond the capabilities of even the most powerful home PCs, for the kind of research that scientists need to do with them that is.
ID: 66484 · Report as offensive     Reply Quote
AndreyOR

Send message
Joined: 12 Apr 21
Posts: 317
Credit: 14,816,935
RAC: 19,934
Message 66486 - Posted: 16 Nov 2022, 22:10:15 UTC - in response to Message 66484.  

That would have been the multi-year climate runs. Unfortunately the complexity of today's climate models puts them beyond the capabilities of even the most powerful home PCs ...

Hmmm, and here I and probably others thought that our home PCs are these amazing "home beasts" capable of running complex weather models multiple models at a time. :-) It seems like the complexity of the models far outpaced the capabilities of even HEDTs which wasn't even a category of home PCs until some years ago. Thanks for that comment to help us see the bigger picture Glenn. :-)
ID: 66486 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,432,494
RAC: 17,331
Message 66487 - Posted: 16 Nov 2022, 22:22:20 UTC - in response to Message 66486.  

That would have been the multi-year climate runs. Unfortunately the complexity of today's climate models puts them beyond the capabilities of even the most powerful home PCs ...
Hmmm, and here I and probably others thought that our home PCs are these amazing "home beasts" capable of running complex weather models multiple models at a time. :-) It seems like the complexity of the models far outpaced the capabilities of even HEDTs which wasn't even a category of home PCs until some years ago. Thanks for that comment to help us see the bigger picture Glenn. :-)
Ah, there's a difference between what you call 'weather models' like OpenIFS and what I'm calling 'climate models' that are used for multi-annual & multi-century simulations that contribute to government climate policy. Home PCs are indeed very powerful, more powerful than the Cray-1 I used to use many years ago. But climate models are much bigger beasts than weather models. Not only do they include sub-models for the atmosphere, ocean/lakes, land & sea ice like weather models, they also include atmospheric chemistry, dynamic vegetation, river-runoff sub-models, with sophisticated parallel I/O code that includes integrated data processing to handle the sheer volume of data coming out of these models. There's a nice graphic on this page if you are interested.

Don't get me wrong though, there's still plenty of interesting research you can do with utilizing weather models on home PCs that contributes to understanding and improving the bigger climate models.
ID: 66487 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66488 - Posted: 17 Nov 2022, 3:53:47 UTC - in response to Message 66479.  
Last modified: 17 Nov 2022, 3:56:27 UTC

The project I'm most closely associated with wanted to put out 125,000 OpenIFS tasks, but a quick calculation showed it would be nearly Christmas before we had 80% back. The scientist doing the work has a contract that finishes in Feb 2023 and needs analysis done by end of the year in order to write reports/papers/etc. So we've had to compromise and will probably only put out ~60,000. But we'll watch the return rate and if we think more can be done in time, they will get sent out.
Pity the virtualbox windows thing isn't running yet, then we'd get them all done.

That would have been the multi-year climate runs. Unfortunately the complexity of today's climate models puts them beyond the capabilities of even the most powerful home PCs, for the kind of research that scientists need to do with them that is.
I take it they can't be split into a thousand pieces and we all run a bit at once?

Ah, there's a difference between what you call 'weather models' like OpenIFS and what I'm calling 'climate models' that are used for multi-annual & multi-century simulations that contribute to government climate policy.
The government listening to scientists! C|N>K! No, they do what they can make money out of. That's why they give you guys so little funding, then draw conclusions that suit themselves.
ID: 66488 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,432,494
RAC: 17,331
Message 66493 - Posted: 17 Nov 2022, 10:16:26 UTC - in response to Message 66488.  

That would have been the multi-year climate runs. Unfortunately the complexity of today's climate models puts them beyond the capabilities of even the most powerful home PCs, for the kind of research that scientists need to do with them that is.
I take it they can't be split into a thousand pieces and we all run a bit at once?
Good question, been thought about before. The starting fields for year N depend on the results of year N-1, so it's not easy to do. People have thought about applying time parallel algorithms but that's a whole new thread.

Ah, there's a difference between what you call 'weather models' like OpenIFS and what I'm calling 'climate models' that are used for multi-annual & multi-century simulations that contribute to government climate policy.
The government listening to scientists! No, they do what they can make money out of. That's why they give you guys so little funding, then draw conclusions that suit themselves.
Rubbish. I spent 20yrs in the university sector doing research, managing grants and international projects. That's not how it works at all. I suggest you read about the work of the WCRP. Those comments are typicaI from people with no direct experience of the sector. I'll leave it there.
ID: 66493 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66494 - Posted: 17 Nov 2022, 10:55:31 UTC - in response to Message 66480.  

CPDN also is the only project I know that uses trickles (they may even have asked for that facility specially), and awards intermediate credit at each trickle. That leaves the user with some concrete record of achievement, even if the task subsequently fails.
I know Primegrid does trickle ups with genefer extreme, because they extend the deadline if you're making reasonable progress. Although they don't do so with the credit (like that matters).
ID: 66494 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66495 - Posted: 17 Nov 2022, 11:00:39 UTC - in response to Message 66493.  
Last modified: 17 Nov 2022, 11:02:46 UTC

Rubbish. I spent 20yrs in the university sector doing research, managing grants and international projects. That's not how it works at all. I suggest you read about the work of the WCRP. Those comments are typicaI from people with no direct experience of the sector. I'll leave it there.
We all know the government makes daft decisions on the environment. You can't deny the lack of funding to your scientists, you've mentioned it earlier in this very thread. If there was enough funding, you wouldn't have to be farming out the computing to unpaid volunteers. They subsidise things in stupid ways, they want us to use electric vehicles which don't save us any money and involve mining (in a very dangerous way) a yet unrecyclable Lithium, and use electricity which comes from gas burning power stations. Electric vehicles do more harm to the environment than petrol cars. I have 0.000% faith in anything a government does, but I continue to support scientists so at least someone knows what's best, even if it's not carried out for some time.
ID: 66495 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,700,823
RAC: 9,977
Message 66496 - Posted: 17 Nov 2022, 11:07:00 UTC - in response to Message 66494.  

There are many features in BOINC, like the locality scheduler written by Bruce Allen for Einstein, which were created to meet the specific needs of a single project. But once they've been added, they're freely available for any project to use.

Peter, you don't have to have the last word on everything. Get off your soapbox, and go and start reading up on your homework.
ID: 66496 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4537
Credit: 19,001,532
RAC: 21,726
Message 66497 - Posted: 17 Nov 2022, 11:10:13 UTC

If you wish to debate the politics of this, please start a separate thread in the appropriate section.
ID: 66497 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66498 - Posted: 17 Nov 2022, 11:14:15 UTC - in response to Message 66496.  

There are many features in BOINC, like the locality scheduler written by Bruce Allen for Einstein, which were created to meet the specific needs of a single project. But once they've been added, they're freely available for any project to use.

Peter, you don't have to have the last word on everything. Get off your soapbox, and go and start reading up on your homework.
What's your problem today? Nothing I wrote is incorrect, but you said only CPDN used trickle ups.
ID: 66498 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66499 - Posted: 17 Nov 2022, 11:15:03 UTC - in response to Message 66497.  

If you wish to debate the politics of this, please start a separate thread in the appropriate section.
Neither me or Glenn wishes to debate it. We can't very well make a new thread for every single branch of a conversation. Welcome to the English language.
ID: 66499 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 1061
Credit: 36,700,823
RAC: 9,977
Message 66500 - Posted: 17 Nov 2022, 11:44:25 UTC - in response to Message 66498.  

... but you said only CPDN used trickle ups.
False. I said "CPDN also is the only project I know ..." - it was a statement of my personal knowledge only.
ID: 66500 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66501 - Posted: 17 Nov 2022, 11:48:19 UTC - in response to Message 66500.  

... but you said only CPDN used trickle ups.
False. I said "CPDN also is the only project I know ..." - it was a statement of my personal knowledge only.
And I was adding to your knowledge.
ID: 66501 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66502 - Posted: 17 Nov 2022, 11:49:34 UTC - in response to Message 66039.  
Last modified: 17 Nov 2022, 11:51:46 UTC

I accept it is very easy to post something one finds interesting that is related at least in one's own mind to a discussion thread. However as has been noted, this can very quickly make it difficult to follow the actual topic in a thread. I am going to be stricter both with myself and others. So if as a community we don't improve our discipline in what we post, expect to see a lot of posts moving here.
Natürlich mein Führer

And I see you didn't dare to move Glenn's post.
ID: 66502 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4537
Credit: 19,001,532
RAC: 21,726
Message 66503 - Posted: 17 Nov 2022, 12:15:39 UTC - in response to Message 66502.  

And I see you didn't dare to move Glenn's post.


I had to take a break to answer the phone. I may move some more. George started the new thread because too many discussions were nothing or little to do with new CPDN work making it difficult for anyone new to find what might be important. I or other moderators may move more after discussions.
ID: 66503 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66504 - Posted: 17 Nov 2022, 12:41:39 UTC - in response to Message 66503.  

And I see you didn't dare to move Glenn's post.
I had to take a break to answer the phone. I may move some more. George started the new thread because too many discussions were nothing or little to do with new CPDN work making it difficult for anyone new to find what might be important. I or other moderators may move more after discussions.
ROFL, you moved the scientist's post. Time for you two to have a fisticuffs.
ID: 66504 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,432,494
RAC: 17,331
Message 66505 - Posted: 17 Nov 2022, 16:32:15 UTC - in response to Message 66503.  

And I see you didn't dare to move Glenn's post.
I had to take a break to answer the phone. I may move some more. George started the new thread because too many discussions were nothing or little to do with new CPDN work making it difficult for anyone new to find what might be important. I or other moderators may move more after discussions.
Dave has moved & hidden my posts before for being in the wrong place. Fine by me. These forums are a valuable source of information but not if they are cluttered by off-topic messages.
ID: 66505 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 66507 - Posted: 17 Nov 2022, 18:37:15 UTC - in response to Message 66505.  

Dave has moved & hidden my posts before for being in the wrong place. Fine by me. These forums are a valuable source of information but not if they are cluttered by off-topic messages.
You're a very bad boy, don't do it again!
ID: 66507 · Report as offensive     Reply Quote
ProfileTiggus

Send message
Joined: 19 Dec 05
Posts: 6
Credit: 2,011,429
RAC: 0
Message 68409 - Posted: 21 Feb 2023, 17:44:58 UTC - in response to Message 68386.  

I have not been given any modules for over a year. Is it possible to add me to volunteer list and push files to me?
ID: 68409 · Report as offensive     Reply Quote
1 · 2 · 3 · Next

Message boards : Cafe CPDN : Off topic posts.

©2024 cpdn.org