climateprediction.net (CPDN) home page
Thread 'Does CPDN support MultiCore per Task'

Thread 'Does CPDN support MultiCore per Task'

Message boards : Number crunching : Does CPDN support MultiCore per Task
Message board moderation

To post messages, you must log in.

AuthorMessage
Yeti

Send message
Joined: 5 Aug 04
Posts: 178
Credit: 18,745,357
RAC: 45,842
Message 67411 - Posted: 7 Jan 2023, 14:17:52 UTC

Hi,

I got the info, that I can run CPDN under Linux with MultipeCores (MT). How can I configure this ?

Thanks in Advance
Supporting BOINC, a great concept !
ID: 67411 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,013,957
RAC: 21,195
Message 67412 - Posted: 7 Jan 2023, 14:48:33 UTC - in response to Message 67411.  

Hi,

I got the info, that I can run CPDN under Linux with MultipeCores (MT). How can I configure this ?

Thanks in Advance
No need to configure anything. But you need to wait. Multi core tasks will be coming out probably later this year. See some of the discussions on OpenIFS tasks.
ID: 67412 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 67413 - Posted: 7 Jan 2023, 14:53:03 UTC - in response to Message 67411.  

I got the info, that I can run CPDN under Linux with MultipeCores (MT). How can I configure this ?


I run CPDN with Red Hat Enterprise Linux release 8.7 (Ootpa)

The only tasks I have ever run using Multple Cores were MilkyWay ones.
My app_config.xml file for MilkyWay looks like this. The only reason for the app_version part was to limit it to running only 4 cpus at a time. I think the default was to use 8 or more (I forget the exact number). So if you are willing to accept defaults, you do not need to do anything to configure this.

Now if Oifs distributes multiple core applications, it might, or might not, require a different setup. It depends on how they implement the multiple-core applications.

[/var/lib/boinc/projects/milkyway.cs.rpi.edu_milkyway]$ cat app_config.xml 
<app_config>
    <project_max_concurrent>2</project_max_concurrent>
<app_version>
      <app_name>milkyway_nbody</app_name>
      <plan_class>mt</plan_class>
      <avg_ncpus>4</avg_ncpus>
   </app_version>
</app_config>

ID: 67413 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,432,494
RAC: 17,331
Message 67414 - Posted: 7 Jan 2023, 15:49:45 UTC - in response to Message 67411.  

Hi,
I got the info, that I can run CPDN under Linux with MultipeCores (MT). How can I configure this ?
Thanks in Advance
As Dave has already said there are plans for a multi-core OpenIFS app (not the current Hadley Centre models). I have a working version of the app in testing but there have been some issues getting it to work correctly across different machines, so for the time being it's still in development.
ID: 67414 · Report as offensive     Reply Quote
Yeti

Send message
Joined: 5 Aug 04
Posts: 178
Credit: 18,745,357
RAC: 45,842
Message 67465 - Posted: 9 Jan 2023, 17:44:56 UTC - in response to Message 67414.  

As Dave has already said there are plans for a multi-core OpenIFS app (not the current Hadley Centre models). I have a working version of the app in testing but there have been some issues getting it to work correctly across different machines, so for the time being it's still in development.

I have already helped testing Atlas@Home in Alpha- and Development stage, if you are interested, you can use my machines (Ubuntu 22.04) for further testing. PM me if needed, I would be glad to help.
Supporting BOINC, a great concept !
ID: 67465 · Report as offensive     Reply Quote
kotenok2000

Send message
Joined: 22 Feb 11
Posts: 32
Credit: 226,546
RAC: 4,080
Message 67711 - Posted: 14 Jan 2023, 16:13:36 UTC - in response to Message 67465.  

How will ram usage scale with 8 threads compared to 8 workunits?
ID: 67711 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,013,957
RAC: 21,195
Message 67715 - Posted: 14 Jan 2023, 17:16:11 UTC - in response to Message 67711.  

How will ram usage scale with 8 threads compared to 8 workunits?
Same memory needed. I can't remember where but Glen has posted this answer somewhere on the forums. I suspect that the handling of the multicore aspect will add a slight overhead but nothing significant.
ID: 67715 · Report as offensive     Reply Quote
AndreyOR

Send message
Joined: 12 Apr 21
Posts: 317
Credit: 14,831,845
RAC: 19,903
Message 67741 - Posted: 15 Jan 2023, 11:40:25 UTC - in response to Message 67711.  
Last modified: 15 Jan 2023, 11:42:20 UTC

How will ram usage scale with 8 threads compared to 8 workunits?

If I remember correctly, the most demanding OIFS model that's planned to be released is going to be a 4-core (set, not adjustable), 22GB RAM (total). There's also going to be an intermediate app which I don't remember the planned requirements for. Glenn is still working on those so the final requirements may change and they're probably a few months away from being released.
ID: 67741 · Report as offensive     Reply Quote

Message boards : Number crunching : Does CPDN support MultiCore per Task

©2024 cpdn.org