climateprediction.net (CPDN) home page
Thread 'New Work Discussion 2025'

Thread 'New Work Discussion 2025'

Message boards : Number crunching : New Work Discussion 2025
Message board moderation

To post messages, you must log in.

AuthorMessage
Hans Sveen

Send message
Joined: 31 Aug 04
Posts: 7
Credit: 17,818,382
RAC: 1,525
Message 71910 - Posted: 9 Jan 2025, 14:13:24 UTC - in response to Message 71908.  

Hi!
Thank You for the information, so no more windows wus in the near future?
Hans Sveen
Oslo,Norway

ID: 71910 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1067
Credit: 17,020,946
RAC: 5,160
Message 71912 - Posted: 9 Jan 2025, 16:04:25 UTC - in response to Message 71910.  

There are no new Windows based batches currently but no doubt there will be some later in the year.

Linux is the focus for the next batches (which of course you can run on Windows using WSL).
---
CPDN Visiting Scientist
ID: 71912 · Report as offensive     Reply Quote
kotenok2000

Send message
Joined: 22 Feb 11
Posts: 33
Credit: 226,546
RAC: 4,080
Message 71913 - Posted: 9 Jan 2025, 18:57:04 UTC - in response to Message 71912.  

I tried to run open ifs task on wsl1 but it crashed.
ID: 71913 · Report as offensive     Reply Quote
wujj123456

Send message
Joined: 14 Sep 08
Posts: 130
Credit: 44,254,664
RAC: 9,487
Message 71914 - Posted: 9 Jan 2025, 22:54:21 UTC

I wonder if we can unpin the other announcements posts and pin this one. Are the people with the right permissions no longer active on the forum?
ID: 71914 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1121
Credit: 17,202,915
RAC: 2,154
Message 71915 - Posted: 10 Jan 2025, 0:24:22 UTC - in response to Message 71908.  

Also coming up are two OpenIFS (linux) projects. These will be multicore and a high resolution configuration which need more time to get ready. They will also need machines with 64+GB of RAM.


My Linux machine has 128 GB of RAM.

How many cores needed for each work unit? Can I decide this, or do you? If me, how do I set it up?
ID: 71915 · Report as offensive     Reply Quote
AndreyOR

Send message
Joined: 12 Apr 21
Posts: 319
Credit: 15,031,602
RAC: 4,207
Message 71916 - Posted: 10 Jan 2025, 7:33:42 UTC - in response to Message 71913.  

In reply to kotenok2000's message of 9 Jan 2025:
I tried to run open ifs task on wsl1 but it crashed.

WSL1 doesn't have a full Linux kernel like WSL2, that may be the reason. I've successfully run a lot of Linux CPDN and other BOINC projects in WSL2 (Ubuntu). Very much recommend it, relatively easy to set up, uses minimal resources (compared to traditional VMs). With a little extra work you can control WSL2 BOINC client via the Windows BOINC manager.
ID: 71916 · Report as offensive     Reply Quote
ProfileAlan K

Send message
Joined: 22 Feb 06
Posts: 493
Credit: 31,669,049
RAC: 10,904
Message 71917 - Posted: 10 Jan 2025, 23:42:09 UTC - in response to Message 71908.  

Sadly I will have to duck out of these multicore IFS tasks - my computer can only take 32GB RAM. Any other IFS work in the pipeline that will work with this amount of memory?
ID: 71917 · Report as offensive     Reply Quote
alanb1951

Send message
Joined: 31 Aug 04
Posts: 38
Credit: 9,581,380
RAC: 3,853
Message 71918 - Posted: 11 Jan 2025, 6:55:56 UTC - in response to Message 71917.  
Last modified: 11 Jan 2025, 6:57:39 UTC

In reply to Alan K's message of 10 Jan 2025:
Sadly I will have to duck out of these multicore IFS tasks - my computer can only take 32GB RAM. Any other IFS work in the pipeline that will work with this amount of memory?
Seconded regarding smaller tasks! I have several systems that either can't handle more RAM or would require a complete RAM replacement to get past my [previous] standard 32GB choice, but they all coped well with that test task Glenn packaged up a while ago.

I am currently replacing a failed system with a 64GB system with two spare memory slots and 128GB capability, so that one should be able to cope :-) -- the others won't ever be able to do these tasks, and I don't have another replacement needed at present (future failures excepted!...) -- and I was really looking forward to running more OpenIFS tasks...

Cheers - Al.
ID: 71918 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1067
Credit: 17,020,946
RAC: 5,160
Message 71919 - Posted: 11 Jan 2025, 10:43:26 UTC - in response to Message 71917.  

In reply to Alan K's message of 10 Jan 2025:
Sadly I will have to duck out of these multicore IFS tasks - my computer can only take 32GB RAM. Any other IFS work in the pipeline that will work with this amount of memory?
Yes, there might be some lower memory batches. We're still working out the requirements for the projects.

Regarding memory, yes the task actually only takes around 25-27Gb RAM depending on how much output is configured. So if it's a machine not used for anything else that'll be fine. But I was thinking of raising the RAM requirements assuming most PCs running these will also be used for other work at the same time. This isn't set in stone yet, so good to get opinions.
---
CPDN Visiting Scientist
ID: 71919 · Report as offensive     Reply Quote
Vato

Send message
Joined: 4 Oct 19
Posts: 16
Credit: 9,174,915
RAC: 3,722
Message 71920 - Posted: 11 Jan 2025, 10:59:32 UTC - in response to Message 71919.  

I have a number of 32GB machines that would run CPDN dedicated so I would like that option to be available if the model can cope please
ID: 71920 · Report as offensive     Reply Quote
makracz

Send message
Joined: 9 May 24
Posts: 2
Credit: 1,909,752
RAC: 6,044
Message 71921 - Posted: 11 Jan 2025, 21:55:34 UTC - in response to Message 71920.  
Last modified: 11 Jan 2025, 21:56:38 UTC

In reply to Vato's message of 11 Jan 2025:
I have a number of 32GB machines that would run CPDN dedicated so I would like that option to be available if the model can cope please


Would it be technically possible to implement this as an opt-in in user profile settings?
By default, these tasks would only be sent to hosts with 64+ GB of RAM (or however much you decide), but a user could lower the RAM threshold to 32+ GB.
ID: 71921 · Report as offensive     Reply Quote
wujj123456

Send message
Joined: 14 Sep 08
Posts: 130
Credit: 44,254,664
RAC: 9,487
Message 71922 - Posted: 12 Jan 2025, 0:59:11 UTC - in response to Message 71919.  

Given these tasks would be opt-in, I feel so long as we make the expectation clear at the point of opt-in, it shouldn't be an issue to release them to 32GB machines.
ID: 71922 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4558
Credit: 19,039,635
RAC: 18,944
Message 71923 - Posted: 12 Jan 2025, 9:00:19 UTC - in response to Message 71922.  

In reply to wujj123456's message of 12 Jan 2025:
Given these tasks would be opt-in, I feel so long as we make the expectation clear at the point of opt-in, it shouldn't be an issue to release them to 32GB machines.
Not a bad idea. If there were too many chancing it the memory restrictions could be put back in or the maximum number of attempts could be set at 5 rather than 3 if this didn't delay the results coming in from good machines too much.
ID: 71923 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4558
Credit: 19,039,635
RAC: 18,944
Message 71924 - Posted: 12 Jan 2025, 12:16:04 UTC

To keep the announcements thread clear.
ID: 71924 · Report as offensive     Reply Quote
Robert Thomas Wyatt

Send message
Joined: 22 Nov 04
Posts: 3
Credit: 49,246
RAC: 0
Message 71969 - Posted: 21 Mar 2025, 2:12:25 UTC - in response to Message 71908.  

Not sure where to ask this question, but will we see projects for Darwin/MacOS again? Would love to contribute some time again!
ID: 71969 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4558
Credit: 19,039,635
RAC: 18,944
Message 71970 - Posted: 21 Mar 2025, 8:29:02 UTC - in response to Message 71969.  

In reply to Robert Thomas Wyatt's message of 21 Mar 2025:
Not sure where to ask this question, but will we see projects for Darwin/MacOS again? Would love to contribute some time again!
There may be occasional batches of HADCM3S tasks. The issue is the recent iterations of Macs not supporting 32 bit working so these will only work on older kit. I don't know if there is an equivalent of the installing 32bit libraries on Linux. If there is, it is I suspect only ever going to be an option for those with a greater understanding of the OS as I am sure it wouldn't have Apple support. The other possibility is the OIFS code being ported for running on MacOS. I certainly would not rule this out in the longer term but it certainly isn't a priority right now. OIFS is 64 bit so not affected.

I can't remember which other projects are affected but I know there are at least two others using older 32bit code requiring 32bit libraries that don't exist.

Sorry I can't offer anything more hopeful at the moment.
ID: 71970 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1067
Credit: 17,020,946
RAC: 5,160
Message 71973 - Posted: 24 Mar 2025, 11:10:42 UTC - in response to Message 71970.  

There won't be any native macOS tasks for the foreseeable future. The problem is in maintaining codes to work across 3 operating systems; Windows/Linux/macOS. CPDN doesn't currently have resources available to achieve it.

Running a linux or Windows virtual machine on macOS to run CPDN tasks is perfectly feasible, even if it doesn't take full advantage of the powerful Apple chips.
---
CPDN Visiting Scientist
ID: 71973 · Report as offensive     Reply Quote
Robert Thomas Wyatt

Send message
Joined: 22 Nov 04
Posts: 3
Credit: 49,246
RAC: 0
Message 71974 - Posted: 25 Mar 2025, 0:41:51 UTC - in response to Message 71973.  

Thank you for the quick response! It's unfortunate but I understand. I'm able to contribute to five other BOINC projects right now, some do require Rosetta, but it only supports Intel Mac code. I wonder how difficult it is to contribute time to helping port your projects, is there a thread for this?
ID: 71974 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1067
Credit: 17,020,946
RAC: 5,160
Message 71975 - Posted: 26 Mar 2025, 9:24:24 UTC - in response to Message 71974.  

In reply to Robert Thomas Wyatt's message of 25 Mar 2025:
Thank you for the quick response! It's unfortunate but I understand. I'm able to contribute to five other BOINC projects right now, some do require Rosetta, but it only supports Intel Mac code. I wonder how difficult it is to contribute time to helping port your projects, is there a thread for this?
If you have the right expertise I can talk to CPDN about the possibility. There might be licensing issues with some of the code, I'm not sure.

To help you'd need to have a good working knowledge of C++ (fortran would be a plus), linux & macOS, git, Makefiles & building software on multiple platforms. It would be hands-on work.
---
CPDN Visiting Scientist
ID: 71975 · Report as offensive     Reply Quote
Robert Thomas Wyatt

Send message
Joined: 22 Nov 04
Posts: 3
Credit: 49,246
RAC: 0
Message 71976 - Posted: 28 Mar 2025, 17:25:33 UTC - in response to Message 71975.  

I don't have that expertise. Only have experience in helping to package fink projects. Kind regards.
ID: 71976 · Report as offensive     Reply Quote

Message boards : Number crunching : New Work Discussion 2025

©2025 cpdn.org