climateprediction.net (CPDN) home page
Thread 'Most Powerful CPU for CPDN in 2018?'

Thread 'Most Powerful CPU for CPDN in 2018?'

Message boards : Number crunching : Most Powerful CPU for CPDN in 2018?
Message board moderation

To post messages, you must log in.

AuthorMessage
Larfy Hu

Send message
Joined: 15 Apr 16
Posts: 1
Credit: 111,051
RAC: 0
Message 59019 - Posted: 19 Nov 2018, 3:35:55 UTC

Hello,

I would like to build a dedicated CPDN rig (i.e. will run CPDN only, 24/7).

I tried to search for some configuration guides on the forum but the information I found seems to be a bit outdated, so I decided to open up this post to collect some advice.

For me, the budget is not too much of a concern, so I'm basically looking for the most powerful configuration (within a relatively reasonable consumer budget of course, let's say <= USD 2.5k?)

However, I do face a constraint that I will only be allowed to build one physical machine. So although I do understand that in terms of total throughput it may sometimes be better to build two cheaper machines rather than a single expensive one, in my case that is unfortunately not an option of mine.

That said, I'm ok with those server boards that allows for multiple CPUs on one board. Again, as long as it fits into one physical machine I'm good. So basically all I can do is to maximize the total throughput out of a single machine.

From the top host ranking it seems that CPU core count is kinda more important than single thread performance and AMD is not doing badly at all on CPDN?

So in that case, would Ryzen 2990WX be kinda the most powerful consumer-grade CPU for CPDN? But how would it compare to Intel Core i9-7980XE?

And how about comparing them to two server-grade ES CPUs like two EPYC 7551 or two Intel Xeon E5-2699 v4?

I'm trying to make such comparisons as on eBay these configurations seem to have similar prices:

2990WX ~ US $1,704.99
i9-7980XE ~ US $1,600.00
2x EPYC 7551 ~ 2x US $699.00
2x E5-2699 v4 ~ 2x US $846.00

Does anyone have experience with the ES (engineering sample) CPUs from eBay? Do they perform well and are they reliable enough?

Also, in general, may I ask how I should estimate the performance of CPUs on CPDN? What should I look for? Is there a CPU benchmark score similar to that from PassMark that can act as a reasonable estimator for CPDN performances?

Meanwhile, I noticed that memory bandwidth is another thing that is commonly brought up as a performance limiting factor. May I ask how I should take that into account when it comes to CPU selections? Would Ryzen 2950X or other Intel Core ones with higher single thread performance give more total throughput by any chance because of that? What is the threshold that I should start to be concerned with memory bandwidth?

Sorry if I'm asking some very silly questions. I should have done more research to make up for my lack of computer hardware knowledge, but unfortunately I am not able to find enough time for that in the coming weeks and I don't think I can wait until then to start building the rig.

So I would really appreciate some help.

Any advice is warmly welcomed!

Thanks a lot in advance!!!
ID: 59019 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 59020 - Posted: 19 Nov 2018, 5:44:22 UTC

A few things to keep in mind:

1) There are usually only a few hundred to a couple of thousand models released at a time, and there's already thousands of processors waiting to get models.
So a huge cruncher may sit (mostly) idle for weeks.

2) It's recommended that 1.5 to 2 gigs of ram per core is available.

3) It's mostly Windows versions of the models that are used these days.

4) Linux models need 32 bit libraries.

5) This isn't a set and forget project. You need to keep an eye on each of your models to make sure that nothing has started going wrong.
ID: 59020 · Report as offensive     Reply Quote
Profiletullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 59021 - Posted: 19 Nov 2018, 13:34:37 UTC
Last modified: 19 Nov 2018, 13:36:10 UTC

I have been running eight wah2 tasks on my new Windows 10 PC with a Ryzen 5 1400 CPU. Of these 7 have failed but 5 have given me credits all the same.I am running the eighth.
Tullio
ID: 59021 · Report as offensive     Reply Quote
WB8ILI

Send message
Joined: 1 Sep 04
Posts: 161
Credit: 81,522,141
RAC: 1,164
Message 59022 - Posted: 19 Nov 2018, 15:16:44 UTC

Larfy Hu -

You titled this thread "Most Powerful CPU". You probably mean "Most Powerful System" which involves several components - CPU speed (GHz), maximum memory chip transfer rate, bus speed, amount of CPU cache, and maybe others.

What is best for CPDN may or may not be the best for other work (projects).

The word "Most" implies you want to build the world's fastest system for CPDN. I doubt the information exists on how to do that. If a F1 (auto racing) analogy makes any sense to you, you are trying to build a Mercedes or a Ferrari. But even the worst car in F1 is still a really, really fast car.

Go with the fastest memory you can find and a CPU and main board that supports that speed. All other things being equal, go with the largest CPU memory cache.

As Les mentioned, LINUX work is unavailable because most tasks fail. The people in charge are either unable or unwilling to fix this issue.

CPDN work availability is generally sporadic. So you need a backup plan such as World Community Grid (WCG) or your computer will be idle for long periods of time.

CPDN work does not use Graphic Processors (GPU) and neither does WCG. WCG has several Climate Science projects waiting in the wings, if Climate Science is your main or only interest.

If Climate Science is your only interest, I know of no plans anywhere for climate work that uses a GPU, so you don't need the biggest and best graphic card.

These are my thoughts. If others disagree, please comment.
ID: 59022 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 59023 - Posted: 19 Nov 2018, 15:36:51 UTC - in response to Message 59022.  
Last modified: 19 Nov 2018, 16:10:59 UTC

The only thing I would add is that if going for a multi chip system, make sure you have a fast hard disk. The new global models produce over 1GB/day even with only 2 cores active on my laptop which is slow. A fast machine could with these tasks be producing well over 10GB/day and that would just be on 4 cores. If your connection is more bored than broad, don't even think about running those ones!

Edit:Over the years there have been a number of multicore machines dedicated to running cpdn (32 plus cores) that have had very high failure rates and one suspected reason for this is not being able to keep up with the i/o
ID: 59023 · Report as offensive     Reply Quote
Profiletullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 59024 - Posted: 19 Nov 2018, 19:57:35 UTC
Last modified: 19 Nov 2018, 19:59:01 UTC

My newest PC, a HP Omen, has a 128 GB SSD and a 1 TB hard disk.The SSD is not a 2.5" disk like a laptop but a flash memory bolted to the main board.

Tullio
ID: 59024 · Report as offensive     Reply Quote
Helix Von Smelix

Send message
Joined: 31 Aug 04
Posts: 7
Credit: 56,569,239
RAC: 8,275
Message 59025 - Posted: 19 Nov 2018, 21:12:59 UTC

I have found to aim for a "slower" front side bus speed, middle of the option available on a motherboard. exit and shutdown BOINC before a PC restart.
Most failure are from PC re-starts, and too fast settings on the RAM, from my findings.
If I was building a PC now I would buy the AMD threadripper and lots of RAM.
Don't overclock.
ID: 59025 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Jan 06
Posts: 637
Credit: 26,751,529
RAC: 653
Message 59026 - Posted: 19 Nov 2018, 21:47:23 UTC - in response to Message 59025.  

Most failure are from PC re-starts, and too fast settings on the RAM, from my findings.
If I was building a PC now I would buy the AMD threadripper and lots of RAM.
Don't overclock.

Excellent advice. If I had a Threadripper, I think I would start out using full cores by disabling SMT in the motherboard BIOS. That way, you don't overload the memory size or speed requirements. Then, I would enable SMT and start increasing the number of cores to see what effect it has on the speed. It might affect the error rate also.
ID: 59026 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 59030 - Posted: 20 Nov 2018, 2:46:25 UTC

And don't forget that climate modelling relies heavily on floating point maths.
Back near the start, 80 bit floating point was used. I don't know about now.

So there's probably a heavy demand for the fpu as well as well as custom code, and I think that the Intel processors had the edge there.
ID: 59030 · Report as offensive     Reply Quote
Profiletullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 59042 - Posted: 20 Nov 2018, 12:37:41 UTC

A wah2 task ended in 11 days 16 hours and 27 minutes on my Ryzen 5 1400 CPU.
Tullio
ID: 59042 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 59044 - Posted: 20 Nov 2018, 14:44:22 UTC - in response to Message 59042.  

A wah2 task ended in 11 days 16 hours and 27 minutes on my Ryzen 5 1400 CPU.


Doesn't mean a lot without knowing the region, resolution and number of months the task was for. On my admittedly slow laptop, WAH2 tasks on it at the moment vary between about 3 and 8% a day.
ID: 59044 · Report as offensive     Reply Quote
Profiletullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 59062 - Posted: 21 Nov 2018, 13:17:01 UTC - in response to Message 59044.  
Last modified: 21 Nov 2018, 13:19:13 UTC

Global, one month, 12 years
Tullio
ID: 59062 · Report as offensive     Reply Quote
Ba

Send message
Joined: 27 Jan 11
Posts: 7
Credit: 67,315,445
RAC: 6,001
Message 59063 - Posted: 21 Nov 2018, 13:34:02 UTC

My EPYC 7401p rig is current No.1 with over 200k average and this is still going up.
Think that the 8 channel ram is helping.
I'm looking to put a duel EPYC rig together with some sample chips but you need to be careful with the bios versions for the 7551 samples.
ID: 59063 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Jan 06
Posts: 637
Credit: 26,751,529
RAC: 653
Message 59064 - Posted: 21 Nov 2018, 17:05:00 UTC - in response to Message 59063.  

Think that the 8 channel ram is helping.

Something like that will be the wave of the future. The memory speeds just can't keep up with the new CPUs.
ID: 59064 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 59072 - Posted: 22 Nov 2018, 7:15:57 UTC - in response to Message 59064.  

The memory speeds just can't keep up with the new CPUs.


Or even the old ones sometimes. I have a laptop with a Pentium N3540 @ 2.16GHz and a short one month task took over 18 hours something rather than 2 hours less when running alongside 3 global tasks. On this machine running a fourth global task slows the others down by almost 25% so virtually no gain from running four at once.
ID: 59072 · Report as offensive     Reply Quote

Message boards : Number crunching : Most Powerful CPU for CPDN in 2018?

©2024 cpdn.org