climateprediction.net (CPDN) home page
Thread 'HadCM3s post-completion artifacts'

Thread 'HadCM3s post-completion artifacts'

Message boards : Number crunching : HadCM3s post-completion artifacts
Message board moderation

To post messages, you must log in.

Previous · 1 · 2

AuthorMessage
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 52463 - Posted: 23 Aug 2015, 21:13:03 UTC - in response to Message 52462.  

Lots of people do indeed run multicore computers, with several models. (It's generally recommended that these models work best when there's 1 Gig of ram per model, plus 1 more for the OS. A bit overkill perhaps, but as a rough rule of thumb ...)

My two machines have 4 real processors, plus 4 hyperthreading. I only run 4 cores, as the others don't give that much extra, and I'm hoping that it leaves something for the OS when it needs it. (With 16 Gig of ram.)
This worked OK for around 8-9 years with Windows, and now with Linux.

There are several Macs with 24 processors that I've come across, and they seem to run OK.

Have you made a simplified post, similar to your original post here, on BOINC/dev? Perhaps some of the people who frequent that forum may have a clue.


ID: 52463 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Jan 06
Posts: 637
Credit: 26,751,529
RAC: 653
Message 52464 - Posted: 24 Aug 2015, 0:53:51 UTC - in response to Message 52453.  

Regarding the antivirus, I had already disabled scanning of the \ProgramData\BOINC folder but just now excluded the \Program Files\BOINC folder as well.

I have had bad experiences with AVs, and generally avoid them. The machine where I run CPDN is a dedicated machine that runs only BOINC, so I don't have an AV installed there at all. I have found that the exclusions don't always work, because on some AVs they exclude the files only from the AV scans, but not from the "real time protection", which is the main culprit. Can you try disabling it to see if it makes a difference? Also, if BOINC is installed as a service, there is a User listed as "BOINC Master" that I would exclude also.

Also, I don't see your version of BOINC or OS listed. It should not matter, but maybe it does.

To answer your other question, I run 6 Ivy Bridge cores on CPDN, and two more supporting GPUs (GTX 750 Ti). I don't think that matters, but I don't recall running all 8 cores on CPDN.
ID: 52464 · Report as offensive     Reply Quote
Harri Liljeroos

Send message
Joined: 9 Dec 05
Posts: 116
Credit: 12,547,934
RAC: 2,738
Message 52466 - Posted: 24 Aug 2015, 7:30:45 UTC

Please note that the Resource Monitor software keeps showing information about the software for quite some time even if you have closed the program. You can check this with a program that is easy to recognize on the list, like Excel. For me the line for Excel is still visible on the Memory section for about a minute after I have closed it.

To view actual running programs I use Task Managers Processes tab.
ID: 52466 · Report as offensive     Reply Quote
ProfileAlan K

Send message
Joined: 22 Feb 06
Posts: 491
Credit: 31,036,409
RAC: 14,604
Message 52471 - Posted: 24 Aug 2015, 15:49:23 UTC - in response to Message 52463.  

I have a simiar experience on usage compared to Les in that I am running 4 cores and using about 4Gb of memory. Is it a quirk of Win8.1 as I am running Win7 (64bit pro)?
ID: 52471 · Report as offensive     Reply Quote
SAK

Send message
Joined: 21 Jul 15
Posts: 8
Credit: 575,541
RAC: 0
Message 52472 - Posted: 24 Aug 2015, 17:13:44 UTC - in response to Message 52464.  

First, thanks all for the suggestions and comments!

Lots of people do indeed run multicore computers, with several models. (It's generally recommended that these models work best when there's 1 Gig of ram per model, plus 1 more for the OS. A bit overkill perhaps, but as a rough rule of thumb ...)

At 24GB, that gives me 2GB per model plus about 8GB for the OS/other processes so I would think I would be OK. After a reboot, when I start BOINC and everything kicks in to high gear, I am using 4-5GB total. As expected, that slowly creeps up the longer the models run, but when they complete instead of seeing a drop in memory usage, I see a big jump as the next set of models start up.

My two machines have 4 real processors, plus 4 hyperthreading. I only run 4 cores, as the others don't give that much extra, and I'm hoping that it leaves something for the OS when it needs it. (With 16 Gig of ram.)
This worked OK for around 8-9 years with Windows, and now with Linux.

Similar to my setup, maybe I will limit things to 4 concurrent models and see what happens. But I have a hard time believing this is some sort of hardware issue...

Have you made a simplified post, similar to your original post here, on BOINC/dev? Perhaps some of the people who frequent that forum may have a clue.

I have not, thanks for the suggestion. If I am the only person experiencing this, perhaps I just need to suck it up and reboot periodically. However, I will be leaving for about six weeks in Sept/Oct and if I can't figure this out, I won't be running CPDN while I am gone.

I have had bad experiences with AVs, and generally avoid them... Can you try disabling it to see if it makes a difference?

Will do, thanks for the suggestion.

Also, if BOINC is installed as a service, there is a User listed as "BOINC Master" that I would exclude also.

Not running as a service.

Also, I don't see your version of BOINC or OS listed. It should not matter, but maybe it does.

Sorry, Windows 8.1 and BOINC v7.4.42(x64)

To answer your other question, I run 6 Ivy Bridge cores on CPDN, and two more supporting GPUs (GTX 750 Ti). I don't think that matters, but I don't recall running all 8 cores on CPDN.

You are the second person to suggest running all cores may not be a good idea. I have not experienced any drop in day-to-day usability so I figured an unused CPU cycle is a wasted CPU cycle and would run "all out" on all my cores unless I experienced performance issues. I will try scaling back to only using 4 cores (I have four "real" cores and 4 hyper threading virtual cores on this CPU) and see what happens.

Please note that the Resource Monitor software keeps showing information about the software for quite some time even if you have closed the program. You can check this with a program that is easy to recognize on the list, like Excel.

Thanks for the observation Harri. In this case, my screen grab was from approximately 9-hours after the last batch of models had completed. Plus I find the memory usage information in the Resource Monitor to be more informative than in the Task Manager. However, I will be sure to take your observation into consideration in the future.

I have a simiar experience on usage compared to Les in that I am running 4 cores and using about 4Gb of memory. Is it a quirk of Win8.1 as I am running Win7 (64bit pro)?

I am starting to wonder that as well. However, I did a test a week or two ago and have found I can run eight SETI@Home units concurrently as well as two on my GPUs and my memory usage does not increase over time like it does running CPDN units on my CPU. That leads me to think that in my case there may be a CPDN issue, not a BOINC issue behind this.

Thanks again for all the thoughts and comments, I appreciate it. I will report back about any effects disabling the AV has, if any.
ID: 52472 · Report as offensive     Reply Quote
John Price
Avatar

Send message
Joined: 6 Aug 04
Posts: 66
Credit: 7,126,935
RAC: 13,940
Message 52475 - Posted: 25 Aug 2015, 7:22:42 UTC

I don't seem to be able to download any work at all???

I have had a break from Climate prediction for perhaps 3 years so I am sort of new at it.

This is the message I am getting;

AM I doing something wrong?



climateprediction.net 25/08/2015 7:04:16 PM Message from server: No work available for the applications you have selected. Please check your project preferences on the web site.

ID: 52475 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 52477 - Posted: 25 Aug 2015, 10:20:49 UTC - in response to Message 52475.  

Hi John

You need to read this post, and then keep an eye on the Server Status page, 5th from the bottom in the blue menu to the left, for what is available from time to time for your computer OS.


ID: 52477 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 52505 - Posted: 7 Sep 2015, 11:35:50 UTC

And it will soon be time for another clear out. In a couple of days time all the short models will be finished so no danger of deleting the wrong folder by accident!
ID: 52505 · Report as offensive     Reply Quote
Jacob Klein

Send message
Joined: 28 Mar 13
Posts: 16
Credit: 5,383,625
RAC: 0
Message 52506 - Posted: 7 Sep 2015, 12:38:54 UTC
Last modified: 7 Sep 2015, 12:41:17 UTC

I have a 4-year-old installation, where this project is using 17.4 GB, but Reset wasn't working, because BOINC did not know about the files. A recent checkin, however, will allow Reset to actually wipe out all of the files in the project directory, assuming you are not using Anonymous Platform. It did not make it into BOINC 7.6.9, but perhaps the next version, you'll be able to simply click Reset on this project, and it'll work better to clean up the files.

Of course, it'd be better if the project itself kept itself clean . . . I still don't understand why it doesn't. Oh well.

Look for Reset to work better, in the next version of BOINC, as an easier option of cleaning up this project.
ID: 52506 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 52507 - Posted: 7 Sep 2015, 12:55:56 UTC - in response to Message 52506.  

It did not make it into BOINC 7.6.9, but perhaps the next version, you'll be able to simply click Reset on this project, and it'll work better to clean up the files.


If I had no other tasks running I might just click reset but I have some of the hadam3prm3pm2t_eu tasks running as well so just deleting the task folders in the cpdn projects folder is simpler. It is just that with the laptop I have to be careful not to delete a running task by accident.
ID: 52507 · Report as offensive     Reply Quote
Previous · 1 · 2

Message boards : Number crunching : HadCM3s post-completion artifacts

©2024 cpdn.org