Message boards : Number crunching : HadCM3s post-completion artifacts
Message board moderation
Previous · 1 · 2
Author | Message |
---|---|
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
Lots of people do indeed run multicore computers, with several models. (It's generally recommended that these models work best when there's 1 Gig of ram per model, plus 1 more for the OS. A bit overkill perhaps, but as a rough rule of thumb ...) My two machines have 4 real processors, plus 4 hyperthreading. I only run 4 cores, as the others don't give that much extra, and I'm hoping that it leaves something for the OS when it needs it. (With 16 Gig of ram.) This worked OK for around 8-9 years with Windows, and now with Linux. There are several Macs with 24 processors that I've come across, and they seem to run OK. Have you made a simplified post, similar to your original post here, on BOINC/dev? Perhaps some of the people who frequent that forum may have a clue. |
Send message Joined: 15 Jan 06 Posts: 637 Credit: 26,751,529 RAC: 653 |
Regarding the antivirus, I had already disabled scanning of the \ProgramData\BOINC folder but just now excluded the \Program Files\BOINC folder as well. I have had bad experiences with AVs, and generally avoid them. The machine where I run CPDN is a dedicated machine that runs only BOINC, so I don't have an AV installed there at all. I have found that the exclusions don't always work, because on some AVs they exclude the files only from the AV scans, but not from the "real time protection", which is the main culprit. Can you try disabling it to see if it makes a difference? Also, if BOINC is installed as a service, there is a User listed as "BOINC Master" that I would exclude also. Also, I don't see your version of BOINC or OS listed. It should not matter, but maybe it does. To answer your other question, I run 6 Ivy Bridge cores on CPDN, and two more supporting GPUs (GTX 750 Ti). I don't think that matters, but I don't recall running all 8 cores on CPDN. |
Send message Joined: 9 Dec 05 Posts: 116 Credit: 12,547,934 RAC: 2,738 |
Please note that the Resource Monitor software keeps showing information about the software for quite some time even if you have closed the program. You can check this with a program that is easy to recognize on the list, like Excel. For me the line for Excel is still visible on the Memory section for about a minute after I have closed it. To view actual running programs I use Task Managers Processes tab. |
Send message Joined: 22 Feb 06 Posts: 491 Credit: 31,036,409 RAC: 14,604 |
I have a simiar experience on usage compared to Les in that I am running 4 cores and using about 4Gb of memory. Is it a quirk of Win8.1 as I am running Win7 (64bit pro)? |
Send message Joined: 21 Jul 15 Posts: 8 Credit: 575,541 RAC: 0 |
First, thanks all for the suggestions and comments! Lots of people do indeed run multicore computers, with several models. (It's generally recommended that these models work best when there's 1 Gig of ram per model, plus 1 more for the OS. A bit overkill perhaps, but as a rough rule of thumb ...) At 24GB, that gives me 2GB per model plus about 8GB for the OS/other processes so I would think I would be OK. After a reboot, when I start BOINC and everything kicks in to high gear, I am using 4-5GB total. As expected, that slowly creeps up the longer the models run, but when they complete instead of seeing a drop in memory usage, I see a big jump as the next set of models start up. My two machines have 4 real processors, plus 4 hyperthreading. I only run 4 cores, as the others don't give that much extra, and I'm hoping that it leaves something for the OS when it needs it. (With 16 Gig of ram.) Similar to my setup, maybe I will limit things to 4 concurrent models and see what happens. But I have a hard time believing this is some sort of hardware issue... Have you made a simplified post, similar to your original post here, on BOINC/dev? Perhaps some of the people who frequent that forum may have a clue. I have not, thanks for the suggestion. If I am the only person experiencing this, perhaps I just need to suck it up and reboot periodically. However, I will be leaving for about six weeks in Sept/Oct and if I can't figure this out, I won't be running CPDN while I am gone. I have had bad experiences with AVs, and generally avoid them... Can you try disabling it to see if it makes a difference? Will do, thanks for the suggestion. Also, if BOINC is installed as a service, there is a User listed as "BOINC Master" that I would exclude also. Not running as a service. Also, I don't see your version of BOINC or OS listed. It should not matter, but maybe it does. Sorry, Windows 8.1 and BOINC v7.4.42(x64) To answer your other question, I run 6 Ivy Bridge cores on CPDN, and two more supporting GPUs (GTX 750 Ti). I don't think that matters, but I don't recall running all 8 cores on CPDN. You are the second person to suggest running all cores may not be a good idea. I have not experienced any drop in day-to-day usability so I figured an unused CPU cycle is a wasted CPU cycle and would run "all out" on all my cores unless I experienced performance issues. I will try scaling back to only using 4 cores (I have four "real" cores and 4 hyper threading virtual cores on this CPU) and see what happens. Please note that the Resource Monitor software keeps showing information about the software for quite some time even if you have closed the program. You can check this with a program that is easy to recognize on the list, like Excel. Thanks for the observation Harri. In this case, my screen grab was from approximately 9-hours after the last batch of models had completed. Plus I find the memory usage information in the Resource Monitor to be more informative than in the Task Manager. However, I will be sure to take your observation into consideration in the future. I have a simiar experience on usage compared to Les in that I am running 4 cores and using about 4Gb of memory. Is it a quirk of Win8.1 as I am running Win7 (64bit pro)? I am starting to wonder that as well. However, I did a test a week or two ago and have found I can run eight SETI@Home units concurrently as well as two on my GPUs and my memory usage does not increase over time like it does running CPDN units on my CPU. That leads me to think that in my case there may be a CPDN issue, not a BOINC issue behind this. Thanks again for all the thoughts and comments, I appreciate it. I will report back about any effects disabling the AV has, if any. |
Send message Joined: 6 Aug 04 Posts: 66 Credit: 7,126,935 RAC: 13,940 |
I don't seem to be able to download any work at all??? I have had a break from Climate prediction for perhaps 3 years so I am sort of new at it. This is the message I am getting; AM I doing something wrong? climateprediction.net 25/08/2015 7:04:16 PM Message from server: No work available for the applications you have selected. Please check your project preferences on the web site. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
Hi John You need to read this post, and then keep an eye on the Server Status page, 5th from the bottom in the blue menu to the left, for what is available from time to time for your computer OS. |
Send message Joined: 15 May 09 Posts: 4540 Credit: 19,039,635 RAC: 18,944 |
And it will soon be time for another clear out. In a couple of days time all the short models will be finished so no danger of deleting the wrong folder by accident! |
Send message Joined: 28 Mar 13 Posts: 16 Credit: 5,383,625 RAC: 0 |
I have a 4-year-old installation, where this project is using 17.4 GB, but Reset wasn't working, because BOINC did not know about the files. A recent checkin, however, will allow Reset to actually wipe out all of the files in the project directory, assuming you are not using Anonymous Platform. It did not make it into BOINC 7.6.9, but perhaps the next version, you'll be able to simply click Reset on this project, and it'll work better to clean up the files. Of course, it'd be better if the project itself kept itself clean . . . I still don't understand why it doesn't. Oh well. Look for Reset to work better, in the next version of BOINC, as an easier option of cleaning up this project. |
Send message Joined: 15 May 09 Posts: 4540 Credit: 19,039,635 RAC: 18,944 |
It did not make it into BOINC 7.6.9, but perhaps the next version, you'll be able to simply click Reset on this project, and it'll work better to clean up the files. If I had no other tasks running I might just click reset but I have some of the hadam3prm3pm2t_eu tasks running as well so just deleting the task folders in the cpdn projects folder is simpler. It is just that with the laptop I have to be careful not to delete a running task by accident. |
©2024 cpdn.org