climateprediction.net (CPDN) home page
Thread 'New work Discussion'

Thread 'New work Discussion'

Message boards : Number crunching : New work Discussion
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 43 · 44 · 45 · 46 · 47 · 48 · 49 . . . 91 · Next

AuthorMessage
KAMasud

Send message
Joined: 6 Oct 06
Posts: 204
Credit: 7,608,986
RAC: 0
Message 62562 - Posted: 8 Jun 2020, 12:20:23 UTC - in response to Message 62560.  

"The queued stacks of WUs tend to be systems where they have, say, 12 cores, download 24 WUs but then only allow 2 WUs to run concurrently alongside their other projects."


As to this statement, yes true. It is not about allowing two WU's to run "concurrently" alongside other projects. It is all about how many cores you can run at an ambient temperature of 45c without melting the machine down. In the afternoon I can run only two cores( nothing to do with projects). At night, maybe four. Vector in GPU computing also.
Another factor is the base speed. At all twelve cores running simultaneously, maybe 2.2 MHz. A single core. 4.04 MHz. I am still thinking about the advantages of so many cores. Maybe getting WU's of Climate. Should I get a forty-eight cores machine? Naaa, that is a bit of being silly.
ID: 62562 · Report as offensive
KAMasud

Send message
Joined: 6 Oct 06
Posts: 204
Credit: 7,608,986
RAC: 0
Message 62563 - Posted: 8 Jun 2020, 12:30:20 UTC - in response to Message 62561.  

You can of course control the size of your buffer. Setting it to the default of 0.1+0.5 days will get you fewer work units than setting it to 10 days, for example. But that is rather crude, and sometimes they won't send you anything at all.

Unfortunately, the BOINC scheduler is not aware of the "app_config.xml" file, so if you set it to run only two work units, it will still download as if you were running on all 12 cores. So until BOINC gets smarter (a long process), the best way would be for CPDN to provide you a user-selectable limit of how many work units you want downloaded at a time. Several projects do that now: WCG, LHC and Cosmology that I can think of at the moment.

But CPDN has been going in the direction of fewer options. They need to reverse course.



Better would be CPDN slashing drastically the due back date and then re-issuing the WU"s. The current due back date is from the time of Pentium One. I know, it used to take ages then. Now with faster RAM, SSD drives and modernisation, maybe five days to complete.
As to the buffer size, my GPU is busy on another project whose WU"s it completes in four minutes flat. I earn my credits with my GPU and CPU's are full time dedicated to Climate.
ID: 62563 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,016,442
RAC: 21,024
Message 62564 - Posted: 8 Jun 2020, 13:01:27 UTC - in response to Message 62563.  

Better would be CPDN slashing drastically the due back date and then re-issuing the WU"s. The current due back date is from the time of Pentium One. I know, it used to take ages then. Now with faster RAM, SSD drives and modernisation, maybe five days to complete.


Yes, even on a slow machine like my current desktop that is going to end up like the axe that has been in my family for generations. (Grandfather gave it a new head, father a new handle) tasks complete in 31/32 days max. (Pentium(R) Dual-Core CPU E5400 @ 2.70GHz) Next upgrade will be new CPU memory and motherboard which with PSU and hard disks having been changed already will only leave the case as original.
ID: 62564 · Report as offensive
KAMasud

Send message
Joined: 6 Oct 06
Posts: 204
Credit: 7,608,986
RAC: 0
Message 62565 - Posted: 8 Jun 2020, 14:00:39 UTC

Another advantage for machines who have dedicated their CPU's to Climate, their machines hammer at the server every one and a half hours or so. Their requests I suppose get lined up, maybe justice. Machines which have not dedicated their CPU's to Boinc and if even there is work available (their work quota might be full of letting us say Collatz WU's) Boinc will not ask the server for work. If you check the server state now and then, there are about 22 or 24 machines dedicated. The rest are busy.
ID: 62565 · Report as offensive
ProfileJIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,363,583
RAC: 5,022
Message 62582 - Posted: 14 Jun 2020, 13:21:25 UTC

Is batch 871 still open? I just received 2 Wu’s (both _2s). They have failed on 2 other machines. They must be 3 or 4 months old. Are they still needed an wanted.
ID: 62582 · Report as offensive
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 62583 - Posted: 14 Jun 2020, 13:56:00 UTC - in response to Message 62582.  

Is batch 871 still open? I just received 2 Wu’s (both _2s). They have failed on 2 other machines. They must be 3 or 4 months old. Are they still needed an wanted.

Batch 871 is still open. It was issued on May 22nd 2020.
ID: 62583 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,016,442
RAC: 21,024
Message 62584 - Posted: 14 Jun 2020, 15:22:34 UTC

It is rare for batches to be closed under nine months or even a year except when withdrawn because of a major problem that should have been caught in testing when a new batch is subsequently issued.

I can only remember two or three instances o this happening but might well have missed some.
ID: 62584 · Report as offensive
ProfileJIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,363,583
RAC: 5,022
Message 62585 - Posted: 14 Jun 2020, 15:51:05 UTC - in response to Message 62583.  

Thanks. Hopefully I can shepard these two along and get them completed.
ID: 62585 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,016,442
RAC: 21,024
Message 62586 - Posted: 18 Jun 2020, 14:09:00 UTC

Oops! Just picked up two retreads when I was trying to clear laptop of work prior to doing a clean install of 20.04 - Thought I had put all projects to no new tasks. - Obviously not!
ID: 62586 · Report as offensive
WB8ILI

Send message
Joined: 1 Sep 04
Posts: 161
Credit: 81,522,141
RAC: 1,164
Message 62587 - Posted: 18 Jun 2020, 19:54:33 UTC

Dave -

What did you do? Upgrade to 20.04 without a clean install? Your computers show you have 20.04 on both computers and the tasks downloaded today.

I upgraded to 20.04 from 18.04 without any problems on several computers as soon as 20.04 became available (actually before as a beta). without any issues.

.
ID: 62587 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,016,442
RAC: 21,024
Message 62588 - Posted: 19 Jun 2020, 5:06:35 UTC

What did you do? Upgrade to 20.04 without a clean install? Your computers show you have 20.04 on both computers and the tasks downloaded today.


Yes, did a standard upgrade via the command line. However this stopped the manager from working though not the client due to some wxwidgets conflict. This also causes make command to fall over when I roll my own manager on the laptop though not the desktop. I have found a work around with Jord's self extracting manager and client for the laptop to get it going again. Now I just have a longer wait till I can clean things up.
ID: 62588 · Report as offensive
lazlo_vii

Send message
Joined: 11 Dec 19
Posts: 108
Credit: 3,012,142
RAC: 0
Message 62589 - Posted: 19 Jun 2020, 11:19:57 UTC - in response to Message 62588.  
Last modified: 19 Jun 2020, 11:20:56 UTC

What did you do? Upgrade to 20.04 without a clean install? Your computers show you have 20.04 on both computers and the tasks downloaded today.


Yes, did a standard upgrade via the command line. However this stopped the manager from working though not the client due to some wxwidgets conflict. This also causes make command to fall over when I roll my own manager on the laptop though not the desktop. I have found a work around with Jord's self extracting manager and client for the laptop to get it going again. Now I just have a longer wait till I can clean things up.


FYI, you can open a terminal and issue commands to start/stop/enable/disable the BIONC client before and after upgrades:

sudo systemctl start boinc-client
sudo systemctl stop boinc-client
sudo systemctl disable boinc-client
sudo systemctl enable boinc-client


You can also use the BOINC command line interface to manage the the client. See:

man boinccmd
ID: 62589 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,016,442
RAC: 21,024
Message 62590 - Posted: 19 Jun 2020, 11:26:24 UTC - in response to Message 62589.  

You can also use the BOINC command line interface to manage the the client. See:


Yes I was managing BOINC from the command line until I got a work around. However I like to play and often build my own BOINC client and manager from source code using the testing versions and would quite like to get back into being able to do that on the laptop.
ID: 62590 · Report as offensive
Eirik Redd

Send message
Joined: 31 Aug 04
Posts: 391
Credit: 219,896,461
RAC: 649
Message 62593 - Posted: 20 Jun 2020, 5:15:35 UTC - in response to Message 62590.  

You can also use the BOINC command line interface to manage the the client. See:


Yes I was managing BOINC from the command line until I got a work around. However I like to play and often build my own BOINC client and manager from source code using the testing versions and would quite like to get back into being able to do that on the laptop.


Yes, yes boinccmd has been a great help to me over the years when the gui fails, as it does from time to time.
But I don't think many users even imagine how useful a cli interface can be.
My daughter asked me a few months ago, while taking a coding class --"dad, how do I get out of less?" "q".
How few CPDN volunteers even know what differential equation is?

How to get more crunchers?
Then there will be more work units.
ID: 62593 · Report as offensive
lazlo_vii

Send message
Joined: 11 Dec 19
Posts: 108
Credit: 3,012,142
RAC: 0
Message 62771 - Posted: 9 Oct 2020, 6:01:15 UTC - in response to Message 62593.  

So I got excited and configured one of my machines to do the new N216 models. When it didn't get any work I thought "Oh well, gone already." Then I realized I had issue commands to the wrong system and it didn't get any work because it's queue was full. Oops. Once I had the right IP address for boinccmd I got 4 of the new 5 month models. I'll try to have them back within 14 days but I can't promise because I have never run 4 N216's on one Zen2 chiplet. I was able to do three 4 months WU's in 7-8 days though so it shouldn't be that bad.
ID: 62771 · Report as offensive
lazlo_vii

Send message
Joined: 11 Dec 19
Posts: 108
Credit: 3,012,142
RAC: 0
Message 62778 - Posted: 9 Oct 2020, 20:42:05 UTC - in response to Message 62771.  
Last modified: 9 Oct 2020, 20:42:20 UTC

It looks like the 5 month WU's are running at 10% a day on the 3700X. It would be a little faster if I was only doing 3 of them but it's still a good rate.
ID: 62778 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,016,442
RAC: 21,024
Message 62779 - Posted: 11 Oct 2020, 6:15:23 UTC
Last modified: 11 Oct 2020, 7:12:32 UTC

And now all gone bar the inevitable retreads.
ID: 62779 · Report as offensive
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,016,442
RAC: 21,024
Message 62785 - Posted: 23 Oct 2020, 20:39:53 UTC

Still no news as to when they might make the main site but more testing is happening with the OpenIFS tasks.

If the latest batch is anything to go by, they will not be for everyone, the ones I ran recently peaked at 11GB of RAM and about 13GB of swap. (I never saw my swap file usage go up to anything like that so I wonder if that means data swapped out to disk in the BOINC data directory though usage there never got up that high when I looked.

OpenIFS v2.19
x86_64-pc-linux-gnu
Peak working set size 11,797.17 MB
Peak swap size 13,131.91 MB
Peak disk usage 3,516.51 MB
ID: 62785 · Report as offensive
ProfileAlan K

Send message
Joined: 22 Feb 06
Posts: 491
Credit: 30,985,838
RAC: 14,284
Message 62786 - Posted: 23 Oct 2020, 22:58:45 UTC - in response to Message 62785.  

I would have to resize my virtual memory for those then. Currently only 8GB.
ID: 62786 · Report as offensive
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 62787 - Posted: 23 Oct 2020, 23:56:42 UTC - in response to Message 62786.  

Yes, these are classed as high resolution.
ID: 62787 · Report as offensive
Previous · 1 . . . 43 · 44 · 45 · 46 · 47 · 48 · 49 . . . 91 · Next

Message boards : Number crunching : New work Discussion

©2024 cpdn.org