climateprediction.net (CPDN) home page
Thread 'No work for Windows OR Linux?!'

Thread 'No work for Windows OR Linux?!'

Message boards : Number crunching : No work for Windows OR Linux?!
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 65336 - Posted: 12 Apr 2022, 6:08:46 UTC

So I've got Windows and Linux running in an attempt to get something. Just one task.... one single task.... But no. Nothing. Despite the server status saying 400 tasks are available, I get refused on both operating systems.
ID: 65336 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 65337 - Posted: 12 Apr 2022, 6:47:37 UTC - in response to Message 65336.  

The HadAM4 at N144 resolution tasks are Linux, as per the Applications page
And they're downloading and running nicely on my machine.
ID: 65337 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 65338 - Posted: 12 Apr 2022, 7:17:25 UTC - in response to Message 65337.  

The HadAM4 at N144 resolution tasks are Linux, as per the Applications page
And they're downloading and running nicely on my machine.
Not here they're not. "Got 0 new tasks". No reason given. I'm leaving. Permanently.
ID: 65338 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 65339 - Posted: 12 Apr 2022, 12:08:02 UTC - in response to Message 65336.  

I got four N144 tasks as soon as they became available.
I have a little over 1-day in each. I.e., about 35% progress.
According to the web site, there are several hundred more available.
   PID    PPID USER       PR  NI S    RES  %MEM  %CPU  P     TIME+ COMMAND                                                                   
  40546   40535 boinc     39  19 R 665100   1.0  99.1  2   2436:15 /var/lib/boinc/projects/climateprediction.net/hadam4_um_8.09_i686-pc-lin+ 
  40544   40536 boinc     39  19 R 664556   1.0  99.2  8   2436:15 /var/lib/boinc/projects/climateprediction.net/hadam4_um_8.09_i686-pc-lin+ 
  40542   40537 boinc     39  19 R 664464   1.0  99.4  5   2436:13 /var/lib/boinc/projects/climateprediction.net/hadam4_um_8.09_i686-pc-lin+ 
  40548   40534 boinc     39  19 R 664316   1.0  99.5  3   2436:18 /var/lib/boinc/projects/climateprediction.net/hadam4_um_8.09_i686-pc-lin+ 

ID: 65339 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 65340 - Posted: 12 Apr 2022, 12:17:11 UTC - in response to Message 65339.  
Last modified: 12 Apr 2022, 12:17:27 UTC

I got four N144 tasks as soon as they became available.
I have a little over 1-day in each. I.e., about 35% progress.
According to the web site, there are several hundred more available.
   PID    PPID USER       PR  NI S    RES  %MEM  %CPU  P     TIME+ COMMAND                                                                   
  40546   40535 boinc     39  19 R 665100   1.0  99.1  2   2436:15 /var/lib/boinc/projects/climateprediction.net/hadam4_um_8.09_i686-pc-lin+ 
  40544   40536 boinc     39  19 R 664556   1.0  99.2  8   2436:15 /var/lib/boinc/projects/climateprediction.net/hadam4_um_8.09_i686-pc-lin+ 
  40542   40537 boinc     39  19 R 664464   1.0  99.4  5   2436:13 /var/lib/boinc/projects/climateprediction.net/hadam4_um_8.09_i686-pc-lin+ 
  40548   40534 boinc     39  19 R 664316   1.0  99.5  3   2436:18 /var/lib/boinc/projects/climateprediction.net/hadam4_um_8.09_i686-pc-lin+ 
Looks like I lacked the 32 bit libraries. These should be supplied by CPDN or Boinc automatically. Oh nevermind, back to Windows where things just work. Linux has been deleted.
ID: 65340 · Report as offensive     Reply Quote
SolarSyonyk

Send message
Joined: 7 Sep 16
Posts: 262
Credit: 34,915,412
RAC: 16,463
Message 65341 - Posted: 12 Apr 2022, 16:23:37 UTC

I've got about 16 of the N144 tasks happily running on Linux as well, though I did follow the instructions and install the 32-bit libraries as widely covered around the forums...

The project is what it is, and whining and quitting because nobody has work for Windows and you refuse to set your Linux system up to properly run the tasks seems a bit absurd. More work for my heaters, I suppose!
ID: 65341 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,013,957
RAC: 21,195
Message 65342 - Posted: 12 Apr 2022, 17:41:49 UTC - in response to Message 65340.  

I did say over on the BOINC boards that the 32bit libraries needed to be installed though not having them doesn't stop you downloading work, it just makes it all crash.
ID: 65342 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 65343 - Posted: 12 Apr 2022, 17:53:40 UTC - in response to Message 65340.  

When I got this (Linux) machine, I could not find the compatibility libraries for RHEL8 that I was running.
I finally found help getting them here.

https://www.cpdn.org/forum_thread.php?id=8008&postid=62949
ID: 65343 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 65344 - Posted: 12 Apr 2022, 18:53:03 UTC - in response to Message 65342.  

I did say over on the BOINC boards that the 32bit libraries needed to be installed though not having them doesn't stop you downloading work, it just makes it all crash.

Dave, I've had both happen. It won't download work, or it immediately crashes if 32 bit libraries are not installed. May depend on the distribution or other things that are installed before boinc and cpdn.
ID: 65344 · Report as offensive     Reply Quote
computezrmle

Send message
Joined: 9 Mar 22
Posts: 30
Credit: 1,065,239
RAC: 556
Message 65345 - Posted: 12 Apr 2022, 20:14:39 UTC - in response to Message 65344.  

It won't download work, ... if 32 bit libraries are not installed.

wrong

It ... immediately crashes if 32 bit libraries are not installed.

right

May depend on the distribution

wrong

BOINC doesn't check for missing standard libs when it downloads work (even 32-bit ones like in this case).
When a program starts the dynamic linker loads all libs the program is linked against.
That's the moment when a missing lib causes an error.

Non standard libs need to be included in the project's app version description to be checked/downloaded by BOINC.
ID: 65345 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,013,957
RAC: 21,195
Message 65346 - Posted: 12 Apr 2022, 20:29:53 UTC - in response to Message 65345.  

The issue with including the libraries is that they vary between distributions so that might sort out for one person but not another.
ID: 65346 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Jan 06
Posts: 637
Credit: 26,751,529
RAC: 653
Message 65347 - Posted: 12 Apr 2022, 21:49:52 UTC - in response to Message 65346.  

FWIW, I am running the HadAM4 N144 fine under WSL now (using Ubuntu 20.04.4).
I installed the 32-bit libraries using "sudo apt install lib32ncurses6 lib32z1 lib32stdc++-8-dev", though that is in addition to "lib32ncurses6 lib32z1 lib32stdc++-7-dev" that I had previously installed.
https://www.cpdn.org/results.php?hostid=1530163

I have not run them for a while on this Windows machine, because the last time I could not reboot without shutting them down with a BOINC command (boinccmd --quit).
https://www.cpdn.org/forum_thread.php?id=9025&postid=63477#63477
Now, I can just reboot and they do not error out, and start up again automatically.

It is probably due to the updates to WSL, or BOINC, or maybe the work units themselves.
At any rate, it is convenient to be able to run them on Win10. This machine has a Ryzen 3600, and running six at a time (50% of the cores) works well.
ID: 65347 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 65348 - Posted: 13 Apr 2022, 3:52:27 UTC - in response to Message 65342.  

I did say over on the BOINC boards that the 32bit libraries needed to be installed though not having them doesn't stop you downloading work, it just makes it all crash.
Then that's not what happened to me, the server was behaving as though there was no work available.
ID: 65348 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 65349 - Posted: 13 Apr 2022, 3:54:14 UTC - in response to Message 65346.  

The issue with including the libraries is that they vary between distributions so that might sort out for one person but not another.
Another reason not to use Linux. It's not standard across distributions. It's in the early stages of development, maybe one day Linux will be competitive. The distributions need to start working together to make one standard.
ID: 65349 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 65350 - Posted: 13 Apr 2022, 3:55:45 UTC - in response to Message 65341.  

I've got about 16 of the N144 tasks happily running on Linux as well, though I did follow the instructions and install the 32-bit libraries as widely covered around the forums...

The project is what it is, and whining and quitting because nobody has work for Windows and you refuse to set your Linux system up to properly run the tasks seems a bit absurd. More work for my heaters, I suppose!
I installed everything perfectly. But I ran out of disk space as it was a virtual machine. Since Linux appears to have no way of resizing the system partition (Windows just does this in disk management while running without a restart!), I had to start from scratch and forgot one step.
ID: 65350 · Report as offensive     Reply Quote
SolarSyonyk

Send message
Joined: 7 Sep 16
Posts: 262
Credit: 34,915,412
RAC: 16,463
Message 65351 - Posted: 13 Apr 2022, 4:49:24 UTC - in response to Message 65349.  
Last modified: 13 Apr 2022, 4:50:37 UTC

Another reason not to use Linux. It's not standard across distributions. It's in the early stages of development, maybe one day Linux will be competitive. The distributions need to start working together to make one standard.


If you're running one of the standard, mainline Linux distributions (Ubuntu, Debian, RedHat, CentOS, etc), there are entirely standard and well documented ways of doing the things you need to do to run 32-bit binaries on a 64-bit platform, and the forum covers pretty much all of them. If you're running one of the weirder, more "do your own thing the way you want it done" distributions (Arch, Slack, Gentoo, etc), you probably know enough to solve that problem on your own. This isn't supporting some esoteric bit of EISA hardware on a USB bridge, it's running compute binaries. There are standard ways of doing it, you're just apparently unwilling to bother with them.

As for "early stages of development" and "maybe one day," well, that's a pretty stiff matter of opinion. I think Linux is just fine, and I also am busily purging the non-Linux operating systems from my life because I can't stand what the companies behind them are doing. Perhaps you're fine with Windows 11 requiring an online Microsoft Account to use your local computer (with all the nice tasty behavioral data Microsoft can slurp up and sell on the backend, knowing which particular person and email it's tied to), but I'd rather not, and, more specifically, won't. If that requirement remains, none of my machines will run Win11, period. If that means there are things I can't do, well, so be it. I probably didn't have too much interest in doing them anyway. Kerbal Space Program runs just fine on Linux.

Since Linux appears to have no way of resizing the system partition (Windows just does this in disk management while running without a restart!), I had to start from scratch and forgot one step.


Balderdash. That you don't know how to do it doesn't mean that the way doesn't exist. I do exactly this, quite regularly, and just about every cloud instance out there does this every time you create one.

Expand the physical volume. For most VM management software, just resize the disk in the point and click bit.
In Linux, once you're booted, run growpart. It's typically provided by the cloud-guest-utils package, and will expand the last partition to fill the remainder of the physical volume.
Then run resize2fs on your resized partition, which supports online expansion of ext4 filesystems, and it will grow the filesystem to the newly expanded partition.

Oh, look, I just resized the partition online, without having to reinstall!

You might also consider upping the percentage of disk boinc is allowed on a dedicated compute box/VM. In your /etc/boinc-client/global_prefs_override.xml, I'd suggest adding the following for dedicated compute rigs (I run quite a few, all Linux, unless they're a Mac VM):

   <disk_max_used_gb>0.000000</disk_max_used_gb>
   <disk_max_used_pct>90.000000</disk_max_used_pct>
   <disk_min_free_gb>1.000000</disk_min_free_gb>
   <vm_max_used_pct>75.000000</vm_max_used_pct>
   <ram_max_used_busy_pct>90.000000</ram_max_used_busy_pct>
   <ram_max_used_idle_pct>90.000000</ram_max_used_idle_pct>
ID: 65351 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 65352 - Posted: 13 Apr 2022, 4:57:23 UTC - in response to Message 65351.  

Another reason not to use Linux. It's not standard across distributions. It's in the early stages of development, maybe one day Linux will be competitive. The distributions need to start working together to make one standard.
If you're running one of the standard, mainline Linux distributions (Ubuntu, Debian, RedHat, CentOS, etc),
I was, so why didn't Boinc/CPDN provide what I needed, instead of a half piece of software?

As for "early stages of development" and "maybe one day," well, that's a pretty stiff matter of opinion. I think Linux is just fine, and I also am busily purging the non-Linux operating systems from my life because I can't stand what the companies behind them are doing. Perhaps you're fine with Windows 11 requiring an online Microsoft Account to use your local computer (with all the nice tasty behavioral data Microsoft can slurp up and sell on the backend, knowing which particular person and email it's tied to), but I'd rather not, and, more specifically, won't. If that requirement remains, none of my machines will run Win11, period. If that means there are things I can't do, well, so be it. I probably didn't have too much interest in doing them anyway. Kerbal Space Program runs just fine on Linux.
I just want to tell the computer what to do by clicking, not by typing in commands from the last century.

Since Linux appears to have no way of resizing the system partition (Windows just does this in disk management while running without a restart!), I had to start from scratch and forgot one step.
Balderdash. That you don't know how to do it doesn't mean that the way doesn't exist. I do exactly this, quite regularly, and just about every cloud instance out there does this every time you create one.

Expand the physical volume. For most VM management software, just resize the disk in the point and click bit.
In Linux, once you're booted, run growpart.
I googled and found gpart, which wasn't even included, Windows has disk management already there. I installed it and got a similar graphical interface, but the system drive refused to expand. So I booted off a live CD, it still refused.
ID: 65352 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,013,957
RAC: 21,195
Message 65353 - Posted: 13 Apr 2022, 6:42:50 UTC

The distributions need to start working together to make one standard.

As Richard said on a thread I started over on the BOINC fora,
Standards are great. That's why we have so many of them.
ID: 65353 · Report as offensive     Reply Quote
computezrmle

Send message
Joined: 9 Mar 22
Posts: 30
Credit: 1,065,239
RAC: 556
Message 65354 - Posted: 13 Apr 2022, 6:43:40 UTC

Hi guys,

I usually don't post comments like this.

You may be aware that Peter Hucker has been banished at the main BOINC forum yesterday.

It started a while ago when he got temporarily banished for the first time for his speech getting more and more rude.
During the banishment he created a 1st shadow account - which violates the forum rules.
That shadow account had been deleted very quickly but he created (at least) a 2nd one.

After the banishment of his main account was finished he again became more and more rude.
At the end he heavily insulted everybody he previously got help from plus the forum moderator.

The interesting fact is that the topics at the main BOINC forum were nearly the same as here
- he complained about getting no tasks from CPDN
- he complained about Linux not being a serious OS


Over at LHC@home where I'm a forum moderator he also started that kind of posts a while ago and it took me a few clear PMs to make him aware that the project would banish him if he doesn't respect the rules.
ID: 65354 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 65355 - Posted: 13 Apr 2022, 6:51:37 UTC - in response to Message 65354.  
Last modified: 13 Apr 2022, 7:00:23 UTC

Hi guys,

I usually don't post comments like this.

You may be aware that Peter Hucker has been banished
Oooh for a whole month. By someone who won't admit their name.

at the main BOINC forum yesterday.

It started a while ago
6 years ago.

when he got temporarily banished for the first time
Actually it's 38 times.....

for his speech getting more and more rude.
Yeah, you think the word "idiot" is rude. I don't know what freaky religion you come from (it can't be Jewish since you're German, and I don't know any other anti-swearing religions), but idiot isn't rude. Fucking cunt is rude. Go on, grass me off again, you know you love it. Are you 6?

I also notice you followed me here. Look, if you want to ask me out, just say so.
ID: 65355 · Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : No work for Windows OR Linux?!

©2024 cpdn.org