climateprediction.net (CPDN) home page
Thread 'CPDN client for glibc2.2'

Thread 'CPDN client for glibc2.2'

Message boards : Number crunching : CPDN client for glibc2.2
Message board moderation

To post messages, you must log in.

AuthorMessage
Rainer Emrich
Avatar

Send message
Joined: 26 Aug 04
Posts: 3
Credit: 6,367,024
RAC: 0
Message 2128 - Posted: 30 Aug 2004, 8:03:16 UTC

There should be a CPDN client for glibc2.2 or the option to compile the client for different paltforms, as for seti_boinc.

I have several maschines idle for long times, but it\'s impossible to upgrade to glibc2.3. Because some software, we are using, depend\'s on the glibc2.2.

Rainer
ID: 2128 · Report as offensive     Reply Quote
old_user73

Send message
Joined: 5 Aug 04
Posts: 39
Credit: 14,887
RAC: 0
Message 2131 - Posted: 30 Aug 2004, 9:07:49 UTC - in response to Message 2128.  

As a parallel question: Are there any plans on publishing the source code for the application so that users can compile for their own weird systems (Playstation 2, my DVD player etc...) and with their own crazy CPU specific optimizations...or?
ID: 2131 · Report as offensive     Reply Quote
ProfileAndrew Hingston
Volunteer moderator

Send message
Joined: 17 Aug 04
Posts: 753
Credit: 9,804,700
RAC: 0
Message 2135 - Posted: 30 Aug 2004, 10:47:10 UTC

There are a couple of caveats to be made. One is that it is quite a large program (around a million lines of code) so it is a lot more daunting a task than S@H, for example.

The other is the sensitive subject of validation. Remember that this is publicly funded scientific research. Whilst someone may have perfect confidence that their compilation for, say, XBox is just wonderful, it may be difficult to convince others that the results can be trusted without independent corroboration. SETI gets around this by sending the same WU to at least three different machines, and rejects any results that are out of line. CPDN cannot afford to do this, and so has to rely on the integrity of the software, though there are of course ways of trapping anomalous results.
ID: 2135 · Report as offensive     Reply Quote
old_user1
Avatar

Send message
Joined: 5 Aug 04
Posts: 907
Credit: 299,864
RAC: 0
Message 2146 - Posted: 30 Aug 2004, 11:39:01 UTC - in response to Message 2135.  
Last modified: 5 Sep 2004, 11:10:41 UTC

also, other than the complexity/size of the climate model is the issue that CPDN has an arrangement to use this (at no charge) from the UK Met Office -- it is proprietary code and not freely available; although the results will be (when we get the grid stuff working for scientists to use!)

I will look into the hadsm3 compilation, as I had thought everything was statically linked as they are in the model (hadsm3um) and small executables (hadsm3se) and maybe the viz (which is not "mandatory" but nice to see your "world" running!)
ID: 2146 · Report as offensive     Reply Quote
old_user8065

Send message
Joined: 1 Sep 04
Posts: 24
Credit: 10,865,773
RAC: 0
Message 3071 - Posted: 5 Sep 2004, 10:39:39 UTC
Last modified: 7 Sep 2004, 8:36:45 UTC

Howdy!

I've just ran into the same brick as Rainer did.

I checked all 3 binaries that seem to really matter (hadsm3, hadsm3se and hadsm3um; does hadsm3viz really matter?) and I found out that two of them are already statically linked. Why not statically link also the first one (hadsm3)?

It further seems to me, that the hadsm3 binary is only some kind of wrapper binary which takes care of running the actual scientific model. Or am I wrong?

For sure this will enlarge the download file set, but as these seem to get downloaded only once, I don't think people will complain a lot.

A side note: while trying to get things working, I detached and attached to the project a couple of times. Every time I attached to the project a 'result' got assigned and had been discarded by client when I detached from the project. How an be such results returned to the pool of work available to other participants?
ID: 3071 · Report as offensive     Reply Quote
old_user8065

Send message
Joined: 1 Sep 04
Posts: 24
Credit: 10,865,773
RAC: 0
Message 3591 - Posted: 9 Sep 2004, 13:03:41 UTC

Howdy!

I'm glad to see that the version 4.04 now runs on my ancient GLIBC 2.2 linux. Thanks a lot!

The question about returning the 'ghost' model runs still remains: how to delete the model runs allocated to a client but the client never managed to run because of old GLIBC?
ID: 3591 · Report as offensive     Reply Quote
old_user1
Avatar

Send message
Joined: 5 Aug 04
Posts: 907
Credit: 299,864
RAC: 0
Message 3651 - Posted: 9 Sep 2004, 21:58:00 UTC - in response to Message 3591.  

> Howdy!
>
> I'm glad to see that the version 4.04 now runs on my ancient GLIBC 2.2 linux.
> Thanks a lot!
>
> The question about returning the 'ghost' model runs still remains: how to
> delete the model runs allocated to a client but the client never managed to
> run because of old GLIBC?
>
>
cool, you're the first I've heard from "ancient" boxes -- I discovered from another user around here that I wasn't statically compiling everything, so now I am so there are no dependencies (except on vis, but I distribute a few libGL's that should help).

I wouldn't worry about the old/crashed model runs, BOINC detects the crash and reallocates new results for that workunit.
ID: 3651 · Report as offensive     Reply Quote
old_user8065

Send message
Joined: 1 Sep 04
Posts: 24
Credit: 10,865,773
RAC: 0
Message 17215 - Posted: 16 Nov 2005, 10:38:59 UTC

Back to my problem ... this time for sulphur ...

Here\'s output from ldd:

ldd sulphur_4.21_i686-pc-linux-gnu
./sulphur_4.21_i686-pc-linux-gnu: /lib/i686/libc.so.6: version `GLIBC_2.3\' not found (required by ./sulphur_4.21_i686-pc-linux-gnu)
libm.so.6 => /lib/i686/libm.so.6 (0xb7fb5000)
libdl.so.2 => /lib/libdl.so.2 (0xb7fb1000)
libpthread.so.0 => /lib/i686/libpthread.so.0 (0xb7f9d000)
libc.so.6 => /lib/i686/libc.so.6 (0x42000000)
/lib/ld-linux.so.2 => /lib/ld-linux.so.2 (0xb7fed000)

Any hope for statical build?

OTOH: is it possible to define a box not to fetch sulphur experiment? The problematic one is a 2-way P3@1GHz which will take forever to complete sulphur experiment...
Metod ...
ID: 17215 · Report as offensive     Reply Quote
Profileold_user6033

Send message
Joined: 31 Aug 04
Posts: 7
Credit: 58,875,069
RAC: 0
Message 17539 - Posted: 29 Nov 2005, 12:22:44 UTC

I get the same on my linux cluster:

[climateprediction.net]# ldd sulphur_4.21_i686-pc-linux-gnu
./sulphur_4.21_i686-pc-linux-gnu: /lib/i686/libc.so.6: version `GLIBC_2.3\' not found (required by ./sulphur_4.21_i686-pc-linux-gnu)
libm.so.6 => /lib/i686/libm.so.6 (0x40018000)
libdl.so.2 => /lib/libdl.so.2 (0x4003b000)
libpthread.so.0 => /lib/i686/libpthread.so.0 (0x4003e000)
libc.so.6 => /lib/i686/libc.so.6 (0x42000000)
/lib/ld-linux.so.2 => /lib/ld-linux.so.2 (0x40000000)

these are RH7.3 ish boxes...

Any way to disable the sulphur models?
Seb

ID: 17539 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 17552 - Posted: 29 Nov 2005, 19:23:50 UTC

Slab has been shut down, at least for the moment, and a large number of sulphur data sets generated, because the researchers want more sulphur.

(Carl\'s post <a href=\"http://www.climateprediction.net/board/viewtopic.php?t=3352\"> here.</a>)

You\'ll just have to shoot those computers. :(

ID: 17552 · Report as offensive     Reply Quote
Profileold_user5994

Send message
Joined: 31 Aug 04
Posts: 239
Credit: 2,933,299
RAC: 0
Message 17578 - Posted: 30 Nov 2005, 10:26:11 UTC

Well, the only problem I have is that with the longer run times of Sulfur models and shorter deadlines, there is a tension here. The run times I see are 4 to 5 times slab, yet the deadline is 50% ...

I still don\'t see the point of increasing the work by a factor of 4 but decreasing the deadline by factor of 2 ... especially when we should now have SOME \"slack\" with some models created. One of my fears would be an entry into EDF on too many of my computers.

So, just my 2 cents, but, I see this is a little unrealistic ...
ID: 17578 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 17582 - Posted: 30 Nov 2005, 12:59:44 UTC

My sulphur was started on 10-10-2005, and the deadline says 22-9-2006, so I think the deadlines have been relaxed.

ID: 17582 · Report as offensive     Reply Quote
Profileold_user5994

Send message
Joined: 31 Aug 04
Posts: 239
Credit: 2,933,299
RAC: 0
Message 17599 - Posted: 1 Dec 2005, 4:12:33 UTC

Hmm,

Looking at mine, I have 2 with 6 month deadlines and 2 with what looks like a year. So, you may be correct.
ID: 17599 · Report as offensive     Reply Quote
Profileold_user6033

Send message
Joined: 31 Aug 04
Posts: 7
Credit: 58,875,069
RAC: 0
Message 17604 - Posted: 1 Dec 2005, 9:52:18 UTC - in response to Message 17552.  


You\'ll just have to shoot those computers. :(


ack! looks like new OS in the new year - hmm Debian?

Seb

ID: 17604 · Report as offensive     Reply Quote
old_user8065

Send message
Joined: 1 Sep 04
Posts: 24
Credit: 10,865,773
RAC: 0
Message 17659 - Posted: 2 Dec 2005, 17:51:15 UTC - in response to Message 17604.  


You\'ll just have to shoot those computers. :(


ack! looks like new OS in the new year - hmm Debian?


I\'m heading for the ultimate solution - replace those old ones (which are too slow to finnish sulphur runs in decent time anyway) with new ones - installing Debian.

I\'ll replace one this month, but I don\'t know about the other one. I can\'t afford down time to re-install it from scratch. I might be forced to detach it from CPDN :(

Metod ...
ID: 17659 · Report as offensive     Reply Quote
Profileold_user6033

Send message
Joined: 31 Aug 04
Posts: 7
Credit: 58,875,069
RAC: 0
Message 17794 - Posted: 6 Dec 2005, 11:44:44 UTC

New version of sulpher client works now though on the glib2.2 machines - at least some work will get done over Christmas :)
ID: 17794 · Report as offensive     Reply Quote
ProfileThyme Lawn
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1283
Credit: 15,824,334
RAC: 0
Message 17797 - Posted: 6 Dec 2005, 12:28:18 UTC - in response to Message 17794.  

New version of sulpher client works now though on the glib2.2 machines - at least some work will get done over Christmas :)

Glad to hear that Seb. You might have lost your #1 spot otherwise :)
"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer
ID: 17797 · Report as offensive     Reply Quote

Message boards : Number crunching : CPDN client for glibc2.2

©2024 cpdn.org