climateprediction.net (CPDN) home page
Thread 'No work for Linux either now.'

Thread 'No work for Linux either now.'

Questions and Answers : Unix/Linux : No work for Linux either now.
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3

AuthorMessage
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 59010 - Posted: 15 Nov 2018, 7:36:05 UTC - in response to Message 59009.  

I and others have emailed the project about the trickles issue on the website for these tasks.
ID: 59010 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 59011 - Posted: 15 Nov 2018, 17:23:46 UTC - in response to Message 59010.  
Last modified: 15 Nov 2018, 17:24:17 UTC

I and others have emailed the project about the trickles issue on the website for these tasks.


I know. Does the project ever acknowledge your emails?

I just sent another trickle for each of my two current work units.

15-Nov-2018 00:33:39 Finished upload of hadcm3s_s163_190012_120_771_011667985_1_r1015151956_4.zip
15-Nov-2018 03:57:19 Finished upload of hadcm3s_st510_190012_120_771_011666946_1_r701299043_4.zip

I do not so much mind the lack of visual feedback on the web site, but I sure hope those trickles are getting to where they need to go.
ID: 59011 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 59012 - Posted: 15 Nov 2018, 17:58:20 UTC - in response to Message 59011.  

The trickles are I understand more to do with credit. It is the zips that get uploaded that provide the information to the scientists. I am assured there is no doubt that the information is getting back to them even when the trickles do not appear on the website. I have been told that they will take another look at the trickles not appearing for these tasks but I don't know where it sits in the priority list.
ID: 59012 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 59014 - Posted: 17 Nov 2018, 15:54:23 UTC - in response to Message 59012.  

The trickles are I understand more to do with credit. It is the zips that get uploaded that provide the information to the scientists.


But it is the trickles that upload the zips. So the scientists need the zips that are uploaded with each trickle. So it seems to me that trickles have more to do with sending the work than merely giving credit.

Here is my most recent trickle:

17-Nov-2018 06:26:08 Finished upload of hadcm3s_s163_190012_120_771_011667985_1_r1015151956_6.zip
ID: 59014 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 59015 - Posted: 17 Nov 2018, 16:37:15 UTC - in response to Message 59014.  

Ian who understands these things far better than I think I ever will has emailed the project with some ideas on this. - To do with the different format of the zip names on different trickles for these tasks. May find out next week if this is part of the problem.
ID: 59015 · Report as offensive     Reply Quote
Dave Roberts

Send message
Joined: 15 Jan 11
Posts: 175
Credit: 6,242,691
RAC: 699
Message 59016 - Posted: 17 Nov 2018, 19:44:04 UTC

I've always understood Dave's interpretation to be correct.
In logs of my recent tasks, there are trickles without zip uploads and also zip uploads without a prior trickle

EG
Sun 11 Nov 00:01:47 2018 | climateprediction.net | Sending scheduler request: To send trickle-up message.
Sun 11 Nov 00:01:47 2018 | climateprediction.net | Not requesting tasks: "no new tasks" requested via Manager
Sun 11 Nov 00:01:48 2018 | climateprediction.net | Scheduler request completed

Sun 11 Nov 04:51:33 2018 | climateprediction.net | Started upload of hadcm3s_n847_190012_120_771_011670374_0_r606276455_out.zip
Sun 11 Nov 04:51:34 2018 | climateprediction.net | Computation for task hadcm3s_n847_190012_120_771_011670374_0 finished

However, many zip uploads hasve been preceded by a trickle, albeit with a slight time delay.

Fri 16 Nov 12:10:49 2018 | climateprediction.net | Sending scheduler request: To send trickle-up message.
Fri 16 Nov 12:10:49 2018 | climateprediction.net | Not requesting tasks: "no new tasks" requested via Manager
Fri 16 Nov 12:10:50 2018 | climateprediction.net | Scheduler request completed

Fri 16 Nov 17:31:01 2018 | climateprediction.net | Sending scheduler request: To send trickle-up message.
Fri 16 Nov 17:31:01 2018 | climateprediction.net | Not requesting tasks: "no new tasks" requested via Manager
Fri 16 Nov 17:31:02 2018 | climateprediction.net | Scheduler request completed

Fri 16 Nov 17:32:09 2018 | climateprediction.net | Started upload of hadcm3s_su139_190012_120_771_011667641_0_r717114851_5.zip
Fri 16 Nov 17:33:49 2018 | climateprediction.net | Finished upload of hadcm3s_su139_190012_120_771_011667641_0_r717114851_5.zip

It's certainly trickles that start the credit calcs, perhaps they have a final task to see if any zips need uploading?
ID: 59016 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 59017 - Posted: 17 Nov 2018, 20:05:39 UTC

Yes, zips and tickles are unrelated.
Although the trickles have at times been used to upload small amounts of data, their original, and still main purpose, is for the credit calcs.

And I think that the hadcm3s problem has been solved. Now it just needs to be fixed.
But it's the weekend again.
ID: 59017 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 59036 - Posted: 20 Nov 2018, 8:04:03 UTC - in response to Message 59017.  

Plan is to rebuild the hadcm3s application and hopefully sort out the zips problem once and for all on it.
ID: 59036 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 59071 - Posted: 22 Nov 2018, 2:26:26 UTC - in response to Message 58996.  

Both had a first run on the same Linux computer, and they both failed after about 4.75 days when they couldn't find a library file.

If yours are completing, your software is superior in that it has all the missing 32 bit libs.


My software must be superior then. One of them has now completed successfully.

Task
click for details Computer Sent Time reported
or deadline
explain Status Run time
(sec) CPU time
(sec) Credit Application
21374094 1256552 10 Nov 2018, 19:23:32 UTC 22 Nov 2018, 1:06:34 UTC Completed 886,134.98 823,317.80 3,111.26 UK Met Office HadCM3 short v8.34
i686-pc-linux-gnu
21367030 1303288 5 Nov 2018, 23:15:53 UTC 10 Nov 2018, 19:22:04 UTC Error while computing 415,185.36 411,072.20 3,111.26 UK Met Office HadCM3 short v8.34
i686-pc-linux-gnu

ID: 59071 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 59074 - Posted: 22 Nov 2018, 14:07:30 UTC - in response to Message 59071.  

If yours are completing, your software is superior in that it has all the missing 32 bit libs.

My software must be superior then. One of them has now completed successfully.

And here is what is in it:

Red Hat Enterprise Linux Server release 6.10 (Santiago)
boinc[~/projects/climateprediction.net]$ ldd hadcm3s_8.34_i686-pc-linux-gnu
linux-gate.so.1 => (0x00abd000)
libpthread.so.0 => /lib/libpthread.so.0 (0x00cef000)
libdl.so.2 => /lib/libdl.so.2 (0x00d0c000)
libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x00b5f000)
libm.so.6 => /lib/libm.so.6 (0x00da1000)
libgcc_s.so.1 => /lib/libgcc_s.so.1 (0x00aff000)
libc.so.6 => /lib/libc.so.6 (0x0016d000)
/lib/ld-linux.so.2 (0x565a3000)
ID: 59074 · Report as offensive     Reply Quote
Miroslav Fotyi

Send message
Joined: 15 Feb 10
Posts: 1
Credit: 200,842
RAC: 0
Message 59091 - Posted: 26 Nov 2018, 5:15:17 UTC

Také po delší době bych se rád zapojil do výpočtů klimatu a jak tak koukám, pro linux není práce.... že se nestydíte a posporujete jenom ten fůůůj windows !!!
ID: 59091 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 59093 - Posted: 26 Nov 2018, 8:03:48 UTC - in response to Message 59091.  

You can install WINE to run Windows tasks. I have one hadcm3s task running on this machine and windows tasks under WINE currently on my other one.

Můžete nainstalovat WINE pro spuštění úloh systému Windows. Mám jednu úlohu hadcm3s spuštěnou na tomto stroji a Windows úkoly v rámci WINE aktuálně na mé druhé.

(Google translate, I don't speak Czech unfortunately.)
ID: 59093 · Report as offensive     Reply Quote
wolfman1360

Send message
Joined: 18 Feb 17
Posts: 81
Credit: 14,026,121
RAC: 895
Message 60079 - Posted: 5 May 2019, 16:23:55 UTC - in response to Message 57992.  

I get caught when Win10 restarts after updates and I'm not around to manage this new manifestation of corporate arrogance.

I briefly considered installing Win10 on my Ryzen+ build later this year, but quickly drew back from such insanity.

EDIT: I should point out that I use Win10 on a laptop and a second machine, but for a cruncher build where I need to control everything from drivers to reboots, it is a non-starter for me. And I don't even have control of the base OS. MS can change it out at any time and still call it "Win 10". What will they think of next?

I'm running Windows 10 home over here with a 75 day uptime. I'm not doing anything specific, not setting it to have a metered connection or disabling the update service.

The only reason I restarted before was that I specifically went to Windows update and 1809 wasn't even downloaded, let alone ready to be installed. That triggered the process and so I went for it.

Maybe your mileage may vary from machine to machine? I'm also on AMD, which probably gets less priority / fixes than the Intel equivalents?

I also run Tiny wall firewall but don't have Windows update actually blocked (although you could probably do that if you wanted and really tighten up control of exactly when and what phones home.

Just my .02.
ID: 60079 · Report as offensive     Reply Quote
Tamara

Send message
Joined: 24 Aug 19
Posts: 1
Credit: 54,249
RAC: 0
Message 61109 - Posted: 30 Sep 2019, 19:49:37 UTC - in response to Message 60079.  

Just got 4 tasks for my DL380 with CentOS7

Computer: 192.168.8.10
Project climateprediction.net

Name hadam4_a07a_209310_12_838_011900568_2

Application UK Met Office HadAM4 at N144 resolution 8.09
Workunit name hadam4_a07a_209310_12_838_011900568
State Running
Received 9/29/2019 11:48:07 PM
Report deadline 9/11/2020 5:07:55 AM
Estimated app speed 2.91 GFLOPs/sec
Estimated task size 4,821,562 GFLOPs
CPU time at last checkpoint 03:06:05
CPU time 03:57:33
Elapsed time 03:58:55
Estimated time remaining 18d,22:40:27
Fraction done 1.052%
Virtual memory size 652.06 MB
Working set size 635.55 MB
Directory slots/3
Process ID 3640
ID: 61109 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3

Questions and Answers : Unix/Linux : No work for Linux either now.

©2024 cpdn.org