climateprediction.net (CPDN) home page
Thread 'Download server'

Thread 'Download server'

Message boards : Number crunching : Download server
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 58766 - Posted: 17 Sep 2018, 3:08:43 UTC

Is down.
ID: 58766 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 58774 - Posted: 19 Sep 2018, 20:56:22 UTC

Is anyone else having trouble with downloads?

Ping says that it can't find the download server, and the project people seem to have disappeared too.
ID: 58774 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 58776 - Posted: 19 Sep 2018, 21:42:13 UTC - in response to Message 58774.  
Last modified: 19 Sep 2018, 21:43:27 UTC

Yes, Les, me.

With current visual limitation, only this machine was checked. A PNW (Batch 757) task is hung on two downloads, with two more files waiting, on timeouts, in the queue.

If helpful the other boxes will be checked.

Jim
"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 58776 · Report as offensive     Reply Quote
mmonnin

Send message
Joined: 28 May 17
Posts: 49
Credit: 17,334,597
RAC: 7,213
Message 58777 - Posted: 19 Sep 2018, 22:09:35 UTC

Yes I have 5 stuck in download for several days. Some files partially downloaded. Upload trickles are still working.

The whole project site went down the other day but these are still stick. Abort them?
ID: 58777 · Report as offensive     Reply Quote
ProfileAlan K

Send message
Joined: 22 Feb 06
Posts: 491
Credit: 31,033,903
RAC: 14,766
Message 58778 - Posted: 19 Sep 2018, 22:16:40 UTC - in response to Message 58774.  

3 757 series stuck for about 48hrs now.
ID: 58778 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 58780 - Posted: 19 Sep 2018, 23:29:16 UTC

Thanks.
With no one posting for the last days, I was starting to wonder if I'd drifted into an alternative universe. :)

I was half way through downloading 4 new tasks several days ago, when it all suddenly stopped.
I reported the problem, was told it would be looked into, and then the project started going down and coming back up again for a day or two.

A few hours ago I aborted everything, and waited for the delay to finish so that I could start again, in case it was a "bad connection" of some sort.
But nothing will download, so it seems "permanent".

My guess now, is that the profs are away somewhere giving talks / having discussions, and whatever else they do between terms.

So, hold onto what you have, and we'll just have to wait.

I'll send one more email, but I'm not hopeful.
ID: 58780 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Jan 06
Posts: 637
Credit: 26,751,529
RAC: 653
Message 58782 - Posted: 20 Sep 2018, 1:39:52 UTC - in response to Message 58780.  
Last modified: 20 Sep 2018, 1:40:07 UTC

With no one posting for the last days, I was starting to wonder if I'd drifted into an alternative universe. :)

I have five stuck in download (1-so2dms, 2-pnw25, 2-OSTIA) on one machine. But it is the other machine that hurts. I had just converted it to Windows, and it got stuck on the first download.
I think I will leave off for a while.
ID: 58782 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 58786 - Posted: 20 Sep 2018, 15:20:47 UTC

Hi Les,

Thanks for the info. At the time I we tested David was off site so outside the network (but had initially had issues). Unfortunately now talking to departmental IT it has become apparent that this is likely reason (1) rather than reason (2). We are currently pushing them to try and get this fixed ASAP and they are currently working on it in consultation with the storage vendors.

They have said they will let us know the timescales involved later today so I will pass on the information once I know it.

Best wishes,
Sarah

Reason 1 being a firewall issue.Reason 2 Permissions issue.
ID: 58786 · Report as offensive     Reply Quote
bernard_ivo

Send message
Joined: 18 Jul 13
Posts: 438
Credit: 25,620,508
RAC: 4,981
Message 58787 - Posted: 20 Sep 2018, 15:23:21 UTC

I haven't been able to download from the server for the last 2 days and even after abort I get an error message: Not requesting tasks: some download stalled. This a WINE machine. I temporarily switch this machine to WCG until download is fixed.
ID: 58787 · Report as offensive     Reply Quote
ProfileVicki

Send message
Joined: 28 Nov 15
Posts: 50
Credit: 4,099,809
RAC: 0
Message 58788 - Posted: 20 Sep 2018, 22:01:05 UTC - in response to Message 58787.  

I too am stuck with downloads from the PNW series. hAVING REBUILT MY DESKTOP after something scrammed the partition table, I am playing hurry up & wait. Oddly I had little trouble getting some seti tasks, so at least it is crunching something in the meantime.
ID: 58788 · Report as offensive     Reply Quote
BetelgeuseFive

Send message
Joined: 31 Aug 04
Posts: 10
Credit: 2,538,005
RAC: 0
Message 58790 - Posted: 21 Sep 2018, 15:27:32 UTC

I am also having download problems, got 3 tasks but I am no able to download a single one. Lots of messages like this:

21/09/2018 17:24:32 | climateprediction.net | Temporarily failed download of so2dms_rcp85_N96_2049_2060.gz: transient HTTP error

Tom
ID: 58790 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 58791 - Posted: 21 Sep 2018, 17:23:03 UTC

Hi all,

Update for you all on this. IT are working on the problem and their best estimate currently is that this will be resolved sometime early next week.

We will keep you updated with further information when we have it.

Best wishes,
Sarah
ID: 58791 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Jan 06
Posts: 637
Credit: 26,751,529
RAC: 653
Message 58792 - Posted: 22 Sep 2018, 16:43:56 UTC

Curiously, the Server status page shows that the number of unsent work units keeps going down. They aren't being sent to me.
ID: 58792 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 58793 - Posted: 22 Sep 2018, 18:24:00 UTC - in response to Message 58792.  

I noticed that, too, and still have stuck downloads.

It makes me wonder when the count is decremented -- when marked for download or when download is successfully completed. It's a stretch but could it be that not all Batches are affected? We've seen stranger things over the years, eh?

I'll ask.
"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 58793 · Report as offensive     Reply Quote
ProfileAlan K

Send message
Joined: 22 Feb 06
Posts: 491
Credit: 31,033,903
RAC: 14,766
Message 58796 - Posted: 22 Sep 2018, 22:35:40 UTC - in response to Message 58793.  

Most of my stuck downloads are batch 757 but one is from batch 754. Also I have 3 batch 757 that have dowloaded OK are are running OK.
ID: 58796 · Report as offensive     Reply Quote
Ingleside

Send message
Joined: 5 Aug 04
Posts: 127
Credit: 24,488,145
RAC: 21,123
Message 58800 - Posted: 23 Sep 2018, 15:57:28 UTC - in response to Message 58793.  

The count decreases then it's assigned to you, since obviously the same task can't be issued to someone else. Also the scheduling-server doesn't know, and doesn't care, if the download-server is working or not.
ID: 58800 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 58801 - Posted: 23 Sep 2018, 17:29:35 UTC - in response to Message 58800.  

Thank you! Appreciated.
"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 58801 · Report as offensive     Reply Quote
ProfileIain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1084
Credit: 7,824,485
RAC: 4,956
Message 58805 - Posted: 25 Sep 2018, 10:45:53 UTC

My downloads have all now completed.
ID: 58805 · Report as offensive     Reply Quote
Albert H.

Send message
Joined: 18 Feb 06
Posts: 73
Credit: 61,741,444
RAC: 46,410
Message 58808 - Posted: 25 Sep 2018, 12:54:17 UTC - in response to Message 58766.  

Mine too. :)
ID: 58808 · Report as offensive     Reply Quote
mmonnin

Send message
Joined: 28 May 17
Posts: 49
Credit: 17,334,597
RAC: 7,213
Message 58812 - Posted: 26 Sep 2018, 0:24:33 UTC

I'll third that.
ID: 58812 · Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : Download server

©2024 cpdn.org