climateprediction.net (CPDN) home page
Thread 'upload server error : No space left on device'

Thread 'upload server error : No space left on device'

Message boards : Number crunching : upload server error : No space left on device
Message board moderation

To post messages, you must log in.

AuthorMessage
Eirik Redd

Send message
Joined: 31 Aug 04
Posts: 391
Credit: 219,896,461
RAC: 649
Message 44644 - Posted: 11 Aug 2012, 3:34:43 UTC
Last modified: 11 Aug 2012, 3:38:29 UTC

Full error message is

Fri 10 Aug 2012 10:11:17 PM CDT climateprediction.net [error] Error reported by file upload server: can't open file /storage/incoming/uploader//hadam3p_eu_2rfb_1970_1_008118952_0_7.zip: No space left on device

Server status page shows all servers are up.
Message is occurring for several different eu intermediate files trying to upload from here.
file seems to be going to uploader1.atm.ox.ac.uk
ID: 44644 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 44645 - Posted: 11 Aug 2012, 3:47:31 UTC - in response to Message 44644.  

Ah! It must be the weekend. :)

I'll let them know just in case the alarms didn't work.


Backups: Here
ID: 44645 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 44646 - Posted: 11 Aug 2012, 6:33:59 UTC - in response to Message 44645.  

Will suspend network activity on my three boxes till Monday as all are running eu models.
ID: 44646 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 44712 - Posted: 15 Aug 2012, 17:03:11 UTC - in response to Message 44646.  

Interesting, reading about this on other threads, if my dual core I3 is about average for crunching power and time switched on and assuming 30K active hosts, (a bit below the figure given on the home page. I have 11 zip files waiting to go. That would, I estimate be over 4TB of data waiting to assault the server when it comes back on line!
ID: 44712 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 44713 - Posted: 15 Aug 2012, 21:06:54 UTC - in response to Message 44712.  

It's worse. Because some of the download files are also on that server, they've had to re-enable access to it, and not all of the terabytes of upload data have been moved.
So the server will be getting a hammering, which, from past experience, will cause some download failures, due to process timeouts.


Backups: Here
ID: 44713 · Report as offensive     Reply Quote
Desti

Send message
Joined: 6 Aug 04
Posts: 124
Credit: 9,195,838
RAC: 0
Message 44717 - Posted: 16 Aug 2012, 1:47:24 UTC

Upload server is stated as running now, but still don't accept any uploads?!
Linux Users Everywhere @ BOINC
ID: 44717 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 44718 - Posted: 16 Aug 2012, 1:53:47 UTC - in response to Message 44717.  

Which probably means that it's getting hammered, as I just said.


Backups: Here
ID: 44718 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 44719 - Posted: 16 Aug 2012, 6:56:49 UTC - in response to Message 44718.  

Might just leave it another day before re-enabling network access then.
ID: 44719 · Report as offensive     Reply Quote
Profiletullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 44720 - Posted: 16 Aug 2012, 7:30:03 UTC

I've just uploaded 2 zip files.
Tullio
ID: 44720 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 44723 - Posted: 16 Aug 2012, 16:00:09 UTC

Some of mine went up, others remain hung. Oh, well, I'm shutting machines down to keep the house from becoming an oven. (Forecast includes an "Excessive Heat Warning".) It will all come out okay eventually; 'patience,' I tell myself.

"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 44723 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 44724 - Posted: 16 Aug 2012, 16:02:29 UTC - in response to Message 44723.  

15 zips from 3 machines all gone now but it looks like they have filled the server up again in the process as it has changed colour on the server status web page again.

ID: 44724 · Report as offensive     Reply Quote
Digby

Send message
Joined: 17 Feb 06
Posts: 89
Credit: 4,309,159
RAC: 0
Message 44725 - Posted: 16 Aug 2012, 16:52:32 UTC

Well I smile when I read the posts from Les...he has grown into quite a sage and just takes it all in his stride.

FWIW I heard a program on BBC Radio 4 last night called 'costing the earth' and there was a chap being interviewed who I believe was a government or academic environmental advisor. He seemed quite matter of fact that climate change was occurring and how this would affect British farming and wildlife etc. He seemed to think that by 2060 our climate would be similar to Madeira's current climate...but after that he did not know what would happen. He said that whilst the UK could warm over the coming years it was protected by the Atlantic sinds and so water would still be available...the same could not be said for other countries. My thoughts were 'Its a shame that politicians are not incentivised to think more than 12 months ahead'...I am all for Greenpeace and FOE etc.

Cheers Digby
ID: 44725 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 44727 - Posted: 16 Aug 2012, 18:22:17 UTC

OK going to that one via listen again.. Despite uploader1 showing red, another zip has gone through so maybe I was wrong about it being filled up.

Talking about planning ahead, one of the Oxford colleges a few years back needed a new beam for one of their halls. When deliberating about where they were going to get one from, the Bursar told them, "That oak tree there." It was planted about the same time the hall was built.

That is the sort of planning ahead we need from our politicians!

Dave
ID: 44727 · Report as offensive     Reply Quote
Eirik Redd

Send message
Joined: 31 Aug 04
Posts: 391
Credit: 219,896,461
RAC: 649
Message 44728 - Posted: 17 Aug 2012, 7:38:13 UTC - in response to Message 44727.  
Last modified: 17 Aug 2012, 7:52:58 UTC

Uploader just went green on the server status page -- doesn't mean much - please wait a bit (like a day or two) before hitting the server with uploads.

I've been enabling network access one or twice a day on my 6 hosts - partly to upload trickles, partly to get downloads when running out of work - there's been plenty to download and crunch this last week. "Project backoff" is up to 6 hours on one of my machines.

I run 6 hosts - the problem that is beginning to get bad here is running out of disk space account of not being able to upload. Knowing that the project has to store all our uploads - how many terabytes - or is it exabytes -
our contributions are that big --

Thanks all, have patience, part of the problem is that the crunchers have been creating so much data to upload. That's not a problem - that's just having to deal with a lot of volunteer computed data.
ID: 44728 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 44729 - Posted: 17 Aug 2012, 11:14:04 UTC - in response to Message 44728.  

The zips are only about 13MB each. If you have enough cores and speed to be producing that many of them surely you have a large enough hard disk to store them a little while? It would take a while to fill up the 27GB max I have allowed BOINC.

All my zips went through yesterday 12 from this machine, three from my netbook and on from my partners desktop. I haven't put boinc on her laptop yet. If I do I certainly won't give it any full ocean models as the time it spends switched on is so little!

Dave
ID: 44729 · Report as offensive     Reply Quote
Eirik Redd

Send message
Joined: 31 Aug 04
Posts: 391
Credit: 219,896,461
RAC: 649
Message 44742 - Posted: 18 Aug 2012, 7:22:01 UTC - in response to Message 44729.  

The zips are only about 13MB each. If you have enough cores and speed to be producing that many of them surely you have a large enough hard disk to store them a little while? It would take a while to fill up the 27GB max I have allowed BOINC.

All my zips went through yesterday 12 from this machine, three from my netbook and on from my partners desktop. I haven't put boinc on her laptop yet. If I do I certainly won't give it any full ocean models as the time it spends switched on is so little!

Dave


Yeah -- my "space problem" locally was a misconfiguration - had to update config to allow the few more gigs the backlog caused -- advice-- allow lots of extra disk space - it's cheap.

I have 3 quad-cores an hex and two duals - one slow, one fast.

I've been deliberately waiting for others to upload and trying to get new work as or when available. Will enable upload for my boxen one or 2 at a time the next day or so.

Right now my uploads are slowly clearing - only have slow DSL --
Hey until 3 years ago I was supporting this project over dial-up.

Thanks for your useful recent comments - and -

Keep on crunching!

Thanks to all



ID: 44742 · Report as offensive     Reply Quote
Eirik Redd

Send message
Joined: 31 Aug 04
Posts: 391
Credit: 219,896,461
RAC: 649
Message 44743 - Posted: 18 Aug 2012, 7:26:22 UTC - in response to Message 44729.  
Last modified: 18 Aug 2012, 7:28:45 UTC

Sorry for multiple posts - server and link so slow -- apologies
ID: 44743 · Report as offensive     Reply Quote

Message boards : Number crunching : upload server error : No space left on device

©2024 cpdn.org