climateprediction.net home page
disk space

disk space

Message boards : Number crunching : disk space
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile old_user111507

Send message
Joined: 23 Nov 05
Posts: 22
Credit: 2,807,102
RAC: 0
Message 22209 - Posted: 19 Apr 2006, 22:11:54 UTC

client keeps telling me i dont have enough disk space, i have plenty. What gives?
ID: 22209 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 22210 - Posted: 19 Apr 2006, 22:20:58 UTC

Either you have a lot of failed/old models taking up space, or you need to tell BOINC how much it can use.
You do this by setting an option in general preferences on your Account page.


ID: 22210 · Report as offensive     Reply Quote
Profile old_user111507

Send message
Joined: 23 Nov 05
Posts: 22
Credit: 2,807,102
RAC: 0
Message 22211 - Posted: 19 Apr 2006, 22:59:26 UTC

actually i just finshed a w/u, seems to have uploaded sucessfully, i really dont want to give the client more disk space since i have some machines that have pretty small drives im already giving it 2.50 Gigs. mabey i\'ll just delete the folder and reinstall...Thanks Les
ID: 22211 · Report as offensive     Reply Quote
Profile old_user111507

Send message
Joined: 23 Nov 05
Posts: 22
Credit: 2,807,102
RAC: 0
Message 22212 - Posted: 19 Apr 2006, 23:07:05 UTC

never mind . i did have quite a few failed units, deleted, everythings fine now. thanks again Les...
ID: 22212 · Report as offensive     Reply Quote
Profile old_user177151
Avatar

Send message
Joined: 20 Mar 06
Posts: 110
Credit: 1,475,965
RAC: 0
Message 22337 - Posted: 23 Apr 2006, 19:49:18 UTC
Last modified: 23 Apr 2006, 19:49:47 UTC

If the client reports lack of disk space, does it crash the model, or will it \'suspend\' and continue when more space is given?

ID: 22337 · Report as offensive     Reply Quote
Profile astroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 22364 - Posted: 24 Apr 2006, 23:40:23 UTC - in response to Message 22337.  

If the client reports lack of disk space, does it crash the model, or will it \'suspend\' and continue when more space is given?

Crash, with finality, unless you have a proper backup.
"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 22364 · Report as offensive     Reply Quote
Profile old_user111507

Send message
Joined: 23 Nov 05
Posts: 22
Credit: 2,807,102
RAC: 0
Message 22366 - Posted: 25 Apr 2006, 0:08:27 UTC

thanks astro, i was hoping Les would respond...Markus
ID: 22366 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 22368 - Posted: 25 Apr 2006, 1:05:49 UTC

Sorry, I didn\'t reply because I didn\'t know.

I found out decades ago, that allowing a disk to get too close to being full was asking for trouble. I\'m not sure how it works now, but back then, even small files took up lots of space, because it was allocated in \'chunks\'; so a 10 byte file would actually be, perhaps, 1K. And there was always the chance that some of the indicated free space had already been detected as \'bad sectors\', and locked off.

So I make sure that I have plenty of elbow room these days. Or that I know which stores currently have a \'good deal\' on hds.
But I had a feeling that the program would crash.
It was written for big main frames, where space was available, and not taken up by lots of small fiddly programs when it was being run. So it comes as a shock to it when it hits a brick wall. This is just one more instance of when it will crash.

Think of it as a wild animal, and give it plenty of space.

(Let\'s see, Western Digital 250G, $220. Seagate 300G, $169.)


ID: 22368 · Report as offensive     Reply Quote
Profile old_user177151
Avatar

Send message
Joined: 20 Mar 06
Posts: 110
Credit: 1,475,965
RAC: 0
Message 22371 - Posted: 25 Apr 2006, 2:55:50 UTC - in response to Message 22368.  
Last modified: 25 Apr 2006, 2:56:25 UTC


Think of it as a wild animal, and give it plenty of space.

No, that\'s \'er indoors :)

Will it crash when it hits the value in use no more than in general preferences, or when physical disk space gives out?

ID: 22371 · Report as offensive     Reply Quote
Profile old_user111507

Send message
Joined: 23 Nov 05
Posts: 22
Credit: 2,807,102
RAC: 0
Message 22372 - Posted: 25 Apr 2006, 3:20:01 UTC

it very well just might, 99.000123456%.... just make Sure you back the WHOLE directory before you change your prefs....
ID: 22372 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 22375 - Posted: 25 Apr 2006, 6:36:38 UTC

Will it crash when it hits the value in use no more than in general preferences, or when physical disk space gives out?


Probably: whichever comes first. Like I said, give it room.

ID: 22375 · Report as offensive     Reply Quote
Profile old_user177151
Avatar

Send message
Joined: 20 Mar 06
Posts: 110
Credit: 1,475,965
RAC: 0
Message 22377 - Posted: 25 Apr 2006, 6:51:48 UTC - in response to Message 22372.  

it very well just might, 99.000123456%.... just make Sure you back the WHOLE directory before you change your prefs....

OK, I\'m happy now. My general prefs still say the default of \'use no more than 100GB\'. My BOINC directory only stands at 878MB and I have 31.6GB disk space left on this drive, so I should be OK for a while, but I need to think about relocating the BOINC directory to another drive since that 31.6GB is sure to get eaten into by other stuff.

Thanks all for your help.

ID: 22377 · Report as offensive     Reply Quote
Profile old_user111507

Send message
Joined: 23 Nov 05
Posts: 22
Credit: 2,807,102
RAC: 0
Message 22393 - Posted: 25 Apr 2006, 17:36:37 UTC

100 Gigs is overdoing it a bit, espacially since you only have 31.6. i think 2.5 is the minimum and 6 should be plenty. As i just found out, failed w/u\'s do not automaticly get deleted, and can eventually consume your whole boinc directory
ID: 22393 · Report as offensive     Reply Quote
Profile old_user177151
Avatar

Send message
Joined: 20 Mar 06
Posts: 110
Credit: 1,475,965
RAC: 0
Message 22396 - Posted: 25 Apr 2006, 18:43:08 UTC - in response to Message 22393.  
Last modified: 25 Apr 2006, 18:48:07 UTC

100 Gigs is overdoing it a bit, espacially since you only have 31.6. i think 2.5 is the minimum and 6 should be plenty. As i just found out, failed w/u\'s do not automaticly get deleted, and can eventually consume your whole boinc directory

Thanks Marcus. Hey, 6 GB is even plenty for a complete XP installation. The 100GB is the default set by the client on installation. So I guess I just need to work things out and keep an eye out for a climate model growing, and when appropriate find out how to delete the unwanted w/u\'s.

PS It\'s not like a have disk space problem, I have nearly a terrabyte of GBs on this one PC, but new to all this and would like to know before I start reorganizing.


ID: 22396 · Report as offensive     Reply Quote
Profile old_user111507

Send message
Joined: 23 Nov 05
Posts: 22
Credit: 2,807,102
RAC: 0
Message 22400 - Posted: 26 Apr 2006, 1:50:45 UTC - in response to Message 22364.  

What happend astro....did you quit our team???....Markus
ID: 22400 · Report as offensive     Reply Quote
Profile old_user96693

Send message
Joined: 6 Sep 05
Posts: 50
Credit: 97,106
RAC: 0
Message 22403 - Posted: 26 Apr 2006, 13:25:50 UTC

Generally I just move old completed/crashed (none yet) models to another location until I have enough to fill a DVD then burn them off.

This keeps the CPDN Boinc Directory under 1.5 to 2 gig.
ID: 22403 · Report as offensive     Reply Quote
Profile old_user177151
Avatar

Send message
Joined: 20 Mar 06
Posts: 110
Credit: 1,475,965
RAC: 0
Message 22467 - Posted: 29 Apr 2006, 9:33:59 UTC - in response to Message 22403.  
Last modified: 29 Apr 2006, 9:35:38 UTC

Generally I just move old completed/crashed (none yet) models to another location until I have enough to fill a DVD then burn them off.

This keeps the CPDN Boinc Directory under 1.5 to 2 gig.

I think that\'s a winning idea. I tend to use rewrittable DVDs in case I need to add to my archived DVD-RW, BUT because of the cost of DVD-Rs - which have come down so much so that cutting to DVD-R is economical (I\'ve had a few problems trying to recover from DVD-RW after adding to them with newer/different burners.)

ID: 22467 · Report as offensive     Reply Quote
Profile astroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 22484 - Posted: 29 Apr 2006, 19:00:04 UTC

Once upon a time (read: Classic/\'Slab\'/Sulphur Cycle era) much data was zipped and stored on participants\' machines for self-study or future reference by the science team. (Martin Sykes developed an excellent analysis tool for use with Slab Results.)

With the coming of the Coupled Model, more data are uploaded and nothing remains after the end of the Run. (Unfortunately, there isn\'t a cleanup-after-crash janitorial routine. [Probably get one when Carl & Tolu have some free time. {\"Free time\" is a joke; they\'re continually buried in work and lower-priority work doesn\'t always get done.}])
"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 22484 · Report as offensive     Reply Quote

Message boards : Number crunching : disk space

©2024 cpdn.org