climateprediction.net (CPDN) home page
Thread 'Zip files'

Thread 'Zip files'

Message boards : Number crunching : Zip files
Message board moderation

To post messages, you must log in.

AuthorMessage
old_user101781
Avatar

Send message
Joined: 10 Oct 05
Posts: 49
Credit: 74,483
RAC: 0
Message 17172 - Posted: 14 Nov 2005, 8:55:18 UTC

Yesterday I have just uploaded my first sulphur zip files, can anyone tell me how big they are? I am asking this because mine started to upload at 21:14:04 and did not finish until 21:19:19. That is over five minutes, I am using broadband so the rate was at 27759 bytes per sec. My calculations put it at around 8M is this correct?
ID: 17172 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 17173 - Posted: 14 Nov 2005, 9:37:37 UTC

That\'s about right. My two are 8.4M and 2.4M. 6 more trickles before I find out the size of the 3rd zip.
They\'re a lot bigger than slab.
ID: 17173 · Report as offensive     Reply Quote
crandles
Volunteer moderator

Send message
Joined: 16 Oct 04
Posts: 692
Credit: 277,679
RAC: 0
Message 17175 - Posted: 14 Nov 2005, 11:45:53 UTC

I think it is only the first that is 8MB the others are all about 2.4MB.
Visit BOINC WIKI for help

And join BOINC Synergy for all the news in one place.
ID: 17175 · Report as offensive     Reply Quote
Profile[B@H] Ray
Avatar

Send message
Joined: 19 Aug 05
Posts: 104
Credit: 1,866,495
RAC: 0
Message 17963 - Posted: 10 Dec 2005, 4:59:41 UTC

The one that I have waiting at the end of Phase 4 is 2.4 Megs. Looks like it will be a big one at the end of Phase 5 though.

Ray
Keep on crunching Pizza@Home
ID: 17963 · Report as offensive     Reply Quote
ProfileHonza
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 390
Credit: 2,475,242
RAC: 0
Message 18007 - Posted: 10 Dec 2005, 20:27:19 UTC - in response to Message 17963.  

The one that I have waiting at the end of Phase 4 is 2.4 Megs. Looks like it will be a big one at the end of Phase 5 though.

Ray,
IIRC, final upload on Phases 5 was again just about 2.5 Megs which makes all phases upload to fit 20 Megs in total.

<i>phpBB forum for CPDN, all are </i><a href="http://www.climateprediction.net/board">invited</a>
ID: 18007 · Report as offensive     Reply Quote
Profile[B@H] Ray
Avatar

Send message
Joined: 19 Aug 05
Posts: 104
Credit: 1,866,495
RAC: 0
Message 18757 - Posted: 27 Dec 2005, 0:34:15 UTC - in response to Message 18007.  

The one that I have waiting at the end of Phase 4 is 2.4 Megs. Looks like it will be a big one at the end of Phase 5 though.

Ray,
IIRC, final upload on Phases 5 was again just about 2.5 Megs which makes all phases upload to fit 20 Megs in total.


Honza
If there is only 20 megs sent in, which files should we zip and archive for storage? My dataout folder is now at 1.98 Gig in size, and the zip backup at phase 5 trickle 177 was 1.22 gig. The backup was of the complete Boinc folder includeing 3 projects. I figure that the dataout would be about .9 gig when completed and zipped. That will be a pain to put into 2 zip files to put on 2 CD\'s.
Ray
Keep on crunching Pizza@Home
ID: 18757 · Report as offensive     Reply Quote
Profileold_user5994

Send message
Joined: 31 Aug 04
Posts: 239
Credit: 2,933,299
RAC: 0
Message 18765 - Posted: 27 Dec 2005, 8:12:06 UTC

Ray,

I am not sure about this, but my memory tells me that the expected size of the Sulfur model\'s save zips will be about 600M, Slabs are 300M and change.
ID: 18765 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 18922 - Posted: 1 Jan 2006, 22:06:57 UTC

Actually, a completed sulphur model is zipped down to a little less than 1 GB at the end, but it can get up to 2.5 GB right before that.
ID: 18922 · Report as offensive     Reply Quote
ProfileHonza
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 390
Credit: 2,475,242
RAC: 0
Message 18925 - Posted: 2 Jan 2006, 10:22:11 UTC - in response to Message 18922.  
Last modified: 2 Jan 2006, 10:24:07 UTC

Actually, a completed sulphur model is zipped down to a little less than 1 GB at the end, but it can get up to 2.5 GB right before that.
Correct,
@ Ray and others: you may try to re-RAR the completed model package.
Slab went down from 340MB Zip files to 288MB RAR (best compression) so 85% of the original.
Sulphur use gZIP compression and went down from 1000MB gz to 882 MB RAR. Still will not fit to a single CD...but one may put 5 re-RARed SC models to a DVD-R instead of 4 original ZIPped.
<i>phpBB forum for CPDN, all are </i><a href="http://www.climateprediction.net/board">invited</a>
ID: 18925 · Report as offensive     Reply Quote
Profile[B@H] Ray
Avatar

Send message
Joined: 19 Aug 05
Posts: 104
Credit: 1,866,495
RAC: 0
Message 18938 - Posted: 2 Jan 2006, 20:03:28 UTC
Last modified: 2 Jan 2006, 20:20:00 UTC

Mine will finish up tomarrow 03 Jan. 2006. Will zip the models folders and save on one of the spair HD\'s that I have. I have 3 spair HD\'s on the shelf, may as well put one to work. Don\'t have a DVD burner yet, but someday. There is plunty of room for keeping them all on ether of the systems also, but don\'t like to store there.

At timestep 250,531 of Phase 5 the output folder is at 2.29 Gig in size. Will be out all night, so will stop it to be here when it finishes.

This one went bad on 17 Sept. 05, but I had a two day old backup to restore and not louse most of the time that I had put into it. Will the results page correct itself after it is completed? Now is says:
Over Client error Downloaded 2,958,481.00 18,960.21 18,960.21

But as everyone says you can still complete a work unit that went bad as long as you have a good back up to restore.

My first completed one so far, the other system has one in Phase 2 at this point. May give this system a brake from Sulpher for a while and get another near the end of Jan., give Rosetta more time for a while.

Ray
Keep on crunching Pizza@Home
ID: 18938 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 18940 - Posted: 3 Jan 2006, 1:05:15 UTC

Unless something changed, once stigmatized, always stigmatized. Credit will reflect full run stats, though. (I have some successfully-completed Runs logged as errored on the Results page.)

As far as the science is concerned, it matters not a whit what is on the Results page. They\'re separate data bases; one for science, one for stats.

Consider it a badge of honor, Ray; the Model crashed somewhere along the way but you had a backup and sent it on its way again: Another Phoenix risen.

"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 18940 · Report as offensive     Reply Quote
Profile[B@H] Ray
Avatar

Send message
Joined: 19 Aug 05
Posts: 104
Credit: 1,866,495
RAC: 0
Message 18943 - Posted: 3 Jan 2006, 3:38:07 UTC - in response to Message 18940.  

Consider it a badge of honor, Ray; the Model crashed somewhere along the way but you had a backup and sent it on its way again: Another Phoenix risen.


That is always a good way of looking at it. Had to restore that one 2 times, the 2nd time lightning hit the power lines here, took out the degital TV converter, microwave and the UPS. But the UPS did it\'s job of protecting the computer even if I had to restore the backup again. Two mounths into it, that would have hurt even though I had credit for what was turned in. The work is more important them the credit.

Cheers
Ray

Keep on crunching Pizza@Home
ID: 18943 · Report as offensive     Reply Quote
Profile[B@H] Ray
Avatar

Send message
Joined: 19 Aug 05
Posts: 104
Credit: 1,866,495
RAC: 0
Message 18959 - Posted: 3 Jan 2006, 19:04:55 UTC

I got the model turned in today, will wait a couple weeks before starting another. But I did increase the amount of time given to the model I have running on the other system so I will still be turning in one trickle a day. Feels good finally having one completely finished, that is better than when I get the credit.

Cheers
Ray
Keep on crunching Pizza@Home
ID: 18959 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 18960 - Posted: 3 Jan 2006, 19:33:09 UTC

Congrats! Every finished Model helps the cause.

The results page will still show an error for that Work Unit but will also show full credit -- and the science team gets what it needs from your effort.

Two recoveries and Run completed; a fine example of the value of backups, Ray.

"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 18960 · Report as offensive     Reply Quote

Message boards : Number crunching : Zip files

©2024 cpdn.org