Message boards : Number crunching : Upload pending
Message board moderation
Author | Message |
---|---|
Send message Joined: 26 Jun 06 Posts: 7 Credit: 158,935 RAC: 0 |
Hi! Running your files have created a bunch of hadam3p_eu_xxxx...zip files. These apparently won't upload. They've been sitting in "Transfers" for days, a few saying "100 %" and "Upload: pending (project backoff.." most saying "0 %" Upload: pending ... ". "Retry now" has no apparent effect. Same in "Tasks" finished runs just sitting there saying "100 %" and "Uploading" but nothing is happening. Running BOINC 7.0.28 (64x) on win 64. Server down? Line down? |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
|
Send message Joined: 26 Jun 06 Posts: 7 Credit: 158,935 RAC: 0 |
Hi! Errrmmm... server full...? That would do it, I guess. How... Why don't... oh, never mind. :) We're too productive for them! Thanks! |
Send message Joined: 18 Dec 11 Posts: 4 Credit: 64,484 RAC: 0 |
I've got the same problem (4 zip files waiting at the moment). Any idea how long the server will be down for? |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
|
Send message Joined: 26 Jun 06 Posts: 7 Credit: 158,935 RAC: 0 |
Even moving terabytes shouldn't take days... |
Send message Joined: 15 May 09 Posts: 4540 Credit: 19,039,635 RAC: 18,944 |
Even moving terabytes shouldn't take days... On one occasion recently when stuff had to be moved it was a couple of Terabytes. The speed all depends on the speed of the network. if 100MB/second=6GB/min=360GB/hour=8.64GB/day. My guess is that 100MB/s is optimistic even if the data isn't being verified. Add on verification and I don't know how much time it adds. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
Wait and see. And this thread should have been in Number Crunching, not the Science section, as it's nothing to do with the science of climate modelling. Backups: Here |
Send message Joined: 18 Dec 11 Posts: 4 Credit: 64,484 RAC: 0 |
Sorry Les. :-) |
Send message Joined: 26 Jun 06 Posts: 7 Credit: 158,935 RAC: 0 |
My bad. Sorry. Haven't posted here before and was unclear on the areas. Will try to do right in the future :) |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
It turns out to be terabytes, not gigabytes. And it's live data, to which researchers have access for running data extraction queries. So care has to be taken in moving it. Because some of the download files are also on that server, they've had to re-enable access to it, and not all of the terabytes of upload data have been moved. Expect things to be slow, and for the server to quickly re-fill. Backups: Here |
Send message Joined: 26 Jun 06 Posts: 7 Credit: 158,935 RAC: 0 |
All this talk of cumbersome moving of files makes one ponder the marvels of server area networks and clustered solutions. |
Send message Joined: 5 Aug 04 Posts: 1496 Credit: 95,522,203 RAC: 0 |
All this talk of cumbersome moving of files makes one ponder the marvels of server area networks and clustered solutions. All it requires is a huge budget, for hardware, for staff ... "We have met the enemy and he is us." -- Pogo Greetings from coastal Washington state, the scenic US Pacific Northwest. |
Send message Joined: 26 Jun 06 Posts: 7 Credit: 158,935 RAC: 0 |
Well yes. There is always that. The opposite strategy would be shutting down the server, plug a cheap drive into a physical port, copy the files, have someone physically run it over to wherever it should go and call and say whether it went allright. Then delete the originals. In my darker moments I wistfully wonder which is really the most efficient and safe. If against all odds it hadn't already occurred to you, I'm neither complaining nor being very serious. Not my intent to po anyone. Please feel free to ignore, terminate, delete or move this thread as you see fit. :) Have a good one. Time for bed on my end. |
Send message Joined: 26 Jun 06 Posts: 7 Credit: 158,935 RAC: 0 |
More than a GBs worth of upload files have magically disappeared from my transfer tab in BOINC. All good things to those who wait :) |
Send message Joined: 24 Jan 06 Posts: 5 Credit: 435,756 RAC: 0 |
Do we have a problem again? I have had a bunch of files waiting for nearly two weeks now. |
Send message Joined: 15 May 09 Posts: 4540 Credit: 19,039,635 RAC: 18,944 |
Do we have a problem again? I have had a bunch of files waiting for nearly two weeks now. Check the news section at the top of number crunching. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
This thread has been moved here from the climateprediction.net Science section. |
©2024 cpdn.org