climateprediction.net (CPDN) home page
Thread 'troubles uploading'

Thread 'troubles uploading'

Message boards : Number crunching : troubles uploading
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · Next

AuthorMessage
Profilemo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 38602 - Posted: 31 Dec 2009, 13:44:18 UTC
Last modified: 31 Dec 2009, 13:45:06 UTC

Metalius\'s model that couldn\'t upload its #1 and #2 files is here.

Metalius, has Boinc tried to upload these files again?

We have had no other forum reports of HadAM3P zip files refusing to upload. Most of the moderators haven\'t got any to try with because we\'re running Beta models on a different server. So Jim, it would be very useful if you could allow at least one of your HadAM3P models to complete and see whether all 3 of its files upload. We would then have a clearer idea whether only Metalius is having this problem or everybody.

Any reports about successful or failed HadAM3P #1 and #2 zip file uploads would be very welcome!
Cpdn news
ID: 38602 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 38603 - Posted: 31 Dec 2009, 15:12:36 UTC

I had a hadam3p complete and upload all files successfully last night. No unusual messages in the messages tab. Another one should complete in an hour or two.
ID: 38603 · Report as offensive     Reply Quote
metalius
Avatar

Send message
Joined: 28 Nov 06
Posts: 89
Credit: 12,023,653
RAC: 4,025
Message 38604 - Posted: 31 Dec 2009, 17:20:45 UTC - in response to Message 38602.  

Metalius, has Boinc tried to upload these files again?

Yes, I pressed today \"Retry now\" many times.
How it \"works\"...
1. After few seconds BOINC is dropping down transfer speed to 1.nn KBps.
2. After few minutes it stops at all...

P.S. I upgraded BOINC from 6.6.36 to 6.10.18 - no difference.
P.S. That host has quite fast internet connection and it is working.
ID: 38604 · Report as offensive     Reply Quote
ProfileJIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,363,583
RAC: 5,022
Message 38605 - Posted: 31 Dec 2009, 18:34:26 UTC
Last modified: 31 Dec 2009, 18:40:09 UTC

Good news. One of my AM3Ps just finished and all 3 zip files uploaded successfully. So the server must be working. Messages below:

12/31/2009 1:24:09 PM climateprediction.net Computation for task hadam3p_m766_1990_2_1006501152_0 finished
12/31/2009 1:24:10 PM climateprediction.net Resuming task hadam3p_n347_1968_2_1006542553_2 using hadam3p version 606
12/31/2009 1:24:12 PM climateprediction.net Started upload of hadam3p_m766_1990_2_1006501152_0_1.zip
12/31/2009 1:24:12 PM climateprediction.net Started upload of hadam3p_m766_1990_2_1006501152_0_2.zip
12/31/2009 1:26:37 PM climateprediction.net Finished upload of hadam3p_m766_1990_2_1006501152_0_2.zip
12/31/2009 1:26:37 PM climateprediction.net Started upload of hadam3p_m766_1990_2_1006501152_0_3.zip
12/31/2009 1:26:41 PM climateprediction.net Finished upload of hadam3p_m766_1990_2_1006501152_0_3.zip
12/31/2009 1:27:09 PM climateprediction.net Finished upload of hadam3p_m766_1990_2_1006501152_0_1.zip
ID: 38605 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 38606 - Posted: 31 Dec 2009, 22:40:20 UTC

My 2nd hadam3p model finished and uploaded fine.
ID: 38606 · Report as offensive     Reply Quote
ProfileJIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,363,583
RAC: 5,022
Message 38607 - Posted: 1 Jan 2010, 5:42:47 UTC

Happy New Year. The second AM3P finished and uploaded all zip files without trouble so the server must be working right. The problem must be in Metelius\' computer and or network.

ID: 38607 · Report as offensive     Reply Quote
metalius
Avatar

Send message
Joined: 28 Nov 06
Posts: 89
Credit: 12,023,653
RAC: 4,025
Message 38617 - Posted: 3 Jan 2010, 8:09:43 UTC

Yes, the problem was in my computer. I don\'t know, who and how did it... Maximum upload and download rates were set to very low values.
My apologies, dear friends!
ID: 38617 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 38618 - Posted: 3 Jan 2010, 8:55:32 UTC

I glad that you found the source of the problem.
I\'ve thought about it on and off, but couldn\'t think what it might be. Wouldn\'t have thought of that in a long time. :)

ID: 38618 · Report as offensive     Reply Quote
ProfileByron Leigh Hatch @ team Carl ...
Avatar

Send message
Joined: 17 Aug 04
Posts: 289
Credit: 44,103,664
RAC: 0
Message 38664 - Posted: 11 Jan 2010, 19:34:49 UTC


Hello friends

any one else having troubles uploading or just me ?

1/11/2010 11:03:55 AM Internet access OK - project servers may be temporarily down.

1/11/2010 10:56:32 AM Starting BOINC client version 6.10.18 for windows_intelx86
1/11/2010 10:56:32 AM log flags: file_xfer, sched_ops, task, benchmark_debug, state_debug, task_debug
1/11/2010 10:56:32 AM Libraries: libcurl/7.19.4 OpenSSL/0.9.8l zlib/1.2.3
1/11/2010 10:56:32 AM Data directory: C:\\Documents and Settings\\All Users\\Application Data\\BOINC
1/11/2010 10:56:32 AM Running under account Byron Leigh Hatch
1/11/2010 10:56:32 AM Processor: 4 GenuineIntel Intel(R) Xeon(TM) CPU 1.80GHz [x86 Family 15 Model 2 Stepping 7]
1/11/2010 10:56:32 AM Processor features: fpu tsc sse sse2 mmx
1/11/2010 10:56:32 AM OS: Microsoft Windows XP: Professional x86 Edition, Service Pack 3, (05.01.2600.00)
1/11/2010 10:56:32 AM Memory: 1.50 GB physical, 2.10 GB virtual
1/11/2010 10:56:32 AM Disk: 74.47 GB total, 53.38 GB free
1/11/2010 10:56:32 AM Local time is UTC -8 hours
1/11/2010 10:56:32 AM No usable GPUs found
1/11/2010 10:56:32 AM Not using a proxy
1/11/2010 10:56:33 AM [state_debug] Client state summary:
1/11/2010 10:56:33 AM 1 projects:
1/11/2010 10:56:33 AM http://climateprediction.net/

<snip>

1/11/2010 10:56:33 AM 5 app_versions
1/11/2010 10:56:33 AM hadsm3 607
1/11/2010 10:56:33 AM hadsm3mh 602
1/11/2010 10:56:33 AM hadcm3i 604
1/11/2010 10:56:33 AM hadam3 601
1/11/2010 10:56:33 AM hadam3p 606

1/11/2010 10:56:33 AM 5 workunits
1/11/2010 10:56:33 AM hadsm3mh_kvhx_006489753
1/11/2010 10:56:33 AM hadam3p_mx3b_1962_2_1006534745
1/11/2010 10:56:33 AM hadam3p_m1pg_1987_2_1006494070
1/11/2010 10:56:33 AM hadsm3mh_krg0_006484500
1/11/2010 10:56:33 AM hadsm3fub_k2w4_006460926

<snip>

1/11/2010 11:03:47 AM Project communication failed: attempting access to reference site
1/11/2010 11:03:47 AM climateprediction.net Temporarily failed upload of hadam3p_mx3b_1962_2_1006534745_2_1.zip: connect() failed
1/11/2010 11:03:47 AM climateprediction.net Backing off 1 hr 53 min 44 sec on upload of hadam3p_mx3b_1962_2_1006534745_2_1.zip
1/11/2010 11:03:48 AM Internet access OK - project servers may be temporarily down.
1/11/2010 11:03:52 AM climateprediction.net Started upload of hadam3p_mx3b_1962_2_1006534745_2_3.zip
1/11/2010 11:03:54 AM Project communication failed: attempting access to reference site
1/11/2010 11:03:54 AM climateprediction.net Temporarily failed upload of hadam3p_mx3b_1962_2_1006534745_2_3.zip: connect() failed
1/11/2010 11:03:54 AM climateprediction.net Backing off 3 hr 24 min 31 sec on upload of hadam3p_mx3b_1962_2_1006534745_2_3.zip
1/11/2010 11:03:55 AM Internet access OK - project servers may be temporarily down.


ID: 38664 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 38666 - Posted: 11 Jan 2010, 20:42:25 UTC

A server is down.
See the Server Status page in the blue menu to the left of here.


Backups: Here
ID: 38666 · Report as offensive     Reply Quote
jckcpdn

Send message
Joined: 9 Oct 04
Posts: 3
Credit: 18,779,188
RAC: 0
Message 38667 - Posted: 11 Jan 2010, 20:43:31 UTC
Last modified: 11 Jan 2010, 20:45:25 UTC

One of the upload servers is temporarily down.

Server status can be checked here:
http://climateapps2.oucs.ox.ac.uk/cpdnboinc/server_status.html

Edit: Beat me again, Les,
Jim (using a friend\'s account)
ID: 38667 · Report as offensive     Reply Quote
Profilemo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 38668 - Posted: 11 Jan 2010, 23:10:17 UTC

I\'m posting about this in the news thread now. Only #1 file should be stuck. #3 should be able to upload.
Cpdn news
ID: 38668 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 38670 - Posted: 11 Jan 2010, 23:12:12 UTC
Last modified: 11 Jan 2010, 23:13:07 UTC

As I suspected, the server is close to full, which initiates an automatic shutdown. It\'s being addressed, but slowly.

Perhaps people could crunch some of the longer models.
The physicists who run those sub-projects would probably like some data for their research too. :)

This would also be a good time for people who aren\'t currently subscribed to the News and Announcements thread to do so, as this is where progress on this matter will be posted.

Edit
Beaten to it. :)
Backups: Here
ID: 38670 · Report as offensive     Reply Quote
ProfileByron Leigh Hatch @ team Carl ...
Avatar

Send message
Joined: 17 Aug 04
Posts: 289
Credit: 44,103,664
RAC: 0
Message 38672 - Posted: 12 Jan 2010, 5:10:43 UTC - in response to Message 38670.  



Perhaps people could crunch some of the longer models.
The physicists who run those sub-projects would probably like some data for their research too. :)


Les, MO.V, jckcpdn _ Hello _


yes thank you for your sugession, i did\'nt know about this, so I have decided to crunch some of the longer models, perhaps more data for the scientists ??

to select longer models is the following corect ??

go to my account --> Preferences --> Resource share and graphics --> open climateprediction.net preferences --> click the \"Edit climateprediction.net preferences\" --> check the little box for the Application - HadCM3 - 80 model years (Variable up to 160 model years) --> then unselect the other 4 Application --> then update preference ??

thanks in advance
Byron

ID: 38672 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 38673 - Posted: 12 Jan 2010, 5:51:34 UTC

Close.
Step 1) Go to the Server Status page to the left, or the Applications page, also to the left.
2) Note which model types are currently available.
3) < Insert your steps here >


The 80/160 year models haven\'t been available for some time, and may not be back.
The hadsm3 (slab), and hadsm3 (Mid-Holocene), are the only other ones at present.
Slab is 3 phases, and M-H is similar with 4 phases.
More info here.


Backups: Here
ID: 38673 · Report as offensive     Reply Quote
jckcpdn

Send message
Joined: 9 Oct 04
Posts: 3
Credit: 18,779,188
RAC: 0
Message 38681 - Posted: 12 Jan 2010, 20:06:02 UTC

(Jim [astroWX] posting on Janet\'s account again.)

Re. crunching longer (Slab and MH) Work Units: Both of Janet\'s quads have Slab files stuck in the upload queue. No problem getting new work
1/12/2010 10:28:14 AM|climateprediction.net|Started upload of hadsm3fub_k8bp_006467967_1_2.zip
1/12/2010 10:28:16 AM||Project communication failed: attempting access to reference site
1/12/2010 10:28:16 AM|climateprediction.net|Temporarily failed upload of hadsm3fub_k8bp_006467967_1_2.zip: connect() failed
1/12/2010 10:28:16 AM|climateprediction.net|Backing off 6 min 1 sec on upload of hadsm3fub_k8bp_006467967_1_2.zip
1/12/2010 10:28:17 AM||Suspending network activity - user request
1/12/2010 10:28:17 AM||Internet access OK - project servers may be temporarily down.
This is the third day ...

ID: 38681 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 38682 - Posted: 12 Jan 2010, 20:32:26 UTC

The servers are running out of storage space.
Data is being moved, but the progress is slow.
If someone has a few spare giga-terabyte HDs lying around that they could donate ..... :)

ID: 38682 · Report as offensive     Reply Quote
old_user582229

Send message
Joined: 12 Aug 09
Posts: 20
Credit: 3,063,648
RAC: 0
Message 38685 - Posted: 13 Jan 2010, 0:15:40 UTC - in response to Message 38682.  

As in you want to use a couple of TB drives on my server, or you want me to send you a couple of TB drives?

Cheers
David

The servers are running out of storage space.
Data is being moved, but the progress is slow.
If someone has a few spare giga-terabyte HDs lying around that they could donate ..... :)



ID: 38685 · Report as offensive     Reply Quote
old_user582229

Send message
Joined: 12 Aug 09
Posts: 20
Credit: 3,063,648
RAC: 0
Message 38687 - Posted: 13 Jan 2010, 1:25:11 UTC - in response to Message 38685.  

Darn, ran out of time to edit, which reads as follows:

As in you want to use a couple of TB drives on my server, or you want me to send you a couple of TB drives?

Cheers
David

EDIT: Actually, thinking about it some more, I could simply switch four TB drives in a mirror array (2TB total) to a crunch box and you can run the whole thing from your end. At long as it keeps crunching the MH climate models, for Iain\'s Iceworld study, I don\'t really care what else it does, I am happy. I don\'t view disk storage as particularly CPU intensive. I would give you a i7 running Windows 7 I also have a couple of oil cooled 5970 blocks on order (Milkyway/Collatz), so it would be easy to cool the HD\'s if required. The CPU is already oil cooled.

Iain has my email it you wish to take up this offer.

The servers are running out of storage space.
Data is being moved, but the progress is slow.
If someone has a few spare giga-terabyte HDs lying around that they could donate ..... :)


As in you want to use a couple of TB drives on my server, or you want me to send you a couple of TB drives?

Cheers
David

The servers are running out of storage space.
Data is being moved, but the progress is slow.
If someone has a few spare giga-terabyte HDs lying around that they could donate ..... :)




ID: 38687 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 38689 - Posted: 13 Jan 2010, 3:30:18 UTC

Sorry, been out for a while.
I was joking about the donation, but thanks for the offer. :)

While the project does need more storage, this will need to be \"on site\", meaning servers scattered around various buildings belong to different depts of the Uni of Oxford.

It\'s a long process to get approval for funding, server sitting, etc, and some of the places with rack space are a bit inaccessible for hardware upgrades.
What the project possibly really needs, is a large building of it\'s own, with lots of space for server racks, and plenty of room to expand.
And an enclosed area nearby for the flying pigs. :)

So expect upload difficulties for a while.

ID: 38689 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · Next

Message boards : Number crunching : troubles uploading

©2024 cpdn.org