Message boards : Number crunching : Upload failures
Message board moderation
Previous · 1 . . . 12 · 13 · 14 · 15 · 16 · 17 · 18 . . . 19 · Next
Author | Message |
---|---|
Send message Joined: 21 Feb 08 Posts: 47 Credit: 7,929,915 RAC: 0 |
Sorry for all the posts.. My issues is resolved now. Turns out the network i ran all my computers on have a proxy and that one interferes with the transfers in some way. When i moved the files to my laptop and connected direct to the internet instead of my work network problem was resolved! My 98 files are on the way to upload now. Getting around 10 Mbit in speed on a 100 Mbit line :) Hope they will register since they will upload on another machine... |
Send message Joined: 21 Feb 08 Posts: 47 Credit: 7,929,915 RAC: 0 |
For everyones info.. sam50 units are limited to 1 MiB/s in upload speed anz50 units are limitet to 100 KiB/s in upload speed.. Observed sitting waiting for 98 files to upload :D |
Send message Joined: 15 May 09 Posts: 4540 Credit: 19,039,635 RAC: 18,944 |
For everyones info.. So for me, my bored band is the limiting factor. |
Send message Joined: 21 Feb 08 Posts: 47 Credit: 7,929,915 RAC: 0 |
For everyones info.. So whats your connection speed? A while ago i had only mobile dongle to upload from a server park.. 3 Mbit (aprox 300KB/s).. THAT took a LOOOOONG time.... :D |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
Ha! You call that slow? For years I was getting about 40 KB/s on a good day, and around 10-14 KB/s on a bad day. Now that I've got super fast fiber, I get somewhere over a 100KB/s. (It's been so long since there was work that I've forgotten the exact number.) |
Send message Joined: 22 Feb 06 Posts: 491 Credit: 31,050,534 RAC: 14,857 |
Rercent (today) upload to Jasmin: 30/07/2019 23:13:05 | climateprediction.net | Finished upload of wah2_sam50_n6no_201612_25_822_011884633_0_r2139349355_23.zip 30/07/2019 23:13:05 | climateprediction.net | [file_xfer] Throughput 744183 bytes/sec |
Send message Joined: 20 Jul 05 Posts: 25 Credit: 414,873 RAC: 406 |
For everyones info.. To see if you can increase your upload speed you could try changing Max files per project to 1. It may not have any effect but it's worth a try <max_file_xfers_per_project>1</max_file_xfers_per_project> |
Send message Joined: 5 Aug 04 Posts: 1120 Credit: 17,202,915 RAC: 2,154 |
Right now, according to climateprediction.net I am getting: Average upload rate 195.4 KB/sec Average download rate 3390.97 KB/sec Now my Verizon FiOS Internet connection gets: Date Download Upload Test Server 7/30/2019 8:18:57 PM 81.62 Mbps 86.98 Mbps New York City, NY 6/25/2019 9:03:54 AM 82.02 Mbps 87.87 Mbps New York City, NY 6/14/2019 11:56:38 PM 82.44 Mbps 87.53 Mbps New York City, NY 6/1/2019 4:43:44 PM 82.44 Mbps 88.74 Mbps New York City, NY |
Send message Joined: 15 May 09 Posts: 4540 Credit: 19,039,635 RAC: 18,944 |
Right now I am getting 88KB/s upload. I get about 5MB/s download on a clear day with a following wind. |
Send message Joined: 21 Feb 08 Posts: 47 Credit: 7,929,915 RAC: 0 |
For everyones info.. Yeah i had it at 1 when i was trying to fix my problems to not cause to many attempts on the climate servers. i got Max 1 MiB/s .. I had to increase the transfers slots to 10 since i was uploading both anz50 and sam50 units and it was taking forever. When i was transfering sam50 units only i got 10 MiB/s upload speed when i only were transfering anz50 i got a total of 1 MiB/s for all 10 transfers so there is defenatly a cap :) I normally have my transfers set to 2 (default) |
Send message Joined: 21 Feb 08 Posts: 47 Credit: 7,929,915 RAC: 0 |
Ha! You call that slow? Haha.. Yeah it was slow for me since i had to be in the datacenter until the uploads completed and it was hundreds of files to upload at once ;) You say "super fast fiber" ... Now i guess that the bottleneck is not your fibre connection but the CPDN bandwith cap instead :) I'm on fibre too. I can get 1 Gbit/s but i dont need that kind of speed. I'm paying 25$/month for 100 Mbit down and 10 Mbit up. I don't need faster than that.. An awesome plus for this connection is that my real speed is 135/17 Mbit so a lot more than i pay for :) |
Send message Joined: 16 Jan 10 Posts: 1084 Credit: 7,831,940 RAC: 5,064 |
All zips for this cam25 model are failing to upload. Should I wait or abort? I sympathise with your position, having had a CAM25 stuck for weeks. However, on 27th July some of the Zips uploaded successfully so I’m leaving the remaining three transfers to continue attempting to upload. Aborting the transfer does destroy the data but I don’t blame anyone for doing that - it is the (sub-)project’s responsibility to provide the resources to accept data and if they don’t then they may lose data. Their fault I would say. |
Send message Joined: 23 Feb 06 Posts: 20 Credit: 9,221,263 RAC: 3,404 |
my last running work unit (on all of my machines) -a cam25 - is now stuck on trickle up!! suppose I will just have to sit and wait AGAIN for it to clear and for more work. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
Are your SURE that it's a trickle, and not a zip file? Vast difference, and instructions for dealing with this Cam zip problem have been posted a number of times. Reports say that Aborting the stuck zip upload and then waiting, have resulted in a Successful completion. |
Send message Joined: 30 Apr 18 Posts: 3 Credit: 242,814 RAC: 0 |
I have 5 zip files that have become stuck in the transfer cue. I'm trying to be patient and not abort anything prematurly. 9/2/2019 5:21:21 PM | climateprediction.net | Started upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_15.zip 9/2/2019 5:21:43 PM | | Project communication failed: attempting access to reference site 9/2/2019 5:21:43 PM | climateprediction.net | Temporarily failed upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_15.zip: transient HTTP error 9/2/2019 5:21:43 PM | climateprediction.net | Backing off 03:33:21 on upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_15.zip 9/2/2019 5:21:45 PM | | Internet access OK - project servers may be temporarily down. 9/2/2019 6:56:35 PM | | Suspending computation - CPU is busy 9/2/2019 6:56:45 PM | | Resuming computation 9/2/2019 6:57:05 PM | | Suspending computation - CPU is busy 9/2/2019 6:57:35 PM | | Resuming computation 9/2/2019 8:06:31 PM | | Suspending GPU computation - computer is in use 9/2/2019 8:08:23 PM | climateprediction.net | Started upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_13.zip 9/2/2019 8:08:33 PM | | Resuming GPU computation 9/2/2019 8:08:45 PM | climateprediction.net | Temporarily failed upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_13.zip: transient HTTP error 9/2/2019 8:08:45 PM | climateprediction.net | Backing off 03:05:48 on upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_13.zip 9/2/2019 8:08:46 PM | | Project communication failed: attempting access to reference site 9/2/2019 8:08:48 PM | | Internet access OK - project servers may be temporarily down. 9/2/2019 9:27:06 PM | | Suspending computation - CPU is busy 9/2/2019 9:27:16 PM | | Resuming computation 9/2/2019 9:43:27 PM | climateprediction.net | Started upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_3.zip 9/2/2019 9:43:27 PM | climateprediction.net | Started upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_15.zip 9/2/2019 9:43:50 PM | | Project communication failed: attempting access to reference site 9/2/2019 9:43:50 PM | climateprediction.net | Temporarily failed upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_3.zip: transient HTTP error 9/2/2019 9:43:50 PM | climateprediction.net | Backing off 04:28:27 on upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_3.zip 9/2/2019 9:43:50 PM | climateprediction.net | Temporarily failed upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_15.zip: transient HTTP error 9/2/2019 9:43:50 PM | climateprediction.net | Backing off 03:32:43 on upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_15.zip 9/2/2019 9:43:52 PM | | Internet access OK - project servers may be temporarily down. Mario |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
As has been said, CAMS are a pain. The only real "cure" is to wait until a zip has uploaded, and then tries another upload from scratch. At that point, assume that it got through the previous time, and Abort it. Do the same for each of your 5 files. At this point, BOINC should wake up to the fact that everything has "uploaded", and finish off the transfer process. Perhaps not immediately. It's been so long since I had to do this that I forget the timings of what happens. |
Send message Joined: 6 Aug 04 Posts: 195 Credit: 28,382,283 RAC: 10,133 |
Blimey, the last wah2_cam25 zip upload, that has been lurking for weeks, has finished. 08-Sep-19 9:05:20 PM | climateprediction.net | Finished upload of wah2_cam25_a07q_200405_18_691_011369827_0_r1430190651_6.zip |
Send message Joined: 18 Jul 13 Posts: 438 Credit: 25,620,508 RAC: 4,981 |
Got 4 cam25 batch 832 1st zips can't upload 19/09/2019 10:39:39 | climateprediction.net | [http] [ID#4164] Info: TLSv1.2 (OUT), TLS alert, Client hello (1): 19/09/2019 10:39:39 | climateprediction.net | [http] [ID#4164] Info: Connection 3216 seems to be dead! 19/09/2019 10:39:39 | climateprediction.net | [http] [ID#4164] Info: Closing connection 3216 19/09/2019 10:39:39 | climateprediction.net | [http] [ID#4164] Info: TLSv1.2 (OUT), TLS alert, Client hello (1): 19/09/2019 10:39:39 | climateprediction.net | [http] [ID#4164] Info: Connection 3217 seems to be dead! 19/09/2019 10:39:39 | climateprediction.net | [http] [ID#4164] Info: Closing connection 3217 19/09/2019 10:39:39 | climateprediction.net | [http] [ID#4164] Info: TLSv1.2 (OUT), TLS alert, Client hello (1): 19/09/2019 10:39:39 | climateprediction.net | [http] [ID#4165] Info: Found bundle for host upload6.cpdn.org: 0x35aed00 [serially] 19/09/2019 10:39:40 | climateprediction.net | [http] [ID#4164] Info: Trying 158.97.9.11... 19/09/2019 10:39:40 | climateprediction.net | [http] [ID#4165] Info: Hostname was found in DNS cache 19/09/2019 10:39:40 | climateprediction.net | [http] [ID#4165] Info: Trying 158.97.9.11... 19/09/2019 10:40:02 | climateprediction.net | [http] [ID#4164] Info: connect to 158.97.9.11 port 80 failed: Timed out 19/09/2019 10:40:02 | climateprediction.net | [http] [ID#4164] Info: Failed to connect to upload6.cpdn.org port 80: Timed out 19/09/2019 10:40:02 | climateprediction.net | [http] [ID#4164] Info: Closing connection 3219 |
Send message Joined: 15 May 09 Posts: 4540 Credit: 19,039,635 RAC: 18,944 |
Got 4 cam25 batch 832 1st zips can't upload I can sense an email coming on. The server these go to is somewhere in Mexico so will require the project to contact them. As I am sure you have noticed, the process especially with the Mexico server can take a while! Edit: Oxford have been informed. |
Send message Joined: 15 May 09 Posts: 4540 Credit: 19,039,635 RAC: 18,944 |
Actually the upload server which is UK based but remote from Oxford. A message has been sent by Oxford to those who can sort it. Got 4 cam25 batch 832 1st zips can't upload |
©2024 cpdn.org