climateprediction.net (CPDN) home page
Thread 'Upload failures'

Thread 'Upload failures'

Message boards : Number crunching : Upload failures
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 . . . 19 · Next

AuthorMessage
Profiletullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 59952 - Posted: 9 Apr 2019, 17:32:34 UTC

I have added http to the eventlog options and I saw we are using www.google.com. Maybe there is the rub.
tullio
ID: 59952 · Report as offensive     Reply Quote
Albert H.

Send message
Joined: 18 Feb 06
Posts: 73
Credit: 61,774,577
RAC: 46,303
Message 59953 - Posted: 9 Apr 2019, 19:26:12 UTC - in response to Message 59952.  

09/04/2019 21:12:42 | climateprediction.net | Started upload of wah2_anz50_n2ue_201612_20_794_011766072_0_r1080798404_15.zip
09/04/2019 21:12:42 | climateprediction.net | Started upload of wah2_anz50_n1pu_201612_20_794_011764612_0_r869802540_8.zip
09/04/2019 21:12:44 | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space
09/04/2019 21:12:44 | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space
09/04/2019 21:12:44 | climateprediction.net | Temporarily failed upload of wah2_anz50_n2ue_201612_20_794_011766072_0_r1080798404_15.zip: transient upload error
09/04/2019 21:12:44 | climateprediction.net | Backing off 03:35:43 on upload of wah2_anz50_n2ue_201612_20_794_011766072_0_r1080798404_15.zip
09/04/2019 21:12:44 | climateprediction.net | Temporarily failed upload of wah2_anz50_n1pu_201612_20_794_011764612_0_r869802540_8.zip: transient upload error
09/04/2019 21:12:44 | climateprediction.net | Backing off 00:55:53 on upload of wah2_anz50_n1pu_201612_20_794_011764612_0_r869802540_8.zip


here in Luxembourg is this problem
ID: 59953 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 59954 - Posted: 9 Apr 2019, 19:40:28 UTC

I have added http to the eventlog options and I saw we are using www.google.com. Maybe there is the rub.


I thought the google.com was just to check the interweb was working.

Albert, an email has been sent with regards to the zips not going through because server is full.
ID: 59954 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 59955 - Posted: 9 Apr 2019, 20:21:36 UTC - in response to Message 59951.  

An email is on it's way south.


To Antarctica?


Some decades ago there was a trend in Sydney to use the nick name "Northern Antarctica" to refer to Tasmania, so yes. :)
It's probably politically incorrect these days.

There's currently another out of control bushfire on Tasmania's SE coast:
Residents evacuated as bushfire on Tasmania's east coast reaches emergency level

Climate change is evident all over Australia. At the start of this week, the temperatures here in Sydney were up in the low 30s, and it's supposed to be mid Autumn.
ID: 59955 · Report as offensive     Reply Quote
nairb

Send message
Joined: 3 Sep 04
Posts: 105
Credit: 5,646,090
RAC: 102,785
Message 59956 - Posted: 9 Apr 2019, 23:21:57 UTC - in response to Message 59950.  
Last modified: 9 Apr 2019, 23:22:31 UTC

An email is on it's way south.

Magic email seems to have done the job. All those anz w/u zips now uploaded.
ID: 59956 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 59957 - Posted: 10 Apr 2019, 4:53:51 UTC - in response to Message 59956.  

Mine, too.
"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 59957 · Report as offensive     Reply Quote
Profiletullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 59958 - Posted: 10 Apr 2019, 9:08:26 UTC
Last modified: 10 Apr 2019, 9:09:05 UTC

I am running 4 other BOINC projects,SETI,Einstein.LHC,GPUGRID on 3 PCs and one cellphone, using Windows 10, Linux and Android. No problem in uploading results. Reading my inbox I found a mail from Andy saying that I had been blacklisted by Oxford in 2012. Maybe this is the rub.
Tullio
ID: 59958 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 59959 - Posted: 10 Apr 2019, 9:48:35 UTC - in response to Message 59958.  

I found a mail from Andy saying that I had been blacklisted by Oxford in 2012. Maybe this is the rub.


Some years ago I remember someone else being blacklisted because their ISP had been the source of either multiple spam accounts or ddos attacks. I don't recall which at the time but given that at least until November tasks were reporting for you that seems unlikely. I am also a bit surprised than enabling http debug doesn't show a not allowed message if that were the case. However, it may be some automated thing from Oxford as they have beefed up security last year and there have been days when the number of new users signing up has been several times the number of new computers registered recently which makes me suspicious.

Not sure what Les put in his email to Andy but if nothing comes back soon, I will email him again.
ID: 59959 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 59960 - Posted: 10 Apr 2019, 21:06:59 UTC

The ISP that tullio was using years ago was heavily used by spammers, and the people there wouldn't stop it, so Oxford blocked the domain name that they used.
Which also blocked everyone using them as an ISP.
I don't know if this is still in effect.

With no relevant info about the present situation, my guess is that the "reporting" message, (an RPC), arrived at the servers at a bad time, when something was not working there, and "got lost".
So that model will not get marked as completed.

I've got one of them myself, from sometime last year.
ID: 59960 · Report as offensive     Reply Quote
Profiletullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 59964 - Posted: 11 Apr 2019, 12:59:10 UTC

I try to be fair to all my projects,and divide tasks to computers which best suit them. So I loaded my second best Windows computer with 2 wah2 tasks. Wee, like Einstein said when he learned of the Hiroshima bomb.
Tullio
ID: 59964 · Report as offensive     Reply Quote
Profiletullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 59987 - Posted: 18 Apr 2019, 15:40:45 UTC

I am running 4 wah2 SAM tasks on the same computer, and they send up a lot of trickles. I hope the results will go up too.
Tullio
ID: 59987 · Report as offensive     Reply Quote
Profiletullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 60017 - Posted: 26 Apr 2019, 6:18:23 UTC

Sill upload failures of finished results. Trickles seem to be accepted.
Tullio
ID: 60017 · Report as offensive     Reply Quote
Profiletullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 60018 - Posted: 26 Apr 2019, 13:19:21 UTC

It is useless for me to go on crunching tasks since finished results will not upload after nine or more days, while trickles go up.
Tullio
ID: 60018 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 60023 - Posted: 27 Apr 2019, 3:27:01 UTC - in response to Message 60018.  

It is useless for me to go on crunching tasks since finished results will not upload after nine or more days, while trickles go up.
Tullio


To be able to help, we need some information.

This is in the Event log, and should be done without any cc_config set up. (That just adds clutter.)

As I said in an earlier post,

In particular, copy and paste here, everything from (I forget the exact wording)
"Sending Scheduler request"

to

"Scheduler request failed"

Plus the error message lines after that. There may be half a dozen or so.

You should be able to get it to do this by an Update in the Projects tab.
If not, you'll need to look back through the Event log to find the last time it saved those lines.
ID: 60023 · Report as offensive     Reply Quote
Profiletullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 60024 - Posted: 27 Apr 2019, 5:56:18 UTC

I have 4 projects (SETI, EINSTEIN,LHC, GPUGRID) filling my event log. There is no cc_config. My Windows 8.1 mouse is unable to collect and post data, only my Linux mouse on another PC can do this, but CPDN is running on the faster CPU. All that the event log says is that upload fails,Internet access is OK but the servers must be down and it backs off. All other projects upload their results with no pain. One CPDN task has ended and its latest trickles were sent on April 25. The other is still running and its latest trickles were sent on April 26.
Tullio
ID: 60024 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 60025 - Posted: 27 Apr 2019, 7:13:22 UTC

I'm not running those models, so is anyone else having problems uploading sam50s or eu25s?
ID: 60025 · Report as offensive     Reply Quote
Profiletullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 60026 - Posted: 27 Apr 2019, 8:19:03 UTC
Last modified: 27 Apr 2019, 8:23:17 UTC

The two tasks that failed to upload on April 2 gained each 9,898.90 credits. Then a system crash made me rebuild the system and they are no longer trying to upload. I have now one trying to upload and one still running since 7 days with more 7 to go. It seems to be runnng fine.
Tullio
ID: 60026 · Report as offensive     Reply Quote
bernard_ivo

Send message
Joined: 18 Jul 13
Posts: 438
Credit: 25,620,508
RAC: 4,981
Message 60027 - Posted: 27 Apr 2019, 8:40:00 UTC - in response to Message 60025.  

I'm not running those models, so is anyone else having problems uploading sam50s or eu25s?


Seems fine for sam50s - had few eu25s all uploaded
27/04/2019 03:39:17 | climateprediction.net | Started upload of wah2_sam50_a157_201612_25_810_011827155_0_r1222209388_2.zip
27/04/2019 03:39:17 | climateprediction.net | [file_xfer] URL: http://upload3.cpdn.org/cgi-bin/file_upload_handler
27/04/2019 03:39:19 | climateprediction.net | [file_xfer] http op done; retval 0 (Success)
27/04/2019 03:39:19 | climateprediction.net | [file_xfer] parsing upload response: <data_server_reply> <status>0</status> <file_size>0</file_size></data_server_reply>
27/04/2019 03:39:19 | climateprediction.net | [file_xfer] parsing status: 0
27/04/2019 03:39:19 | climateprediction.net | [fxd] starting upload, upload_offset 0
27/04/2019 03:40:52 | climateprediction.net | [file_xfer] http op done; retval 0 (Success)
27/04/2019 03:40:52 | climateprediction.net | [file_xfer] parsing upload response: <data_server_reply> <status>0</status></data_server_reply>
27/04/2019 03:40:52 | climateprediction.net | [file_xfer] parsing status: 0
27/04/2019 03:40:52 | climateprediction.net | [file_xfer] file transfer status 0 (Success)
27/04/2019 03:40:52 | climateprediction.net | Finished upload of wah2_sam50_a157_201612_25_810_011827155_0_r1222209388_2.zip
27/04/2019 03:40:52 | climateprediction.net | [file_xfer] Throughput 487120 bytes/sec
ID: 60027 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Jan 06
Posts: 637
Credit: 26,751,529
RAC: 653
Message 60028 - Posted: 27 Apr 2019, 9:50:11 UTC - in response to Message 60025.  
Last modified: 27 Apr 2019, 9:54:18 UTC

I'm not running those models, so is anyone else having problems uploading sam50s or eu25s?

I have uploaded several of each in the last month or so without problem.
How large are the final uploads that are failing? Maybe a local network problem.
ID: 60028 · Report as offensive     Reply Quote
Profiletullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 60029 - Posted: 27 Apr 2019, 14:05:52 UTC - in response to Message 60028.  
Last modified: 27 Apr 2019, 14:58:01 UTC

I don't think so. I just uploaded a GPUGRID task, a GPU version using a GTX 1050 Ti board, and it uploaded. On a Linux PC, GPUGRID CPU tasks are very heavy, needing several GB of disk space and they upload easily. Same for LHC tasks on another Windows 10 PC and CPU tasks on a Linux Virtual Machine running SuSE Tumbleweed on top of the Windows 8.1 host which runs CPDN.
Tullio
From the Transfers label in the Windows Task Manager, the upload seems to be 702 KB.
I've unloaded 8 WAH2 tasks on my Windows 10 PC. They are SAM,ANZ,PNW and SAFR. Wait and see what happens.
ID: 60029 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 . . . 19 · Next

Message boards : Number crunching : Upload failures

©2024 cpdn.org