climateprediction.net (CPDN) home page
Thread 'trickle uploads stopping at 7.3 MB. Is it just me?'

Thread 'trickle uploads stopping at 7.3 MB. Is it just me?'

Message boards : Number crunching : trickle uploads stopping at 7.3 MB. Is it just me?
Message board moderation

To post messages, you must log in.

AuthorMessage
Profileold_user733
Avatar

Send message
Joined: 9 Aug 04
Posts: 25
Credit: 4,756,979
RAC: 0
Message 32440 - Posted: 3 Feb 2008, 5:15:00 UTC

I just noticed that all my machines are stuck trying to upload trickles and/or results. They start out uploading just fine, then the upload freezes at around 7.3MB, or just under halfway. The upload times out, then the process repeats. Is there a server problem there, or is it on my end?

ID: 32440 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 32441 - Posted: 3 Feb 2008, 6:25:57 UTC


I\'ve just uploaded trickles to two sites, so that\'s OK.
They\'re very small anyway, and should only be a problem if the trickle servers aren\'t working.
I last uploaded zips to the main site about 12 hours ago, and that was OK then.


The zip file uploads may fail if there is a problem with your ISP, or host site for a proxy server.

ID: 32441 · Report as offensive     Reply Quote
Profileold_user733
Avatar

Send message
Joined: 9 Aug 04
Posts: 25
Credit: 4,756,979
RAC: 0
Message 32448 - Posted: 3 Feb 2008, 15:47:32 UTC

OK, so it must be something on my end. Just want to make sure before I start complaining to our IT department. Here\'s an example from the message log of what\'s happening...

2/3/2008 9:34:31 AM|climateprediction.net|Started upload of hadcm3iozn_cq15_2000_80_75899506_6_5.zip
2/3/2008 9:38:51 AM||Project communication failed: attempting access to reference site
2/3/2008 9:38:51 AM|climateprediction.net|Temporarily failed upload of hadcm3iozn_cq15_2000_80_75899506_6_5.zip: http error
2/3/2008 9:38:51 AM|climateprediction.net|Backing off 2 hr 8 min 39 sec on upload of hadcm3iozn_cq15_2000_80_75899506_6_5.zip
2/3/2008 9:38:52 AM||Access to reference site succeeded - project servers may be temporarily down.

The zip file in question is 15.83MB, and the transfer started and went very quickly up to 7.30MB, then abruptly halted. After a while, timeout ensued. The same thing is also happening on another machine which has 3 of these files trying to upload.
ID: 32448 · Report as offensive     Reply Quote
ProfileMikeMarsUK
Volunteer moderator
Avatar

Send message
Joined: 13 Jan 06
Posts: 1498
Credit: 15,613,038
RAC: 0
Message 32449 - Posted: 3 Feb 2008, 16:06:27 UTC


There may be a size limit for file transfers on the proxy server at your site?

I'm a volunteer and my views are my own.
News and Announcements and FAQ
ID: 32449 · Report as offensive     Reply Quote
Profileold_user733
Avatar

Send message
Joined: 9 Aug 04
Posts: 25
Credit: 4,756,979
RAC: 0
Message 32451 - Posted: 3 Feb 2008, 21:42:24 UTC
Last modified: 3 Feb 2008, 21:46:33 UTC

Hmmm, well you\'ve answered at least part of the question. It does seem to be just me. To answer the two questions implied in your response, no, we don\'t use a proxy server, and, I\'ve been running CPDN for years from this site, we never had this issue before.

It\'s a good bet that somebody in the IT department has been fiddling with something, then. I\'ll have to complain about it tomorrow.

Thanks for the help.
ID: 32451 · Report as offensive     Reply Quote
DJStarfox

Send message
Joined: 27 Jan 07
Posts: 300
Credit: 3,288,263
RAC: 26,370
Message 32452 - Posted: 4 Feb 2008, 4:27:29 UTC - in response to Message 32451.  

Hmmm, well you\'ve answered at least part of the question. It does seem to be just me. To answer the two questions implied in your response, no, we don\'t use a proxy server, and, I\'ve been running CPDN for years from this site, we never had this issue before.

It\'s a good bet that somebody in the IT department has been fiddling with something, then. I\'ll have to complain about it tomorrow.

Thanks for the help.


Hmm... Seems like packets go out, but the ACK packets never make it back to your machine. Definitely a firewall configuration problem.
ID: 32452 · Report as offensive     Reply Quote
Profileold_user733
Avatar

Send message
Joined: 9 Aug 04
Posts: 25
Credit: 4,756,979
RAC: 0
Message 32455 - Posted: 4 Feb 2008, 22:51:29 UTC

I ran Wireshark on one of the machines with the problem, and at the point where the stoppage occurs, I see a \"TCP ZeroWindow\" message, looks like it\'s coming back from climateapps3.oucs.ox.ac.uk (163.1.13.134). This is on the Ack, and I can see a steadily decreasing window size on the preceding acks.

got go go, more on this later...
ID: 32455 · Report as offensive     Reply Quote
Profileold_user733
Avatar

Send message
Joined: 9 Aug 04
Posts: 25
Credit: 4,756,979
RAC: 0
Message 32456 - Posted: 5 Feb 2008, 0:12:07 UTC

Sorry I had to go, my ride was there. We have a thing at our location which is called a \"Riverbed\"...

http://www.riverbed.com/products/appliances/

which gets in the middle of all transfers, like a cache. I am becoming suspicious that it may be at fault here. Will explore this more tomorrow.

ID: 32456 · Report as offensive     Reply Quote
Profileold_user733
Avatar

Send message
Joined: 9 Aug 04
Posts: 25
Credit: 4,756,979
RAC: 0
Message 32462 - Posted: 5 Feb 2008, 20:21:57 UTC

It was the Riverbed. With that bypassed, the transfers went smoothly.
ID: 32462 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 32463 - Posted: 5 Feb 2008, 20:40:32 UTC


Another mystery solved.
Glad to hear that you\'re back in business. :)

ID: 32463 · Report as offensive     Reply Quote

Message boards : Number crunching : trickle uploads stopping at 7.3 MB. Is it just me?

©2024 cpdn.org