climateprediction.net (CPDN) home page
Thread 'Total Credit'

Thread 'Total Credit'

Message boards : Number crunching : Total Credit
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next

AuthorMessage
ed2353

Send message
Joined: 15 Feb 06
Posts: 137
Credit: 35,377,018
RAC: 12,908
Message 53974 - Posted: 17 Apr 2016, 23:04:52 UTC - in response to Message 53973.  
Last modified: 17 Apr 2016, 23:21:34 UTC

But several regions going down at the same time should point to a common route/problem surely?

Oh, and my trickles have not been giving me credit since Thursday either.
ID: 53974 · Report as offensive     Reply Quote
ProfileIain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1084
Credit: 7,841,902
RAC: 5,047
Message 53976 - Posted: 17 Apr 2016, 23:33:09 UTC

From my client_state.xml file it would seem that (for routine Zips, 1->n-1):

hadam3p_afr50 go to http://upload2.cpdn.org/cgi-bin/file_upload_handler and are blocked.

wah2_eu25 go to http://upload3.cpdn.org/cpdn_cgi/file_upload_handler and are getting through.

wah2_sas50 and hadam3p_eu also go to upload2; I haven't got any of these running yet, but I assume that these would also be blocked.

So, one of the upload handlers at Oxford appears not to be working, affecting a number of different model types.
ID: 53976 · Report as offensive     Reply Quote
Kevin

Send message
Joined: 5 Jul 09
Posts: 63
Credit: 6,091,274
RAC: 0
Message 53977 - Posted: 17 Apr 2016, 23:35:38 UTC

Les

Is this what you want

<name>hadam3p_afr50_eyrl_201412_12_371_010406591_2_5.zip</name>
<nbytes>26179548.000000</nbytes>
<max_nbytes>200000000.000000</max_nbytes>
<md5_cksum>848fad9cb07eb41120c772348b7d18c5</md5_cksum>
<status>1</status>
<upload_url>http://upload2.cpdn.org/cgi-bin/file_upload_handler</upload_url>



Kevin
ID: 53977 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 53978 - Posted: 18 Apr 2016, 1:27:05 UTC - in response to Message 53974.  

ed2353

Yes, it does seem common. But which one?
A question that's now been answered by Iain and Kevin.

Email sent. Wherein I also mentioned the continuing "no create problem".

Credits are a separate matter.
As are the trickle_up files, which Do all go to Oxford.


ID: 53978 · Report as offensive     Reply Quote
ProfileJIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,363,583
RAC: 5,022
Message 53979 - Posted: 18 Apr 2016, 3:25:57 UTC

And of course it is the weekend. Hopefully tomorrow the Staff will be able to get into the server room and fix the problem.

ID: 53979 · Report as offensive     Reply Quote
jrapdx

Send message
Joined: 4 Jul 15
Posts: 63
Credit: 3,223,760
RAC: 0
Message 53980 - Posted: 18 Apr 2016, 5:19:16 UTC

In case it helps, same problems here: no connection for uploading wah2 zips, starting 2016-04-17 06:19:06 UTC according to the event log. Also, though less important, credits haven't changed since Apr 10. Hopefully the outages will be fixed soon.
ID: 53980 · Report as offensive     Reply Quote
ed2353

Send message
Joined: 15 Feb 06
Posts: 137
Credit: 35,377,018
RAC: 12,908
Message 53981 - Posted: 18 Apr 2016, 8:57:01 UTC - in response to Message 53978.  

Thanks again Les.

My Trickle-ups have now been granted credit.

It also appears that the Credit Script has run and my Total Credit has updated since last night.

I thought that the Credit Script was going to be run weekly on a Saturday, but it seems to have run on a Sunday last week and this.
ID: 53981 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 53982 - Posted: 18 Apr 2016, 9:01:26 UTC - in response to Message 53981.  

I thought that the Credit Script was going to be run weekly on a Saturday, but it seems to have run on a Sunday last week and this.


Or it takes a loooong time to run!
ID: 53982 · Report as offensive     Reply Quote
ProfileVicki

Send message
Joined: 28 Nov 15
Posts: 50
Credit: 4,099,809
RAC: 0
Message 53983 - Posted: 18 Apr 2016, 9:57:41 UTC - in response to Message 53973.  

Hi Les
My traffic jam is now 6 files deep. My client state file is 352k long, what needle in the hay stack do you need from me?. 4 * hadam3p_eu_h8xy files and 2 * wah_sas50_h11l_198812_13 files. no doubt this will build up as more trickle points are reached in the running tasks. Oddly this error is only happening on my win 10 - aspire, not with my win 7 laptop.

Kind thoughts,

Vicki
ID: 53983 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 53984 - Posted: 18 Apr 2016, 10:19:31 UTC - in response to Message 53983.  

Hi Vicki,

Les has the answer on this now. the reason only one box is affected is the type of tasks involved and the fact that the zips go to different servers.

The string to look for is highlighted in bold.

<upload_url>http://upload3.cpdn.org/cpdn_cgi/file_upload_handler</upload_url>

which will be followed by the url for that particular model type.
ID: 53984 · Report as offensive     Reply Quote
bernard_ivo

Send message
Joined: 18 Jul 13
Posts: 438
Credit: 25,623,821
RAC: 1,846
Message 53985 - Posted: 18 Apr 2016, 11:02:45 UTC - in response to Message 53984.  
Last modified: 18 Apr 2016, 11:39:11 UTC


<upload_url>http://upload3.cpdn.org/cpdn_cgi/file_upload_handler</upload_url>


Hi Dave,
Could this also be seen in the Event log window and if yes which is the corresponding option in "Event Log options" I should select for Boinc versions 7.6.22 (x86) and 7.6.9 (x64)?

Edit: The <upload_url> is not in client_state.xml but in client_state_prev.xml at least for the version 7.6.22 (x86) (running under wine) (though at one of my machines I cannot locate neither of the files in the wine directory)
ID: 53985 · Report as offensive     Reply Quote
Profileritterm
Avatar

Send message
Joined: 29 May 08
Posts: 128
Credit: 6,289,876
RAC: 0
Message 53986 - Posted: 18 Apr 2016, 12:30:49 UTC
Last modified: 18 Apr 2016, 12:37:03 UTC

Something seems to have changed with the upload problem, at least for me, and my pending uploads now stand at 100%. Whereas, I was getting "transient HTTP error" and then "connect() failed" messages, I'm now getting errors similar to this:

"...[error] Error reported by file upload server: can't open file /storage/incoming/uploader/hadam3p_pnw_fta4_201312_12_383_010450217_1_7.zip: No such file or directory"
ID: 53986 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 53987 - Posted: 18 Apr 2016, 12:47:47 UTC

Interesting Bernard, - The line I copied and pasted was from my client_state.xml and this machine is using 7.6.22 (x86) under wine.

I assume the option is http_transfer debug
ID: 53987 · Report as offensive     Reply Quote
bernard_ivo

Send message
Joined: 18 Jul 13
Posts: 438
Credit: 25,623,821
RAC: 1,846
Message 53988 - Posted: 18 Apr 2016, 14:32:46 UTC - in response to Message 53987.  

Interesting Bernard, - The line I copied and pasted was from my client_state.xml and this machine is using 7.6.22 (x86) under wine.

I assume the option is http_transfer debug


I do have only http_debug and http_xfer_debug. And I see similar to ritterm's report in my event log
" climateprediction.net | [http] [ID#9122] Info: Connection #392 to host upload2.cpdn.org left intact
climateprediction.net | [error] Error reported by file upload server: can't open file /storage/incoming/uploader/hadam3p_afr50_ewzd_201412_12_371_010404279_1_13.zip: No such file or directory"
for the moment I suspend network activity
ID: 53988 · Report as offensive     Reply Quote
Kevin

Send message
Joined: 5 Jul 09
Posts: 63
Credit: 6,091,274
RAC: 0
Message 53989 - Posted: 18 Apr 2016, 14:58:26 UTC

The atuck uploads are now going, slowly, but getting there.


Kevin
ID: 53989 · Report as offensive     Reply Quote
Kevin

Send message
Joined: 5 Jul 09
Posts: 63
Credit: 6,091,274
RAC: 0
Message 53991 - Posted: 19 Apr 2016, 8:12:45 UTC

The afr50 uploads have stuck again.


Kevin
ID: 53991 · Report as offensive     Reply Quote
Darmok

Send message
Joined: 29 Dec 09
Posts: 34
Credit: 18,395,130
RAC: 0
Message 53993 - Posted: 20 Apr 2016, 22:45:49 UTC - in response to Message 53976.  
Last modified: 20 Apr 2016, 22:46:58 UTC

Maybe a coincidence, but since these stuck uploads, from the 18th, granted credits on AFR are off, varying by as much as 75%. Just saying..
ID: 53993 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 53994 - Posted: 20 Apr 2016, 23:16:19 UTC - in response to Message 53993.  

Maybe a coincidence, but since these stuck uploads, from the 18th, granted credits on AFR are off, varying by as much as 75%. Just saying..


Not sure from your post if you're aware of it, but it's been stated in this thread, and in the news thread of this board that credits are currently only being calculated once a week, on the weekend.
ID: 53994 · Report as offensive     Reply Quote
ProfileastroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 53995 - Posted: 21 Apr 2016, 1:43:51 UTC

It's interesting to read five days of posts in one sitting. (I was away -- had my laptop in tow but couldn't access the boards [the "don't have permission" error message got in the way]).

Haven't had time to dig through records for the desktops yet, but the slow (i5, 2.6 GHz) laptop had 34 .zip files, all afr50, waiting to upload before the pipe was reopened. (It seems an absurdly high number for that box!)

One thing stood out after checking server's record. Same-machine CPU times for these afr50 batches vary quite a bit. Hence, credit will seem low for normal-length (whatever that is) tasks compared to 'speedy' ones.

"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 53995 · Report as offensive     Reply Quote
ProfileAlan K

Send message
Joined: 22 Feb 06
Posts: 491
Credit: 31,084,581
RAC: 14,886
Message 53998 - Posted: 23 Apr 2016, 9:19:47 UTC - in response to Message 53995.  

Looks like we have an upload error again:

23/04/2016 08:15:17 | climateprediction.net | [http] [ID#309] Info: Trying 129.67.195.136...
23/04/2016 08:15:18 | climateprediction.net | [http] [ID#309] Info: Connected to upload2.cpdn.org (129.67.195.136) port 80 (#3861)
23/04/2016 08:15:18 | climateprediction.net | [http] [ID#309] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
23/04/2016 08:15:18 | climateprediction.net | [http] [ID#309] Sent header to server: Host: upload2.cpdn.org
23/04/2016 08:15:19 | climateprediction.net | [http] [ID#309] Sent header to server: Expect: 100-continue
23/04/2016 08:16:16 | climateprediction.net | [http] [ID#309] Info: Connection #3861 to host upload2.cpdn.org left intact
23/04/2016 08:16:16 | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/incoming/uploader/hadam3p_eu_h909_201412_5_388_010503399_1_3.zip: No such file or directory
23/04/2016 08:16:16 | climateprediction.net | Temporarily failed upload of hadam3p_eu_h909_201412_5_388_010503399_1_3.zip: transient upload error
23/04/2016 08:16:16 | climateprediction.net | Backing off 00:03:19 on upload of hadam3p_eu_h909_201412_5_388_010503399_1_3.zip

I've suspended network activity so the server doesn't get bombarded.
ID: 53998 · Report as offensive     Reply Quote
Previous · 1 . . . 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next

Message boards : Number crunching : Total Credit

©2024 cpdn.org