Uploads still stuck for me. Hopefully, server can be fixed today or tomorrow.

Uploads still stuck for me. Hopefully, server can be fixed today or tomorrow.

The absolute earliest will be tomorrow when the cloud provider support go back to work. However, they will probably have a queue of requests to get through so might be day or two after.

When you say "cores" do you mean real cpu cores or threads? (Just want to double check).

Boinc doesn't know about Hyper-Threading.
Every thread is counted as a core.
In every setting that refers to 'cpu' this actually means 'thread'.

---

- - - - - - - - - -
Greetings, Jens

Messages flying about but no identification of exactly what the problem is yet. Andy thinks Jasmin have changed something in their infrastructure but not sure what. What is clear is that those involved are working on it and not sitting on their hands. (With the possible exception of those managing jasmin which I assume is the successor to Joint Academic Network. I never did work out what the rest of the new acronym is.

Messages flying about but no identification of exactly what the problem is yet. Andy thinks Jasmin have changed something in their infrastructure but not sure what. What is clear is that those involved are working on it and not sitting on their hands. (With the possible exception of those managing jasmin which I assume is the successor to Joint Academic Network. I never did work out what the rest of the new acronym is.

Thanks Dave. I've been bouncing around all morning like a kitten on heat, wanting to (but knowing I mustn't) ask 'are we nearly there yet?'.

Messages flying about but no identification of exactly what the problem is yet. Andy thinks Jasmin have changed something in their infrastructure but not sure what. What is clear is that those involved are working on it and not sitting on their hands. (With the possible exception of those managing jasmin which I assume is the successor to Joint Academic Network. I never did work out what the rest of the new acronym is.

The Joint Analysis System Meeting Infrastructure Needs

traceroute eventually makes its way to the proper destination.

traceroute to upload11.cpdn.org (192.171.169.187), 64 hops max
  1   192.168.1.1 (Fios_Quantum_Gateway.fios-router.home)  0.342ms  0.285ms  0.264ms 
  2   100.0.197.1 (lo0-100.BSTNMA-VFTTP-308.verizon-gni.net)  7.776ms  9.234ms  12.042ms 
  3   100.41.214.178 (B3308.BSTNMA-LCR-21.verizon-gni.net)  11.290ms  7.794ms  14.045ms 
  4   *  *  * 
  5   140.222.236.255 (0.ae2.BR1.BOS30.ALTER.NET)  4.700ms  9.752ms  9.719ms 
  6   62.115.170.72 (bost-b2-link.telia.net)  10.007ms  *  * 
  7   62.115.122.202 (nyk-bb1-link.ip.twelve99.net)  15.936ms  9.395ms  9.848ms 
  8   62.115.112.245 (ldn-bb4-link.ip.twelve99.net)  79.272ms  78.822ms  78.587ms 
  9   62.115.120.239 (ldn-b2-link.ip.twelve99.net)  79.447ms  79.003ms  78.299ms 
 10   62.115.175.131 (jisc-ic345131-ldn-b2.ip.twelve99-cust.net)  76.696ms  78.259ms  78.755ms 
 11   146.97.35.197 (ae24.londhx-sbr1.ja.net)  79.159ms  78.027ms  78.719ms 
 12   146.97.33.2 (ae29.londpg-sbr2.ja.net)  79.844ms  77.670ms  81.317ms 
 13   146.97.33.22 (ae31.erdiss-sbr2.ja.net)  90.225ms  87.908ms  88.663ms 
 14   *  *  * 
 15   146.97.41.34 (ral-r26.ja.net)  88.691ms  88.240ms  88.613ms 
 16   *  *  * 
 17   *  *  * 
 18   *  *  * 
 19   *  *  * 
 20   192.171.169.187 (192.171.169.187)  85.539ms !*  85.660ms !*  88.446ms !* 

And "transient HTTP error" after two minutes (timeout) has changed to "connect() failed" after 1 second (software not running yet).

The Joint Analysis System Meeting Infrastructure Needs

In case anyone cares, this describes their systems and services...

https://www.bnlawrence.net/assets/talks/2014-07-02-lawrence_eresearchNZ14_jasmin.pdf

---

And "transient HTTP error" after two minutes (timeout) has changed to "connect() failed" after 1 second (software not running yet).

True: I guess it is better to fail fast. At least they are doing something.
Traceroute is the same as last week (so I will not bother to post the results here).

Tue 03 Jan 2023 08:30:18 AM EST | climateprediction.net | Started upload of oifs_43r3_ps_0144_2001050100_123_970_12186788_0_r1420963935_113.zip
Tue 03 Jan 2023 08:30:18 AM EST | climateprediction.net | Started upload of oifs_43r3_ps_0144_2001050100_123_970_12186788_0_r1420963935_114.zip
Tue 03 Jan 2023 08:30:21 AM EST |  | Project communication failed: attempting access to reference site
Tue 03 Jan 2023 08:30:21 AM EST | climateprediction.net | Temporarily failed upload of oifs_43r3_ps_0144_2001050100_123_970_12186788_0_r1420963935_113.zip: connect() failed
Tue 03 Jan 2023 08:30:21 AM EST | climateprediction.net | Backing off 00:53:19 on upload of oifs_43r3_ps_0144_2001050100_123_970_12186788_0_r1420963935_113.zip
Tue 03 Jan 2023 08:30:21 AM EST | climateprediction.net | Temporarily failed upload of oifs_43r3_ps_0144_2001050100_123_970_12186788_0_r1420963935_114.zip: connect() failed
Tue 03 Jan 2023 08:30:21 AM EST | climateprediction.net | Backing off 00:18:48 on upload of oifs_43r3_ps_0144_2001050100_123_970_12186788_0_r1420963935_114.zip
Tue 03 Jan 2023 08:30:23 AM EST |  | Internet access OK - project servers may be temporarily down.

---

David can now log in.
More messages flying about.

AndreyOR wrote:

I can't get any more work because of too many uploads in progress, according to event log.

Richard Haselgrove wrote:

The "too many uploads in progress" limit? It doesn't count the files, just the number of tasks that can't report because they have at least one file still to upload.

The limit is twice the number of CPU cores in the system.

Richard Haselgrove wrote:

It's what BOINC reads as 'number of CPUs' in the system - so that's probably what the OS reads from the BIOS. If you have a physical CPU that supports hyperthreading, you could double the number by turning hyperthreading on.

Actually it's twice the number of "usable CPUs".
"Usable CPUs" is AFAIU the number of logical CPUs of the host system, possibly overridden by cc_config::options::ncpus, _and_ modified by computing preferences' percentage of CPUs allowed to be used by BOINC.

But back to the matter in hand - I was misled (over-optimistic) about the changed error message. In full, it reads:

03/01/2023 14:31:57 | climateprediction.net | [http] [ID#4304] Info: Trying 192.171.169.187:80...
03/01/2023 14:31:57 | climateprediction.net | [http] [ID#4304] Info: connect to 192.171.169.187 port 80 failed: No route to host
03/01/2023 14:31:57 | climateprediction.net | [http] [ID#4304] Info: Failed to connect to upload11.cpdn.org port 80 after 19 ms: No route to host
03/01/2023 14:31:57 | climateprediction.net | [http] [ID#4304] Info: Closing connection 4403
03/01/2023 14:31:57 | climateprediction.net | [http] HTTP error: Couldn't connect to server
03/01/2023 14:31:58 | climateprediction.net | Temporarily failed upload of oifs_43r3_ps_0264_2002050100_123_971_12187908_2_r743750888_75.zip: connect() failed

Messages flying about but no identification of exactly what the problem is yet. Andy thinks Jasmin have changed something in their infrastructure but not sure what. What is clear is that those involved are working on it and not sitting on their hands. (With the possible exception of those managing jasmin which I assume is the successor to Joint Academic Network. I never did work out what the rest of the new acronym is.

JASMIN is a cloud service managed by people at the Rutherford Appleton Labs for the benefit of UK academia. JANet is the UK academic network provider. A traceroute will show a connection from your broadband to a janet hub before a hop or two to JASMIN.

I would not bother trying to force uploads through, the server is up and will be at capacity for some time. The connect() message just means the httpd servers were busy and there's none spare. Should improve after a couple of hrs.

Just tell the volunteers to sit tight and be patient. It's not all quite working yet.

(I think we guessed that.)

I'm Uploading.

Me Too :)
And to let everybody else have a part of it, i limit my upload slots to one for now. Doesn't hurt me, since the server can use the full bandwith of my upload with one slot.

Greets
Felix

I've had few files upload so only 39,113 to go. That's from 340 completed tasks.

I've had few files upload so only 39,113 to go. That's from 340 completed tasks.

Bunch of files uploaded then it started getting http error at about 15:30. 15:50, started working again then more errors from 17:10 onwards. May just be the server being overloaded though.

I saw it working quite a bit during the late afternoon, but with occasional breaks. I don't know whether that was just a pause to cool down, or a full stop requiring manual intervention. But it seems to have stopped for good (or at least, for the night) now.