From David Wallom

We have migrated the scheduler to the backup system this morning though this means that Andy is doing some fiddling with the https configuration at the moment.

My sam25 uploads that were stuck while the site was down have all uploaded now but I don't know what effect the fiddling will have with anything else just that the transitioner is showing red on the Project Status page currently.

Thanks Dave,

zips going to Oxford seem to be uploading, however JASMIN is still out of disk space.

All of my Linux zips on three machines have gone, so that is progress. But I have over 50 WAH2 zips on my windows machine still stuck. It seems to be discrimination against North America.

My SAM25 zips have all gone but my SAM50 zips are all still stuck.

All of my Linux zips on three machines have gone, so that is progress. But I have over 50 WAH2 zips on my windows machine still stuck. It seems to be discrimination against North America.

Same here. SAM50 and SAFR50 are pending. Those files are several times as big. ~17MB compared to 76/92MB each.

Server is out of disk space

25.06.2019 08:16:44 | climateprediction.net | Started upload of wah2_safr50_n1vt_201112_13_818_011862688_0_r392739119_8.zip
25.06.2019 08:16:46 | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space

I have 2 files 89MB and 90MB

sam50 uploads have started and are slowing down all other communication. 15 GBytes to go, should take at least two days.

Edit: They stopped again. Out of disk space.

One wonders if these issues could have been anticipated. We have done our part!

One wonders if these issues could have been anticipated.

They are hoping to do better with the climate.

One wonders if these issues could have been anticipated.

I suspect they are anticipated but there isn't enough redundancy in the systems of the universities who receive the data to cope with problems. In the past, this has been true of Oxford too. My guess is that the universities receiving the data have a standard protocol of how much space they give researchers irrespective of how much space they actually need.

Of course it may be nothing to do with bureaucracy and I am just letting my 30+ years working for the NHS show. ;)

I've just looked - two tasks waiting to upload, a total of 23 zip files mostly around 90Mb each.
Surely, when sending work out one would have an idea of the returned file sizes, and either think about not sending a particular job out if there might be a space issue, or make sure that there is more than sufficient space available for the return files.

I am having the same problem, but I have 35 zip files waiting. My log says your server is out of space.

6/26/2019 10:21:56 AM | climateprediction.net | Started upload of wah2_sam50_n59k_200612_24_822_011881979_0_r1523546388_3.zip
6/26/2019 10:21:56 AM | climateprediction.net | Started upload of wah2_sam50_n59k_200612_24_822_011881979_0_r1523546388_5.zip
6/26/2019 10:21:59 AM | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space
6/26/2019 10:21:59 AM | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space
6/26/2019 10:21:59 AM | climateprediction.net | Temporarily failed upload of wah2_sam50_n59k_200612_24_822_011881979_0_r1523546388_3.zip: transient upload error
6/26/2019 10:21:59 AM | climateprediction.net | Backing off 04:27:47 on upload of wah2_sam50_n59k_200612_24_822_011881979_0_r1523546388_3.zip
6/26/2019 10:21:59 AM | climateprediction.net | Temporarily failed upload of wah2_sam50_n59k_200612_24_822_011881979_0_r1523546388_5.zip: transient upload error
6/26/2019 10:21:59 AM | climateprediction.net | Backing off 05:49:53 on upload of wah2_sam50_n59k_200612_24_822_011881979_0_r1523546388_5.zip

Some have said that if you have many zip files to upload but they're not getting through to put your tasks on suspended status so they won't fail and wait until the zip files have been successfully uploaded. I only have about 12 files pending, but I've suspended mine until they make enough server space.

Moderators, is this what you would suggest?

From the length of time this has been going on with Jasmin I would guess (perhaps incorrectly) that this is more than just a re-adjustment of quotas but an actual lack of physical hard drive space which of course takes time and money to solve.

Do we have any indication how it is going with the storage space problem? When will it be fixed?

From the length of time this has been going on with Jasmin I would guess (perhaps incorrectly) that this is more than just a re-adjustment of quotas but an actual lack of physical hard drive space which of course takes time and money to solve.

I expect it is worse than that. I fear a repeat of the Big One last year.
When it crashes, it crashes.

Apparently the people who look after "jasmin" have been having problems for some time.
I don't know the fine details and I don't intend to ask.

Yes, Suspending all of the tasks so that you don't get even more zips in the queue is definitely recommended.

Wow, I picked a bad time to return to CPDN. My upload queues are choked with work that can't go anywhere. Hopefully suspending the project will help retain completed work on local machines. There are disk space warnings that make me think some work may end up being lost for good.

These are from the same computer. sam50 downloads are forbidden, anz50 are allowed?

2019-06-27 07:17:52 | climateprediction.net | Giving up on download of wah2_sam50_n4k0_200912_13_809_011823386.zip: permanent HTTP error

2019-06-27 08:18:30 | climateprediction.net | Finished download of wah2_anz50_n27g_201612_20_794_011765246.zip