climateprediction.net (CPDN) home page
Thread 'Has Milo just made space or actually installed the new server?'

Thread 'Has Milo just made space or actually installed the new server?'

Message boards : Number crunching : Has Milo just made space or actually installed the new server?
Message board moderation

To post messages, you must log in.

AuthorMessage
Digby

Send message
Joined: 17 Feb 06
Posts: 89
Credit: 4,309,159
RAC: 0
Message 28613 - Posted: 11 May 2007, 21:58:26 UTC

I hear different reasons for the recent problems with uploading.

1) The server is full and more space needs to be made.
2) A new server has been bought after much discussion and Milo has been installing it. However when he went to install it the computer room was busy and he had to go back a few days later.
3) Milo has been busy building a new RAID 5 storage system.

The first is self explanatory and the second is sometimes mentioned and sometimes not. The third has been mentioned a bit...

So, out of interest, which of these options is happening or is it all three. Just curious because everyone has been putting a lot of effort into this project and the smoother it runs the better...

Cheers

Digby
ID: 28613 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 28614 - Posted: 11 May 2007, 22:16:40 UTC


All 3.

While the server was on it\'s way / waiting to be installed, data had to be offloaded to elsewhere to make room for more from users.
The raid system is how the HD\'s in the new server is organised.

ID: 28614 · Report as offensive     Reply Quote
ProfileThyme Lawn
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1283
Credit: 15,824,334
RAC: 0
Message 28615 - Posted: 11 May 2007, 22:28:05 UTC

The original upload server had been creaking at the seams for a while, with results being off-loaded to other systems manually. There were delays in getting hold of the replacement server, and the team ran out of places to off-load results to. I guess they could have deleted some older results and restored them to the new server from the backups, but that would have made those results inaccessible to the back-end processing done by project scientists. When the old server ran out of disk space our computers started to be used as distributed storage.

The new server is a rack mounted RAID 5 system and, yes, Milo couldn\'t get access to the computer room when it arrived because there was some work going on in there which meant there there wasn\'t enough space for everybody to fit in.

After the new server was safely installed in the rack he had to copy the data off of the computers it was stored on, at which point he was able to cut over to the new server and re-enable uploads.

I guess that\'s the long way of saying the answer is yes to the first 2 and a bit of yes and no to the third. It\'s an off-the-shelf box, so Milo had to do the server-side software setup and data transferring, but he didn\'t have to put all the hardware together!
"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer
ID: 28615 · Report as offensive     Reply Quote
Digby

Send message
Joined: 17 Feb 06
Posts: 89
Credit: 4,309,159
RAC: 0
Message 28645 - Posted: 12 May 2007, 19:01:10 UTC - in response to Message 28615.  

Ok thanks for the update. It sounds as though we are \'good to go\'.

Digby
ID: 28645 · Report as offensive     Reply Quote
ProfileWarped

Send message
Joined: 12 Sep 04
Posts: 34
Credit: 1,017,702
RAC: 0
Message 28704 - Posted: 15 May 2007, 6:56:20 UTC

Despite the news item (see link at the top right of the home page) seeming to indicate that the data migration is still underway, my 10-year uploads are happening without error. The last post by mo.v in the \"News and Announcements\" thread is also ambiguous in that it seems that Milo has merely made space on an already full server.

My question, therefore: Is the new server now fully operational, with plenty of storage space? If so, shouldn\'t the news item and the announcement thread be updated?
Warped
ID: 28704 · Report as offensive     Reply Quote
ProfileMikeMarsUK
Volunteer moderator
Avatar

Send message
Joined: 13 Jan 06
Posts: 1498
Credit: 15,613,038
RAC: 0
Message 28705 - Posted: 15 May 2007, 7:10:41 UTC
Last modified: 15 May 2007, 7:11:26 UTC


AFAIK the new server is up and running (I think it\'s climateapps3 on the status page).

I do know that the CPDN team at Oxford University find it very hard to get updates onto the www.climateprediction.net front page (which is actually hosted at a different university, the Open University in Milton Keynes), so sometimes news items get delayed.

I'm a volunteer and my views are my own.
News and Announcements and FAQ
ID: 28705 · Report as offensive     Reply Quote

Message boards : Number crunching : Has Milo just made space or actually installed the new server?

©2024 cpdn.org