climateprediction.net (CPDN) home page
Thread 'Upload issue.'

Thread 'Upload issue.'

Questions and Answers : Windows : Upload issue.
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · Next

AuthorMessage
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4541
Credit: 19,039,635
RAC: 18,944
Message 69428 - Posted: 29 Jul 2023, 7:30:25 UTC

Hello,
I am also having difficulties with uploading files, for about two weeks now. I now have 12 files of approx 120 MB each waiting to upload. I am running BOINC 7.20.2 for Windows. Here is an extract from the event log:


Glen did say that he had heard from Andy that it was likely to be at least two weeks till upload7 was fixed and ready to take uploads again. If nothing changes by the time I look here on Monday, I will send another email as I think two weeks has passed since Glen passed on that message.
ID: 69428 · Report as offensive     Reply Quote
Karen

Send message
Joined: 12 Jul 19
Posts: 9
Credit: 363,587
RAC: 536
Message 69429 - Posted: 29 Jul 2023, 9:44:30 UTC - in response to Message 69428.  

Thank you Dave.
ID: 69429 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4541
Credit: 19,039,635
RAC: 18,944
Message 69433 - Posted: 30 Jul 2023, 10:28:16 UTC - in response to Message 69429.  

I may give it a couple of days. I see from one of Glen's other posts Andy has been on leave and I don't know what other fires will need fighting on his return.
ID: 69433 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1052
Credit: 16,794,747
RAC: 13,286
Message 69434 - Posted: 30 Jul 2023, 15:42:29 UTC - in response to Message 69433.  

I may give it a couple of days. I see from one of Glen's other posts Andy has been on leave and I don't know what other fires will need fighting on his return.

Dave, that's right. It needs Andy @ CPDN to look at what's happening on the EAS Korean server. He's back tomorrow and I'll sit in on the morning's tech meeting and can report back. You probably recall there needed to be an upgrade of their OS, which was done, but probably few extras need doing.

I'm sure CPDN will be able to get uploads going in the next day or two, but I will update tomorrow.
---
CPDN Visiting Scientist
ID: 69434 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1052
Credit: 16,794,747
RAC: 13,286
Message 69438 - Posted: 31 Jul 2023, 10:41:54 UTC - in response to Message 69434.  

Update from CPDN this morning. Andy their sole technical person is not back from leave until Weds when he'll look at the Korean upload server as a priority. I'm told there's a few more things that need finishing on the upgrade of the server before it can be turned back on. The estimate is this time next week but may well be back up before.
---
CPDN Visiting Scientist
ID: 69438 · Report as offensive     Reply Quote
Profileadrianxw
Avatar

Send message
Joined: 31 Aug 04
Posts: 145
Credit: 2,080,724
RAC: 753
Message 69441 - Posted: 1 Aug 2023, 6:38:02 UTC - in response to Message 69438.  

With the deadlines set as they are for these files, ie. next summer some time, it is not really an urgent issue. Let him get back into things in his own time.
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.
ID: 69441 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1052
Credit: 16,794,747
RAC: 13,286
Message 69442 - Posted: 1 Aug 2023, 8:09:42 UTC - in response to Message 69441.  

The year deadlines are a hangover from the early days of CPDN when they had very long running climate models, not the 'weather' models they run today. The deadlines are unrealistic.

The scientists who fund this project need the results ASAP, which is why it's a priority (i.e. they are 'paying customers'). In practice CPDN close the batches long before the deadlines are met.
---
CPDN Visiting Scientist
ID: 69442 · Report as offensive     Reply Quote
Profileadrianxw
Avatar

Send message
Joined: 31 Aug 04
Posts: 145
Credit: 2,080,724
RAC: 753
Message 69443 - Posted: 1 Aug 2023, 9:59:44 UTC - in response to Message 69442.  
Last modified: 1 Aug 2023, 10:04:01 UTC

Surely, it is the responsibility of the project scientists to state during the initial stages of project development to specify the kind of turn round they need for work units. Whinging about it later is pointless if that was not done.
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.
ID: 69443 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1052
Credit: 16,794,747
RAC: 13,286
Message 69444 - Posted: 1 Aug 2023, 12:17:46 UTC - in response to Message 69443.  

Surely, it is the responsibility of the project scientists to state during the initial stages of project development to specify the kind of turn round they need for work units. Whinging about it later is pointless if that was not done.
Think there's a misunderstanding. No-one is whinging, certainly on the scientists.

The scientists do state a project timeline but it's alot less than 1 yr which is currently set by CPDN for tasks; as I said, it's a leftover from the long climate run days. Realistically, 2-3 months would be more appropriate. If the deadline was really 1yr, they could run Weather@Home on their own computers in that time!
ID: 69444 · Report as offensive     Reply Quote
Profileadrianxw
Avatar

Send message
Joined: 31 Aug 04
Posts: 145
Credit: 2,080,724
RAC: 753
Message 69445 - Posted: 1 Aug 2023, 12:58:52 UTC - in response to Message 69444.  

Well, perhaps CPDN was the wrong vehicle to run their job on. Run it themselves or WCG as alternatives.
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.
ID: 69445 · Report as offensive     Reply Quote
Profileadrianxw
Avatar

Send message
Joined: 31 Aug 04
Posts: 145
Credit: 2,080,724
RAC: 753
Message 69446 - Posted: 1 Aug 2023, 15:30:10 UTC

Off topic observation, the nz tasks all completed normally and have uploaded. The eas ones are stuck, as per the thread here. I have not received any new tasks from the project since the nz's uploaded.
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.
ID: 69446 · Report as offensive     Reply Quote
jwaggy

Send message
Joined: 4 Dec 16
Posts: 2
Credit: 2,571,009
RAC: 5,155
Message 69457 - Posted: 8 Aug 2023, 16:04:24 UTC

I also have tasks that won't upload. They have been attempting to for about 23 days. Is this going to be fixed soon?
ID: 69457 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4541
Credit: 19,039,635
RAC: 18,944
Message 69458 - Posted: 9 Aug 2023, 13:41:35 UTC - in response to Message 69457.  

I also have tasks that won't upload. They have been attempting to for about 23 days. Is this going to be fixed soon?
Sorry I don't have an answer to that. Andy, the only IT person who works for the project is aware of the problem as are the people in Korea where the server the files get sent to is. Rest assured that Glen, myself or one of the other moderators will post any news as soon as we have it.
ID: 69458 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4541
Credit: 19,039,635
RAC: 18,944
Message 69459 - Posted: 10 Aug 2023, 5:08:26 UTC - in response to Message 69458.  

Big jump in the number of users reporting WAH2 tasks this morning. Does that mean uploads going through?
ID: 69459 · Report as offensive     Reply Quote
Profileadrianxw
Avatar

Send message
Joined: 31 Aug 04
Posts: 145
Credit: 2,080,724
RAC: 753
Message 69460 - Posted: 10 Aug 2023, 11:03:56 UTC - in response to Message 69459.  

One of the eas units that complete and "stuck" in upload HAS uploaded this morning. The other is still here. I've tried a manual push, but that doesn't change anything. I can well understand that the upload server would be swamped with work though.
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.
ID: 69460 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4541
Credit: 19,039,635
RAC: 18,944
Message 69461 - Posted: 10 Aug 2023, 11:45:18 UTC - in response to Message 69460.  

I can well understand that the upload server would be swamped with work though.


Thanks. pretty sure that is what it is now. number of computers reporting completed work in last 24 hours rose from around 20 to over 50 at one point on server status page and that would be unlikely with just the NZ tasks.
ID: 69461 · Report as offensive     Reply Quote
Profileadrianxw
Avatar

Send message
Joined: 31 Aug 04
Posts: 145
Credit: 2,080,724
RAC: 753
Message 69463 - Posted: 10 Aug 2023, 17:58:39 UTC - in response to Message 69461.  
Last modified: 10 Aug 2023, 18:27:56 UTC

Your reply was a bit of a surprise there... The 20 going up to 50 completed work units per day was a bit of a shock. I would have expected a "massively parallel process" to be returning 20 - 50 or more work units per minute...
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.
ID: 69463 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4541
Credit: 19,039,635
RAC: 18,944
Message 69464 - Posted: 10 Aug 2023, 19:54:27 UTC - in response to Message 69463.  

Your reply was a bit of a surprise there... The 20 going up to 50 completed work units per day was a bit of a shock. I would have expected a "massively parallel process" to be returning 20 - 50 or more work units per minute...
The column actually indicates the number of users who have returned tasks in the past 24 hours. My tasks from the batch all finished before the outage but I could have had twenty or more. Users with64 threads or more could have had over a thousand each. Because the batch was closed stopping resends, a side effect was the page where i could look at actual successes and failures no longer exists or not anywhere I am able to look at it. Otherwise i could have gotten some idea of actual numbers of workunits.
ID: 69464 · Report as offensive     Reply Quote
Profileadrianxw
Avatar

Send message
Joined: 31 Aug 04
Posts: 145
Credit: 2,080,724
RAC: 753
Message 69465 - Posted: 11 Aug 2023, 6:37:28 UTC - in response to Message 69464.  

Ah, fair enough, question of definitions.
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.
ID: 69465 · Report as offensive     Reply Quote
jwaggy

Send message
Joined: 4 Dec 16
Posts: 2
Credit: 2,571,009
RAC: 5,155
Message 69483 - Posted: 17 Aug 2023, 13:57:22 UTC

I had quite a few files upload but I have 3 left that are stuck with a transient HTTP error.
ID: 69483 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 · Next

Questions and Answers : Windows : Upload issue.

©2024 cpdn.org