Hi,
I just saw there is an upload problem with one of my models here:


23-Sep-2011 14:44:34 [climateprediction.net] Started upload of hadcm3n_o28j_1940_40_007447238_2_1.zip
23-Sep-2011 14:44:48 [climateprediction.net] Sending scheduler request: To send trickle-up message.
23-Sep-2011 14:44:48 [climateprediction.net] Requesting new tasks for NVIDIA GPU
23-Sep-2011 14:44:55 [climateprediction.net] Scheduler request completed: got 0 new tasks
23-Sep-2011 14:44:55 [climateprediction.net] No work sent
23-Sep-2011 14:56:59 [climateprediction.net] Error reported by file upload server: invalid signature
23-Sep-2011 14:56:59 [climateprediction.net] Giving up on upload of hadcm3n_o28j_1940_40_007447238_2_1.zip: permanent upload error

It is this WU:
http://climateapps2.oerc.ox.ac.uk/cpdnboinc/result.php?resultid=13391800

Is it lost now?

---

Linux Users Everywhere @ BOINC

Now again, uploaded one sucessfull and next failed.


23-Sep-2011 19:07:19 [climateprediction.net] Started upload of hadcm3n_t1km_1940_40_007447075_1_1.zip
23-Sep-2011 19:19:24 [climateprediction.net] Finished upload of hadcm3n_t1km_1940_40_007447075_1_1.zip
23-Sep-2011 21:41:27 [climateprediction.net] Sending scheduler request: To send trickle-up message.
23-Sep-2011 21:41:27 [climateprediction.net] Requesting new tasks for NVIDIA GPU
23-Sep-2011 21:41:33 [climateprediction.net] Scheduler request completed: got 0 new tasks
23-Sep-2011 21:41:33 [climateprediction.net] No work sent
23-Sep-2011 21:41:48 [climateprediction.net] Started upload of hadcm3n_p3ta_1940_40_007422530_2_1.zip
23-Sep-2011 21:56:06 [climateprediction.net] Error reported by file upload server: invalid signature
23-Sep-2011 21:56:06 [climateprediction.net] Giving up on upload of hadcm3n_p3ta_1940_40_007422530_2_1.zip: permanent upload error

---

Linux Users Everywhere @ BOINC

Did you, by any chance, install one of the test versions of BOINC - v6.13.3 or v6.13.4?

If so, please go back and re-read the INCOMPATIBILITY WARNING FOR UPCOMING 6.13.3 BUILD.

There has been plenty of discussion of the change in upload file signature handling on the associated boinc_alpha mailing list.

I've just had the same message using BOINC 6.10.58. :(

Problem reported.

---

Backups: Here

Did you, by any chance, install one of the test versions of BOINC - v6.13.3 or v6.13.4?

If so, please go back and re-read the INCOMPATIBILITY WARNING FOR UPCOMING 6.13.3 BUILD.

There has been plenty of discussion of the change in upload file signature handling on the associated boinc_alpha mailing list.

Someone told me that too, but I have


Starting BOINC client version 6.12.34 for x86_64-pc-linux-gnu

---

Linux Users Everywhere @ BOINC

Hi,

just reporting my computer

BOINC 6.12.34 for windows_intelx86
Windows 7

21/09/2011 7:56:52 AM | | Starting BOINC client version 6.12.34 for windows_intelx86
21/09/2011 7:56:52 AM | | log flags: file_xfer, sched_ops, task
21/09/2011 7:56:52 AM | | Libraries: libcurl/7.21.6 OpenSSL/1.0.0d zlib/1.2.5
21/09/2011 7:56:52 AM | | Data directory: C:\ProgramData\BOINC
21/09/2011 7:56:52 AM | | Processor: 8 GenuineIntel Intel(R) Xeon(R) CPU
21/09/2011 7:56:52 AM | | Processor: E5507 @ 2.27GHz [Family 6 Model 26 Stepping 5]
21/09/2011 7:56:52 AM | | Processor: 256.00 KB cache
21/09/2011 7:56:52 AM | | Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr
21/09/2011 7:56:52 AM | | Processor features: pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss htt tm
21/09/2011 7:56:52 AM | | Processor features: pni ssse3 cx16 sse4_1 sse4_2 nx lm vmx tm2 dca popcnt pbe
21/09/2011 7:56:52 AM | | OS: Microsoft Windows 7: Ultimate x86 Edition, Service Pack 1, (06.01.7601.00)
21/09/2011 7:56:52 AM | | Memory: 3.25 GB physical, 6.49 GB virtual
21/09/2011 7:56:52 AM | | Disk: 148.24 GB total, 111.42 GB free
21/09/2011 7:56:52 AM | | Local time is UTC -7 hours
<snip>
23/09/2011 11:40:30 AM | climateprediction.net | Sending scheduler request: To send trickle-up message.
23/09/2011 11:40:30 AM | climateprediction.net | Not reporting or requesting tasks
23/09/2011 11:40:35 AM | climateprediction.net | Scheduler request completed
23/09/2011 1:04:28 PM | climateprediction.net | Sending scheduler request: To send trickle-up message.
23/09/2011 1:04:28 PM | climateprediction.net | Not reporting or requesting tasks
23/09/2011 1:04:32 PM | climateprediction.net | Started upload of hadcm3n_o5vp_1900_40_007440440_2_3.zip
23/09/2011 1:04:35 PM | climateprediction.net | Scheduler request completed
23/09/2011 1:06:44 PM | climateprediction.net | Finished upload of hadcm3n_o5vp_1900_40_007440440_2_3.zip
23/09/2011 2:44:56 PM | climateprediction.net | Restarting task hadcm3n_t10p_1940_40_007457067_1 using hadcm3n version 607
23/09/2011 4:20:54 PM | climateprediction.net | Sending scheduler request: To send trickle-up message.
23/09/2011 4:20:54 PM | climateprediction.net | Not reporting or requesting tasks
23/09/2011 4:20:59 PM | climateprediction.net | Scheduler request completed
23/09/2011 4:21:10 PM | climateprediction.net | Started upload of hadcm3n_o5ax_1900_40_007440322_0_3.zip
23/09/2011 4:23:25 PM | climateprediction.net | Finished upload of hadcm3n_o5ax_1900_40_007440322_0_3.zip

<Edit>

Oops sorry :(

I see frrom re reading the first post, that this thread is about:

as the thread title says: invalid signature - Re: - Requesting new tasks

</Edit>

I've just been looking at the task page for the first model that you mentioned, Desti, in your opening post:

http://climateapps2.oerc.ox.ac.uk/cpdnboinc/result.php?resultid=13391800
It's model hadcm3n_o28j_1940_40_007447238_2. We can't yet compare it with what other models in the same workunit are doing because you're ahead of the others.


There's also the following model which crashed after successfully uploading it's 10-year #1 file:
http://climateapps2.oerc.ox.ac.uk/cpdnboinc/result.php?resultid=13358398
This is model hadcm3n_t1km_1940_40_007447075_1. The stderr + shows that it developed a problem:

Model crashed: ATM_DYN : INVALID THETA DETECTED

That means it developed weather that's impossible in the real world. Luckily this causes models to crash. The other computer sharing the WU has Win + Intel whereas you have AMD + Linux. These differences could mean that the other computer's model doesn't develop the exact same weather as yours ie it may not crash.


And here's the other model you mentioned that couldn't upload its first decadal file:
http://climateapps2.oerc.ox.ac.uk/cpdnboinc/result.php?resultid=13392265
That's model hadcm3n_p3ta_1940_40_007422530_2. After trying and failing to upload its file it crashed. Its stderr + messages are very interesting:

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.
Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.
Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.
Model crashed: ATM_DYN : INVALID THETA DETECTED.
Model crashed: ATM_DYN : INVALID THETA DETECTED.
Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.
Model crashed: ATM_DYN : INVALID THETA DETECTED.
Model crashed: ATM_DYN : INVALID THETA DETECTED.
Model crashed: ATM_DYN : INVALID THETA DETECTED.
Model crashed: ATM_DYN : INVALID THETA DETECTED.

That's two different types of impossible weather that developed. The model tries five times to recalculate the impossibility. I've never before seen both types of impossibility develop at the same moment in one model.

The other two models in this WU have crunched way beyond the point where yours crashed. But they haven't got the same CPU type + OS as you so I wouldn't expect identical results.


Desti, I know you crunch a lot. Is this computer by chance overclocked?

---

Cpdn news

One here too. Slightly undervolted and underclocked AMD Linux laptop at 2GHz. I haven't seen any stability problems with it on CPDN for a nearly a year or World Community Grid for four months. I could restart this one from backup if there's any kind of fix.

Fri 23 Sep 2011 01:22:25 PM EDT Starting BOINC client version 6.10.58 for i686-pc-linux-gnu
Fri 23 Sep 2011 01:22:25 PM EDT Config: GUI RPC allowed from:
Fri 23 Sep 2011 01:22:25 PM EDT log flags: file_xfer, sched_ops, task
Fri 23 Sep 2011 01:22:25 PM EDT Libraries: libcurl/7.19.7 OpenSSL/0.9.8k zlib/1.2.3.3 libidn/1.15
Fri 23 Sep 2011 01:22:25 PM EDT Data directory: /var/lib/boinc-client
Fri 23 Sep 2011 01:22:25 PM EDT Processor: 2 AuthenticAMD AMD Turion(tm) 64 X2 Mobile Technology TL-64 [Family 15 Model 104 Stepping 2]
Fri 23 Sep 2011 01:22:25 PM EDT Processor: 512.00 KB cache
Fri 23 Sep 2011 01:22:25 PM EDT Processor features: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow extd_apicid pni cx16 lahf_lm cmp_legacy svm extapic cr8_legacy 3dnowprefetch
Fri 23 Sep 2011 01:22:25 PM EDT OS: Linux: 2.6.32-33-generic-phc
Fri 23 Sep 2011 01:22:25 PM EDT Memory: 1.84 GB physical, 1.84 GB virtual
Fri 23 Sep 2011 01:22:25 PM EDT Disk: 17.37 GB total, 4.67 GB free
Fri 23 Sep 2011 01:22:25 PM EDT Local time is UTC -4 hours
Fri 23 Sep 2011 01:22:25 PM EDT No usable GPUs found
Fri 23 Sep 2011 01:22:25 PM EDT climateprediction.net URL http://climateprediction.net/; Computer ID 1109877; resource share 50
.
.
.
Sat 24 Sep 2011 02:16:36 AM EDT climateprediction.net Starting hadam3p_eu_2sdm_1981_1_007457216_0
Sat 24 Sep 2011 02:16:36 AM EDT climateprediction.net Starting task hadam3p_eu_2sdm_1981_1_007457216_0 using hadam3p_eu version 609
.
.
.
Sun 25 Sep 2011 08:30:00 AM EDT Resuming network activity
Sun 25 Sep 2011 08:30:00 AM EDT climateprediction.net Sending scheduler request: To send trickle-up message.
Sun 25 Sep 2011 08:30:00 AM EDT climateprediction.net Not reporting or requesting tasks
Sun 25 Sep 2011 08:30:01 AM EDT climateprediction.net Started upload of hadam3p_eu_2sdm_1981_1_007457216_0_1.zip
Sun 25 Sep 2011 08:30:04 AM EDT climateprediction.net Scheduler request completed
Sun 25 Sep 2011 08:30:40 AM EDT climateprediction.net [error] Error reported by file upload server: invalid signature
Sun 25 Sep 2011 08:30:40 AM EDT climateprediction.net Giving up on upload of hadam3p_eu_2sdm_1981_1_007457216_0_1.zip: permanent upload error
.
.
.
Mon 26 Sep 2011 12:54:37 AM EDT Resuming network activity
Mon 26 Sep 2011 12:54:37 AM EDT climateprediction.net Sending scheduler request: To send trickle-up message.
Mon 26 Sep 2011 12:54:37 AM EDT climateprediction.net Not reporting or requesting tasks
Mon 26 Sep 2011 12:54:38 AM EDT climateprediction.net Started upload of hadam3p_eu_2sdm_1981_1_007457216_0_2.zip
Mon 26 Sep 2011 12:54:39 AM EDT climateprediction.net Scheduler request completed
Mon 26 Sep 2011 12:55:42 AM EDT climateprediction.net [error] Error reported by file upload server: invalid signature
Mon 26 Sep 2011 12:55:42 AM EDT climateprediction.net Giving up on upload of hadam3p_eu_2sdm_1981_1_007457216_0_2.zip: permanent upload error
Mon 26 Sep 2011 12:55:59 AM EDT Suspending network activity - time of day
Mon 26 Sep 2011 08:30:00 AM EDT Resuming network activity
Mon 26 Sep 2011 08:30:00 AM EDT climateprediction.net Sending scheduler request: To send trickle-up message.
Mon 26 Sep 2011 08:30:00 AM EDT climateprediction.net Not reporting or requesting tasks
Mon 26 Sep 2011 08:30:01 AM EDT climateprediction.net Started upload of hadam3p_eu_2sdm_1981_1_007457216_0_3.zip
Mon 26 Sep 2011 08:30:06 AM EDT climateprediction.net Scheduler request completed
Mon 26 Sep 2011 08:31:12 AM EDT climateprediction.net [error] Error reported by file upload server: invalid signature
Mon 26 Sep 2011 08:31:12 AM EDT climateprediction.net Giving up on upload of hadam3p_eu_2sdm_1981_1_007457216_0_3.zip: permanent upload error

Desti, I know you crunch a lot. Is this computer by chance overclocked?

Hi,

no, the processor is running at it's default clock rate of 3,2 GHz. I upgraded my memory some days ago from 2x2 GiB to 2x4 GiB, but the memory is running at slightly slower specs. than it is tested by the vendor. I had already run a full memtest86 and it showed no errors and the computer is running around the clock without any crashes.

---

Linux Users Everywhere @ BOINC

I aborted my previous task, and now see the same message on another task on the same machine. My other machine is not having this problem, although it's working on one hadam3p which was issued Sept 12. The ones producing the invalid signature messages were sent Sept 21 and 27. Should I abort this one too?

Wed 28 Sep 2011 08:05:42 AM EDT climateprediction.net Started upload of hadam3p_eu_6e15_2001_1_007480198_0_1.zip
Wed 28 Sep 2011 08:05:43 AM EDT climateprediction.net Scheduler request completed
Wed 28 Sep 2011 08:09:02 AM EDT climateprediction.net [error] Error reported by file upload server: invalid signature
Wed 28 Sep 2011 08:09:02 AM EDT climateprediction.net Giving up on upload of hadam3p_eu_6e15_2001_1_007480198_0_1.zip: permanent upload error

We're still waiting for the project people to work out what is wrong, and whether or not it can be fixed.

If you can, please wait a little longer before aborting.

---

Backups: Here

Hi,

This issue should be solved now for hadam3p_eu workunits. Let us know if you have any more issues with this.

Regards,

Andy

'salright! Thanks.

<quote from News & Announcements>
Some model files have recently failed to upload when the CPDN upload server rejected them because of an invalid signature. This has happened since Boinc changed the procedure regarding the way files are (or are not) signed. CPDN complied with the requested change but did not realise at first that the change applies to every upload server.

All files from all model types should now be accepted by all the upload servers.
<unquote>

What is the effect on results from models which have already experienced upload rejections? Does this mean that results from the relevant models will be invalid because of missing sets of uploads or will the missing data be supplied in later uploads? If the missing data makes the model results invalid, I guess we would be better off aborting those models and starting new ones.

---

While a missing zip file does mean less data, the trickle_up files also contain data which can fill in part of the gap.

I'm continuing to run mine, but other people may have different ideas about using their computer time and electricity.

---

Backups: Here

Thanks, Les. I'll keep going too.