Naked Science Forum

Life Sciences => The Environment => Topic started by: incolour on 20/11/2009 23:40:45

Title: What's the story about the University of East Anglia's emails being hacked?
Post by: incolour on 20/11/2009 23:40:45
I've been following these forums for ages... kind of surprised no one has mentioned this yet!

We should of course be fairly careful about reading too much into this, but it's still pretty bad conduct by the sounds of things.

http://news.bbc.co.uk/1/hi/sci/tech/8370282.stm

(Apologies this is a lunatic site, but the emails on it are actually real and in the .zip... it's just the only place i could find with good examples in one place!)

http://www.freerepublic.com/focus/f-news/2390911/posts

http://www.megaupload.com/?d=75J4XO4T the entire .zip is here. 

I know it doesn't change much, but it's still quite interesting. There's also a lot of data which i guess will be looked at eventually... I can't even work out how to open it!

Have a gander... 
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: litespeed on 21/11/2009 01:38:46
incolour - you wrote: "I can't even work out how to open it!"  That is a reasonable indication you should not open it.......
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: incolour on 21/11/2009 14:04:49
Oh no, i don't mean the .zip of course. In the 'data' folder there's a load of files with weird extensions, is all. And why?
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: frethack on 21/11/2009 16:21:44
Ive been waiting to see if this can be proven absolutely true or if it is a hoax.  Some of the emails are innocuous, and some are criminal.  So far, all I know to be confirmed is that there were files stolen.  If these truly are the ones that were taken, there will need to be investigations.

One of my former professors is associated with the Michael Mann/Gavin Schmidt circle, and have a REAL dislike for Steve McKitrick and Steve McIntyre at ClimateAudit.org (the target of the "crap criticisms from the idiots in the near future" comment).  They arent climatologists, but statisticians, and were the two that showed the hockey stick graph to be untrue by reworking the statistics of Mann's data.

A very interesting time to be alive...science and politics dont mix.
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: LeeE on 21/11/2009 17:01:56
Yeah frethack, there does seem to be a good deal of controversy about that hockey stick graph regarding what data was included in it, and what was not.
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: litespeed on 24/11/2009 20:22:04
Environmental Science Fraud

Gee. WHO would'a thought a SCIENTIST would cook the books. I got an early leason on this WAY back in the 1970's. I was a junior member of a large team of Congressional Investigators tasked to study what policy the US should take regarding conversion to the Metric System.  Two things:

First, everyone assigned to the study initially believed it would be a good idea, but within two weeks of actual study changed their minds. Second, I personally was responsible for 'vetting' a questionare on the subject. We developed a questionaire based on our experiences, and showed it to various 'stake holders' for comment.

One of the questions was simple enough. "If the US considers a switch to the Metric System, how long should be the transition phase: 1) five years 2) ten years 3) fifteen years, 4) never.  The Bureau of Weights and Measures 'scientist' I interviewed flat-out said "Do not even include a choice of never."
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: litespeed on 24/11/2009 20:29:16
Lee

I think the whole hocky-stick thing never really caught on with anyone who had any actual access to historical data.  I believe [but have not researched] the hocky stick people were a bit on the 'evangelical' side of the arguement.  In Hollywood terms they short of 'jumped the shark'.  This means they just overreached to the point of looking stupid.
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: litespeed on 24/11/2009 20:46:54
The Metric System - Just For Giggles

The US has something like forty or fifty thousand miles of Interstate Highways, all of which have markers every 1/10th of a mile, with exit and other signs denominating miles. For instance, typically each exit includes two or three signs that include 'Exit 1 Mile; Exit 1/2 Mile; etc.

These signs are very ruggedly constructed and installed to withstand high winds etc. and are not cheap. So. If you convert to the Metric System you have a choice. First, you look really stupid by replacing 'Exit One Mile' with "Exit 1.6 Kilometers".  Or you move the stupid sign....IMHO either one looks as stupid as the other.

But now I am into my third Milwaukees Best Ice and can not restrain myself regarding Metric System. [I accept I am out of order, but its a lot of fun].  I was responsible for examining the construction industry.  One of the peculiar things I found was the Brick Manufacturers were WAY in favor of conversion, while Cement Block Manufacturers were possitively appoplectic against it.

SOLUTION: Bricks are extruded to any size your little heart desires. Cement blocks are made using forms that are good for 50,000 cement blocks each. So. The brick people saw an opportunity to really stick it to the cement block guys. The cement block guys said the government should compensate them for the capital cost of new forms.  You get the overall picture.  Multiply this by one gallon paint v. four liters, v. five liters etc ad infinitum.

The nation ended up doing the right thing: stay the hell away from that particular tar baby.
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: frethack on 24/11/2009 21:25:31
The Metric System - Just For Giggles

The US has something like forty or fifty thousand miles of Interstate Highways, all of which have markers every 1/10th of a mile, with exit and other signs denominating miles. For instance, typically each exit includes two or three signs that include 'Exit 1 Mile; Exit 1/2 Mile; etc.

These signs are very ruggedly constructed and installed to withstand high winds etc. and are not cheap. So. If you convert to the Metric System you have a choice. First, you look really stupid by replacing 'Exit One Mile' with "Exit 1.6 Kilometers".  Or you move the stupid sign....

IMHO either one looks as stupid as the other.

I would have to agree with you that it would take a prohibitive amount of money to convert all of the signs (and it would have to be done twice...once with both systems until people learn to use the metric system...and again once the full conversion is done (I suppose this step is not as necessary).

IMHO though, the standard system of measure is substandard when compared to intuitiveness of the metric system.  Metric makes science and simple conversions sooooooooooooo much easier.
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: litespeed on 24/11/2009 21:41:03
fret - Just for giggles, I really want to share this with you.  Why do some construction people prefer english to metric?  Metric does not divide as well. For instance, a yard has specifically three feet. Each foot is divisible by two, three, and four and six. It really not that big a deal. However, a standard 4x8 foot piece of plywood might be a bit easier to manage then its metric equivalent.

The bigger issue is all the installed infastructure that is based on yards, feet and inches.  It seems sensless to actually change sizes to evenly match metric. And simply substituting the decimal equivalent of four feet into centimeters is an exercise in maddness. Believe me.  We actually argued whether meter should be spelled metre.

Title: What's the story about the University of East Anglia's emails being hacked?
Post by: litespeed on 24/11/2009 21:45:45
Fret - Being well into my cups, I offer the following [admittedly streatched] observations on TEMPERATURE.  Zero degrees F is cold, and 100 degrees F is hot. Centegrade (Celcius My Hairy Butt) just does not measure up, IMHO.  [:D]

Besides, a proper Centegrade would ACTUALLY be Kelvin.
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: frethack on 24/11/2009 22:26:30
I can certainly understand the unfeasability of changing national infrastructure, and I never really had thought of standard vs. metric in the construction field...and I used to work in that field for a short while in my 20's.

For my purposes metric is great, but I wouldnt want to spend the time/money to change it for everyone else :)
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: FuzzyUK on 01/12/2009 23:24:04
Phil Jones steps down:
http://www.ajc.com/news/nation-world/uk-climate-scientist-to-221080.html

"The chief of a prestigious British research center caught in a storm of controversy over claims that he and others suppressed data about climate change has stepped down pending an investigation, the University of East Anglia said Tuesday."
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: LeeE on 02/12/2009 04:10:13
Phil Jones steps down:
http://www.ajc.com/news/nation-world/uk-climate-scientist-to-221080.html

"The chief of a prestigious British research center caught in a storm of controversy over claims that he and others suppressed data about climate change has stepped down pending an investigation, the University of East Anglia said Tuesday."

Well, how about that!
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: charlesmojica on 02/12/2009 06:15:06
that's bad...
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: LeeE on 02/12/2009 18:18:30
that's bad...

I have to disagree.  There are very serious questions that need to be answered regarding the way that data was included, or excluded, from the work they were doing, allegedly it seems, at the specific orders of the head of the CRU.

It is claimed that the head of the CRU, along with associates, decided to try to hide data and suppress dissent, which was never going to work; security through obscurity never does.  If the claims are found to be true then all that the head of the CRU has achieved by adopting this fundamentally flawed approach is to invalidate all of the work they have done and it will all need to be redone by truly independent researchers, who are accepted to be independent by everyone (another claim is that much of the peer review of the CRU's work may have been rather incestuous).

There is no going forward until this mess has been sorted out.

I must make it clear however, that this issue remains to be investigated; nothing has yet been proved.  However, the 'evidence' so far strongly indicates that an investigation is required.  Under the current particular circumstances it is impossible for the head of the CRU to remain in post while this investigation takes place.
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: BenV on 03/12/2009 13:21:46
While it's still available, I suggest people have a look at Nature's editorial on the subject:  http://www.nature.com/nature/journal/v462/n7273/full/462545a.html

It'll go off behind a paywall soon though, I suspect.
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: litespeed on 19/12/2009 23:18:02
BenV

I reviewed the "Nature" response to the East Anglia Mess.  They write: "It is Nature's policy to investigate such matters if there are substantive reasons for concern, but nothing we have seen so far in the e-mails qualifies."  Deleting climate data prior to audit, encouraging named others to do the same and confirming yet others that have already agreed does not rise to so much as even a Koffee Clache.

What fascinates me is their deliberate, repetitive, and prominent use of the word "Heretic" OOPS. I mean the word Denialists and oddly, for a scientific journal, they seem obsessed with the term Republican. You might as well substitute "Copernican". Pope Urban what's-his-number would be proud.
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: chris on 20/12/2009 00:04:08
Here's a copy of that Nature editorial:

Nature 462, 545 (3 December 2009) | doi:10.1038/462545a; Published online 2 December 2009
(http://www.nature.com/nature/journal/v462/n7273/full/462545a.html)

Climatologists under pressure

Stolen e-mails have revealed no scientific conspiracy, but do highlight ways in which climate researchers could be better supported in the face of public scrutiny.

The e-mail archives stolen last month from the Climatic Research Unit at the University of East Anglia (UEA), UK, have been greeted by the climate-change-denialist fringe as a propaganda windfall (see page 551). To these denialists, the scientists' scathing remarks about certain controversial palaeoclimate reconstructions qualify as the proverbial 'smoking gun': proof that mainstream climate researchers have systematically conspired to suppress evidence contradicting their doctrine that humans are warming the globe.

This paranoid interpretation would be laughable were it not for the fact that obstructionist politicians in the US Senate will probably use it next year as an excuse to stiffen their opposition to the country's much needed climate bill. Nothing in the e-mails undermines the scientific case that global warming is real — or that human activities are almost certainly the cause. That case is supported by multiple, robust lines of evidence, including several that are completely independent of the climate reconstructions debated in the e-mails.

First, Earth's cryosphere is changing as one would expect in a warming climate. These changes include glacier retreat, thinning and areal reduction of Arctic sea ice, reductions in permafrost and accelerated loss of mass from the Greenland and Antarctic ice sheets. Second, the global sea level is rising. The rise is caused in part by water pouring in from melting glaciers and ice sheets, but also by thermal expansion as the oceans warm. Third, decades of biological data on blooming dates and the like suggest that spring is arriving earlier each year.

Denialists often maintain that these changes are just a symptom of natural climate variability. But when climate modellers test this assertion by running their simulations with greenhouse gases such as carbon dioxide held fixed, the results bear little resemblance to the observed warming. The strong implication is that increased greenhouse-gas emissions have played an important part in recent warming, meaning that curbing the world's voracious appetite for carbon is essential (see pages 568 and 570).

Mail trail
A fair reading of the e-mails reveals nothing to support the denialists' conspiracy theories. In one of the more controversial exchanges, UEA scientists sharply criticized the quality of two papers that question the uniqueness of recent global warming (S. McIntyre and R. McKitrick Energy Environ. 14, 751–771; 2003 and W. Soon and S. Baliunas Clim. Res. 23, 89–110; 2003) and vowed to keep at least the first paper out of the upcoming Fourth Assessment Report of the Intergovernmental Panel on Climate Change (IPCC). Whatever the e-mail authors may have said to one another in (supposed) privacy, however, what matters is how they acted. And the fact is that, in the end, neither they nor the IPCC suppressed anything: when the assessment report was published in 2007 it referenced and discussed both papers.

If there are benefits to the e-mail theft, one is to highlight yet again the harassment that denialists inflict on some climate-change researchers, often in the form of endless, time-consuming demands for information under the US and UK Freedom of Information Acts. Governments and institutions need to provide tangible assistance for researchers facing such a burden.

The theft highlights the harassment that denialists inflict on some climate-change researchers.
The e-mail theft also highlights how difficult it can be for climate researchers to follow the canons of scientific openness, which require them to make public the data on which they base their conclusions. This is best done via open online archives, such as the ones maintained by the IPCC (http://www.ipcc-data.org) and the US National Climatic Data Center (http://www.ncdc.noaa.gov/oa/ncdc.html).

Tricky business
But for much crucial information the reality is very different. Researchers are barred from publicly releasing meteorological data from many countries owing to contractual restrictions. Moreover, in countries such as Germany, France and the United Kingdom, the national meteorological services will provide data sets only when researchers specifically request them, and only after a significant delay. The lack of standard formats can also make it hard to compare and integrate data from different sources. Every aspect of this situation needs to change: if the current episode does not spur meteorological services to improve researchers' ease of access, governments should force them to do so.

The stolen e-mails have prompted queries about whether Nature will investigate some of the researchers' own papers. One e-mail talked of displaying the data using a 'trick' — slang for a clever (and legitimate) technique, but a word that denialists have used to accuse the researchers of fabricating their results. It is Nature's policy to investigate such matters if there are substantive reasons for concern, but nothing we have seen so far in the e-mails qualifies.

The UEA responded too slowly to the eruption of coverage in the media, but deserves credit for now being publicly supportive of the integrity of its scientists while also holding an independent investigation of its researchers' compliance with Britain's freedom of information requirements (see http://go.nature.com/zRBXRP).

In the end, what the UEA e-mails really show is that scientists are human beings — and that unrelenting opposition to their work can goad them to the limits of tolerance, and tempt them to act in ways that undermine scientific values. Yet it is precisely in such circumstances that researchers should strive to act and communicate professionally, and make their data and methods available to others, lest they provide their worst critics with ammunition. After all, the pressures the UEA e-mailers experienced may be nothing compared with what will emerge as the United States debates a climate bill next year, and denialists use every means at their disposal to undermine trust in scientists and science.
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: litespeed on 20/12/2009 16:42:17
"Stolen e-mails have revealed no scientific conspiracy...Nature's policy to investigate such matters if there are substantive reasons for concern, but nothing we have seen so far in the e-mails qualifies."

Deleted data specifically prior to audit, encouraging other named individuals to do the same while also identifying those that have already agreed? And then there is the inconvenient truth the 'ringleader' resigned his high position for SOME reason. The publication Nature seems to have a denialist problem of its own.
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: BenV on 20/12/2009 17:24:17
And then there is the inconvenient truth the 'ringleader' resigned his high position for SOME reason. The publication Nature seems to have a denialist problem of its own.
It's only right and proper that he stand down during the investigation - using this to claim something is amiss is a bit desperate.
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: litespeed on 20/12/2009 17:41:57
benV

The guy was, to all appearances, caught red handed leading an actual conspiracy to delete publicly owned data for the specific purpose of contaminating an upcoming audit. I await the 'results' of East Anglia's 'investigation', since Nature finds nothing even suspicious to bother with. How Nature expects their open and complete denial to benefit their cause escapes me entirely.

If there is anything desperate in the air it eminates from the foul Nature response that amounts to screaming THEFT THEFT THEFT, THE DENIERS DID IT, THE DENIERS DID IT! I experienced actual repulsion reading their angry and disengenuous tripe. In particular, they entirely ignore the conspiracy to delete data, and change the subject to other data issues entirely.

The entire paper simply drips with hatred and smear tactics and name calling. It disqusts me that "Science" has fallen to this Junior High School level that is not much more then "Your Mom Wears Combat Boots", but without the humor. But I am glad they wrote it. It reveals both the intellectual and moral depravity that has mestastisized and helps us understand the discussion in that way.

PS: I watched with dismay a similar progression in Scientific American that I have read and subscribe to since the 1960's. Over the years they began more and more to publish political editorial positions that seemed to me to have nothing to do with science but everything to do to ingratiate themselves to various leftist causes. I finally told them to cancel my subscription and keep the money.

It was downright icky, so Orwellian Right Think it made my skin crawl. Thank heavens for the internet. I can get all I need on Bell's Theorem, bubble universes and the higgs boson without the mediation of the scientific priesthood.  I feel like Martin Luther.
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: profound on 09/02/2010 15:01:57
The Great Global Warming Swindle has finally been exposed folks and it is a shocking revalation as to when a collection or group of so called scientists get together to defraud the world and impose their horrible lies and falsehood religion on a unsuspecting and unquestioning etablishmentand ordinary folk are made to suffer their lies.


I spent a week reading the "Climategate’s Climategate’s “Harry Read Me” File is a Must Read!" at
 http://www.floppingaces.net/2009/11/30/climategates-harry-read-me-file-is-a-must-read/


and , and and Oh My God have I ever read such a shoddy and ramshackle ad hoc collection of absolute haphazard collection of corrupt data to support their false god of global warming.

I urge everyone to save this on to their pc and read it intently.

Here is a small sample:-

- “It’s botch after botch after botch.” (18)

- “The biggest immediate problem was the loss of an hour’s edits to the program, when the network died … no explanation from anyone, I hope it’s not a return to last year’s troubles … This surely is the worst project I’ve ever attempted. Eeeek.” (31)

- “Oh, GOD, if I could start this project again and actually argue the case for junking the inherited program suite.” (37)

- “… this should all have been rewritten from scratch a year ago!” (45)

- “Am I the first person to attempt to get the CRU databases in working order?!!” (47)

- “As far as I can see, this renders the (weather) station counts totally meaningless.” (57)

- “COBAR AIRPORT AWS (data from an Australian weather station) cannot start in 1962, it didn’t open until 1993!” (71)

- “What the hell is supposed to happen here? Oh yeah — there is no ’supposed,’ I can make it up. So I have : – )” (98)...

and on and on....

The amount of stupidity in this small sample file demonstrated by scientists is just shocking.

Like a collection of laid back fat school boys to obese to do any actual work they
sit back on their pc twiddling data which they don't understand in file formats which they have not a clue about and wily nily adjusting the data to match a predetermined agenda.

They should all be prosecuted for fraud and made to pay all the money wasted on funding them and their fake worthless studies.


here is the whole file:-



http://camirror.wordpress.com/2009/11/23/the-harry-read_me-file/

---------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
another small sample of the ad-hoc fudges:-

#

; PLOTS ‘ALL’ REGION MXD timeseries from age banded and from hugershoff
; standardised datasets.
; Reads Harry’s regional timeseries and outputs the 1600-1992 portion
; with missing values set appropriately. Uses mxd, and just the
; “all band” timeseries
;****** APPLIES A VERY ARTIFICIAL CORRECTION FOR DECLINE*********
;
yrloc=[1400,findgen(19)*5.+1904]

[[[ this creates 20 consequtive 5 year subsets (possibly averaged) of the tree ring data by date starting in year 1904 ]]]

valadj=[0.,0.,0.,0.,0.,-0.1,-0.25,-0.3,0.,-0.1,0.3,0.8,1.2,1.7,2.5,2.6,2.6,
2.6,2.6,2.6]*0.75 ; fudge factor

[[[ these are the 20 different "fudge factor(s)"-the programmer's words not mine - to be applied to the 20 different subsets of data, so here are those fudge factors with the corresponding years for the 20 consequtive 5 year periods:

Year Fudge Factor
1904 0
1909 0
1914 0
1919 0
1924 0
1929 -0.1
1934 -0.25
1939 -0.3
1944 0
1949 -0.1
1954 0.3
1959 0.8
1964 1.2
1969 1.7
1974 2.5
1979 2.6
1984 2.6
1989 2.6
1994 2.6
1999 2.6

a little further down the program adjusts the 20 datasets with the corresponding fudge factors: ]]]

;
; APPLY ARTIFICIAL CORRECTION
;
yearlyadj=interpol(valadj,yrloc,x)
densall=densall+yearlyadj

[[[ So, we leave the data alone from 1904-1928, adjust downward a bit for 1929-1943 (different bits), leave the same for 1944-1948, adjust down a little more for 1949-1953, and then, whoa, start an exponential fudge upward (guess that would be the “VERY ARTIFICIAL CORRECTION FOR DECLINE” noted by the programmer). Might this result in data which don’t show the desired trend or god forbid show a global temperature “DECLINE” after “VERY ARTIFICIAL CORRECTION” turn into a hockey schtick – I mean stick ? and “HIDE THE DECLINE”? You bet it would!
#

2009 November 25


Ian permalink



you call that science?
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: BenV on 09/02/2010 15:17:19
We've discussed this elsewhere.  I'll merge this post in with the previous thread.
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: LeeE on 09/02/2010 21:24:31
Climate Change Denialists (CCDs) annoy me just as much as Climate Change Evangelists (CCEs).  That apparent errors have been found in the arguments of the CCEs doesn't prove the arguments of the CCDs.

However, it certainly does mean that just about all of the work done on climate change now needs to be re-done, pretty much from scratch, before we really know what's going on.
Title: What's the story about the University of East Anglia's emails being hacked?
Post by: yor_on on 10/02/2010 04:18:04
As I understood it they got access to a backup server. It all depends on if they have used that backup or not. If they haven't had any need for it then the main server should be non-compromised, and also be able to use to compare if data has been changed. I hope it is that it haven't been compromised. Otherwise I don't hold to anyone manipulating something as important as the climate and what data we collect on that. So there will certainly be an investigation, but what I found really bad was the way researchers seems to be treated.

---Quote-
Researchers are barred from publicly releasing meteorological data from many countries owing to contractual restrictions. Moreover, in countries such as Germany, France and the United Kingdom, the national meteorological services will provide data sets only when researchers specifically request them, and only after a significant delay. The lack of standard formats can also make it hard to compare and integrate data from different sources. Every aspect of this situation needs to change: if the current episode does not spur meteorological services to improve researchers' ease of access, governments should force them to do so.
---End of quote--

That seems just plain stupid to me.