16 Jun 2008: Report

The Limits of Climate Modeling

As the public seeks answers about the future impacts of climate change, some climatologists are growing increasingly uneasy about the localized predictions they are being asked to make.

by fred pearce

Now that the world largely accepts our climate is changing, and that humans are to blame, we all want to know what the future holds for our own backyard. How bad will it get? Flood or drought? Feast or famine? Super-hurricane or Mediterranean balm?

The statisticians and climatologists who brought us the big picture are now under huge pressure to get local. But they are growing increasingly concerned about whether their existing models and computers are up to the job. They organized a summit in Reading, England, in May to discuss their concerns. As Brian Hoskins of Reading University, one of the British government’s top climate advisers, put it: “We’ve worked out the global scale. But that’s the easy problem. We don’t yet understand the smaller scale. The pressure is on for answers, and we can’t wait around for decades.”

Already, policymakers are starting to take at face value model predictions of — to take a few examples — warming of 18 degrees Fahrenheit (7.8 degrees Celsius) or more in Alaska, and super-droughts in the southwestern United States, but little warming at all in central states.

But is the task doable? Some climate modelers say that even with the extraordinary supercomputing power now available, the answer is no. That, by being lured into offering local forecasts for decades ahead, they are setting themselves up for a fall that could undermine the credibility of the climate models.

Lenny Smith, an American statistician now working on climate modeling at the London School of Economics in the United Kingdom, is fearful. “Our models are being over-interpreted and misinterpreted,” he says. “They are getting better; I don't want to trash them. But policy-makers think we know much more than we actually know. We need to drop the pretense that they are nearly perfect.”

There are two areas of concern. First, how accurate are the global models at mimicking atmospheric processes? And second, are they capable of zooming in on particular areas to give reliable pictures of the future where you live?

Nobody much doubts that greenhouse gases like carbon dioxide accumulating in the atmosphere will cause warming. It would be a contradiction of 200 years of physics if they did not. But exactly how much warming will occur — and how it will be distributed across the globe and impact other climatic features like rainfall — depends on feedbacks in the climate system, the oceans, and the natural carbon cycle. The influence of some of these feedbacks is much less clear.

One big issue is the influence of clouds. The models are pretty hopeless at predicting future cloud cover. And we can’t even be sure whether, overall, extra clouds would warm or cool the planet. (Clouds may cool us in the day, but will usually keep us warm at night.) In the language of Donald Rumsfeld, we would call this problem a “known unknown.”

And there may also be “unknown unknowns.” For instance, a paper in Earth and Planetary Science Letters in March reported finding fossilized ferns in central Siberia that suggest that in the late Cretaceous era, temperatures there were like modern-day Florida. Yet current climate models predict that the area should have had average temperatures around zero Celsius. The British climate modeler involved in the study, Paul Valdes of Bristol University, says this snapshot from the era of the dinosaurs could mean that “the internal physics of our climate models are wrong.” That the models may also be drastically underestimating likely warming in the 21st century.

This uncertainty at the heart of the models seems surprising when the predictions of most global climate models seem to be in agreement. For more than a decade they have estimated that a doubling of carbon dioxide in the air will warm the world by between 1.5 and 4.5 degrees Celsius.

Some experts think the consensus of the models is bogus. “The modelers tend to tweak them to align them. The process is very incestuous,” one leading British analyst on uncertainty in models told me.

Another, Jerry Ravetz, fellow at Oxford University’s James Martin Institute for Science and Civilisation, says: “The modelers are trained to be very myopic, and not to understand the uncertainty within their models. They become very skilled at solving the little problems and ignoring the big ones.”

These are serious charges. But the custodians of the big models say this is really a communications problem between them and the outside world. Gavin Schmidt of NASA’s Goddard Institute for Space Studies, which runs one of the world’s top climate models, says modelers themselves have a “tacit knowledge” of the uncertainties inherent in their work. But this knowledge rarely surfaces in public discussions, resulting in “an aura of exactitude that can be misleading.”

Steve Rayner, director of the James Martin Institute, says, “What climate models do well is give a broad picture. What they are absolutely lousy at is giving specific forecasts for particular places or times.” And yet that is what modelers are increasingly doing.

At a meeting at Cambridge University in Britain last summer, Larry Smith singled out for criticism the British government's Met Office Hadley Centre for Climate Prediction and Research, which runs another of the world’s premier climate models. He accuses the Centre of making detailed climate projections for regions of Britain, when global climate models disagree strongly about how climate change will affect the islands.

James Murphy, Hadley’s head of climate prediction, says: “I find it far-fetched that a planner is going to rush off with a climate scientist’s probability distribution and make an erroneous decision because they assumed they could trust some percentile of the distribution to its second decimal point.”

But some say the Hadley Centre invites just such a response in some of its leaflets. One of its reports, “New Science for Managing Climate Risks,” distributed to policymakers at the Bali climate conference last December, included “climate model predictions” forecasting that by 2030 the River Orinoco’s flow will have declined by 18.7 percent, the Zambezi by 34.9 percent, and the Amazon by 13.4 percent.

Many in the modeling community are growing wary of such spurious certainty. Last year, a panel on climate modeling assembled by the UN’s World Climate Research Program under the chairmanship of Jagadish Shukla of the George Mason University at Calverton, Maryland, concluded that current models “have serious limitations in simulating regional features, for example rainfall, mid-latitude storms, organized tropical convection, ocean mixing, and ecosystem dynamics.”

Regional projections, the panel said, “are sufficiently uncertain to compromise the goal of providing society with reliable predictions of regional climate change.” Many of the predictions were “laughable,” according to the panel. Concern is greatest about predicting climate in the tropics, including hurricane formation. This seriously undermines the credence that can be placed on a headline-grabbing prediction in May that the future might see fewer Atlantic hurricanes (albeit sometimes more intense).

This might not matter too much if politicians and policymakers had a healthily skeptical view of climate models. But most do not, a meeting of modelers held in Oxford heard in February. Policymakers often hide behind models and modelers, using them to claim scientific probity for their actions. One speaker likened modern climate modelers to the ancient oracles. “They are part of the tradition of goats’ entrails and tea leaves. They are a way of objectifying advice, cloaking sensible ideas in a false aura of scientific certainty.”

We saw that when European governments at the recent Bali climate conference cited the UN’s Intergovernmental Panel on Climate Change as reporting that keeping carbon dioxide concentrations in the atmosphere below 450 parts per million would prevent warming above 2 degrees Celsius. And that that was a “safe” level of warming. Neither statement is in any IPCC reports, and its scientists have repeatedly stated that what might be regarded as a safe degree of warming is ultimately a political and not a scientific question.

None of this should be taken to suggest either that climate models are not valuable tools, or that they are exaggerating the significance of man-made climate change. In fact, they may well inadvertently be under-estimating the pace of change. Most models suggest that climate change in the coming decades will be gradual — a smooth line on a graph. But our growing knowledge of the history of natural climate change suggests that change often happens in sudden leaps.

For instance, there was a huge step-change in the world’s climate 4,200 years ago. Catastrophic droughts simultaneously shattered human societies across the Middle East, India, China, and the interior of North America. “Models have great difficulty in predicting such sudden events, and in explaining them,” says Euan Nisbet of Royal Holloway, the University of London. “But geology tells us that catastrophe has happened in the past, and is likely to happen again.”

As Pasky Pascual of the U.S. Environmental Protection Agency put it at the Oxford meeting: “All models are wrong; some are wronger.” But they are our best handle on likely climate change in the coming decades.

Acting on the findings of Shukla’s panel, modelers from around the world met at the summit in Reading in May to “prepare a blueprint to launch a revolution in climate prediction.” They said that to meet the demands for reliable local forecasts they needed more than a thousand times more computing power than they currently have, and called for the establishment of a new billion-dollar global climate modeling center, a “Manhattan Project for climate,” to deliver the goods.

POSTED ON 16 Jun 2008 IN Biodiversity Climate Science & Technology Asia Europe North America 


I would hope that uncertainty is no longer used as an excuse for inaction.

Posted by Richad Pauli on 16 Jun 2008

For more of the discussion from which some of the quotes in this article were taken, see "The Uncertainty in Climate Modeling" with Gavin Schmidt, Lenny Smith, James Murphy and Claudia Tebaldi at
Posted by Bulletin of the Atomic Scientists on 17 Jun 2008

Nature has managed through large and sudden
climate changes many times. We should adapt.
Anyway, the difference this time is that there are
too many of us. POGO was right: we have seen
the enemy, and it is us.
Posted by Lucian B. Platt, PhD Geologist on 23 Jun 2008

As a global warming skeptic (some would say
"denier") and long time sponsor and user of
computer modeling, I found this article
surprisingly clear and candid. Not candid enough
about the limits of modeling, and especially the
limits when our data series are so error prone
and our causal knowledge so primitive, but
close. Kudos!

I especially applaud the emphasis on the vacuity
of regional projections. Of course, this hardly
suffices to silence the barrage of witch doctor
reports we read on coming droughts, floods,
plagues, and other scourges. It must have been
a terrible bad weather time when the dinosaurs
roamed the arctic. Again, congratulations on
getting off to a fine start toward objective
analysis of these issues.
Posted by Walton Francis on 23 Jun 2008

Not to belabor the point, but on the very same home page
of Environment 360 as Fred Pearce's fine article appears the
following witch doctor regional projection: "20 JUN 2008:
REPORT SAYS A government report, synthesizing more than
100 academic papers, forecasts that as the world warms,
the United States will be subject to prolonged droughts, heat
waves and more frequent downpours like the recent ones
that have left much of the Midwest under water. Issued by
the U.S. Climate Science Program, the report forecasts that
by mid-century, heat waves that now occur once every 20
years will take place once every three years." Perhaps you
might want to comment on the irony!
Posted by Walton Francis on 23 Jun 2008

I would highly recommend the roundtable at the bulletin of atomic scientists posted in the comments above. It is much less cynical, for one thing, touting models' advantages and disadvantages. I think this article didn't do enough to address the first poster's concerns, namely, that uncertainty not be used as an excuse for inaction. The roundtable at the Bulletin is a far better discussion.
Posted by arg11 on 04 Jul 2008

"I would hope that uncertainty is no longer used as an excuse for inaction."

This logic is ridiculous. It is akin to me getting out of my car every 2 miles and checking that my tires haven't exploded just because I heard a rumor that cars with tires have been proven to explode from time to time.

It is called OCD and I do not agree that the world should give into this compulsion.

The earth could be in far greater danger of being smacked by an asteroid, and yet we are spending billions of dollars to stop something we are not even sure we caused. Amazing! We know that asteroids have hit the earth.
Posted by Barry on 22 Sep 2008

The models maybe telling us the wrong thing but "that is no excuse for inaction"!!!
Also,"this snapshot from the era of the dinosaurs could mean that “the internal physics of our climate models are wrong.” That the models may also be drastically underestimating likely warming in the 21st century."
If the physics are wrong, how can you conclude anything esp. that the models may be "drastically underestimating". They could be drastically off in any direction, even those opposite current canon.
In sum, the data may be wrong and the physics may be wrong but the models somehow confirm current canon.
I'm not being snide. This stuff is being used to justify trillions of dollars in government spending, costs of regulation, etc. "Doing something" based on bad data usually makes things worse.

Posted by Paul Cubbage on 21 Feb 2009

Well, about modeling... computers are not gods... just machines making calculations (however complicated, elaborated and fast as they may be) based on the data they are fed with! You just need 1 bit of data missing or to be wrong and all the modeling scenario may be totally wrong or the opposite. And there are so many unknown unknowns and unforeseeable events/variables we can't feed computers with, that there are serious risks of totally missing the reality and have to face the opposite of what we were getting ready for.

I'm not saying we have to stop this but we need a different approach on how it is done and how we interpret it.

In aviation any pilots know that any forecast of more than 72h hours is pretty much totally unreliable, and that even forecast delivered 10 hours before final destination can't be taken for granted and need constant updates. every year many flights face problems for unexpected weather conditions in-flight or landing. How do you pretend to say that in 30 years time a river will be 13.7 percent below it's current level?

And don't forget that even this massive research with all it's conferences, flights, printed documents, supercomputer energy consumption has its own environment costs... so we need to have it properly scoped.

Then there are politics... but for this very reason we must recognize the limits of climate modeling and measure our defensive action accordingly. Otherwise we are just taking a bet.
Posted by pete on 03 May 2009

Models are an essential tool for understanding and predicting natural and human-caused changes in Earth's climate.

Modeling climate help to estimate the effects of increasing greenhouse gases on future global climate.

Posted by Elen on 26 Dec 2009

Comments have been closed on this feature.
Fred Pearce is a freelance author and journalist based in the UK. He is environment consultant for New Scientist magazine and author of recent books When The Rivers Run Dry and With Speed and Violence (Beacon Press). His next, Confessions of an Eco Sinner, will be published in the fall. Pearce has also written for Yale e360 on defusing the population bomb and how water consumption is driving food shortages.



Will Paris Conference Finally
Achieve Real Action on Climate?

The emission pledges from the world’s nations still fall short of the goal for limiting global warming. But as negotiators convene in Paris this week, there is cautious optimism that a significant international agreement on climate can be reached.

Why Brazil’s New Pledges On
Carbon Emissions Fall Short

Brazil has won international acclaim for curbing deforestation. But Brazilian forestry expert Maria Fernanda Gebara says her country has not gone far enough in its pledges to cut carbon emissions and continues to have a dismal record on developing wind and solar power.

On Thin Ice: Big Northern Lakes
Are Being Rapidly Transformed

As temperatures rise, the world’s iconic northern lakes are undergoing major changes that include swiftly warming waters, diminished ice cover, and outbreaks of harmful algae. Now, a global consortium of scientists is trying to assess the toll.

Beyond Keystone: Why Climate
Movement Must Keep Heat On

It took a committed coalition and the increasingly harsh reality of climate change to push President Obama to reject the Keystone XL pipeline. But sustained public pressure will now be needed to force politicians to take the next critical actions on climate.

A Tale of Two Northern European Cities:
Meeting the Challenges of Sea Level Rise

For centuries, Rotterdam and Hamburg have had to contend with the threat of storm surges and floods. Now, as sea levels rise, planners are looking at innovative ways to make these cities more resilient, with new approaches that could hold lessons for vulnerable urban areas around the world.


MORE IN Reports

For Storing Electricity, Utilities
Are Turning to Pumped Hydro

by john roach
High-tech batteries may be garnering the headlines. But utilities from Spain to China are increasingly relying on pumped storage hydroelectricity – first used in the 1890s – to overcome the intermittent nature of wind and solar power.

On Thin Ice: Big Northern Lakes
Are Being Rapidly Transformed

by cheryl katz
As temperatures rise, the world’s iconic northern lakes are undergoing major changes that include swiftly warming waters, diminished ice cover, and outbreaks of harmful algae. Now, a global consortium of scientists is trying to assess the toll.

The Haunting Legacy of
South Africa’s Gold Mines

by mark olalde
Thousands of abandoned gold mines are scattered across South Africa, polluting the water with toxics and filling the air with noxious dust. For the millions of people who live around these derelict sites, the health impacts can be severe.

The Sushi Project: Farming Fish
And Rice in California's Fields

by jacques leslie
Innovative projects in California are using flooded rice fields to rear threatened species of Pacific salmon, mimicking the rich floodplains where juvenile salmon once thrived. This technique also shows promise for growing forage fish, which are increasingly threatened in the wild.

A Delicate Balance: Protecting
Northwest’s Glass Sponge Reefs

by nicola jones
Rare and extensive reefs of glass sponges are found only one place on earth – a stretch of the Pacific Northwest coast. Now, efforts are underway to identify and protect these fragile formations before they are obliterated by fishing vessels that trawl the bottom.

As the Fracking Boom Spreads,
One Watershed Draws the Line

by bruce stutz
After spreading across Pennsylvania, fracking for natural gas has run into government bans in the Delaware River watershed. The basins of the Delaware and nearby Susquehanna River offer a sharp contrast between what happens in places that allow fracking and those that do not.

Will Tidal and Wave Energy
Ever Live Up to Their Potential?

by sophia v. schweitzer
As solar and wind power grow, another renewable energy source with vast potential — the power of tides and waves — continues to lag far behind. But progress is now being made as governments and the private sector step up efforts to bring marine energy into the mainstream.

The Rapid and Startling Decline
Of World’s Vast Boreal Forests

by jim robbins
Scientists are becoming increasingly concerned about the fate of the huge boreal forest that spans from Scandinavia to northern Canada. Unprecedented warming in the region is jeopardizing the future of a critical ecosystem that makes up nearly a third of the earth’s forest cover.

Northern Forests Emerge
As the New Global Tinderbox

by ed struzik
Rapidly rising temperatures, changes in precipitation, and increased lightning strikes are leading to ever-larger wildfires in the northern forests of Alaska, Canada, and Siberia, with potentially severe ecological consequences.

For U.S. Tribes, a Movement to
Revive Native Foods and Lands

by cheryl katz
On ancestral lands, the Fond du Lac band in Minnesota is planting wild rice and restoring wetlands damaged by dams, industry, and logging. Their efforts are part of a growing trend by Native Americans to bring back traditional food sources and heal scarred landscapes.

e360 digest
Yale Environment 360 is
a publication of the
Yale School of Forestry
& Environmental Studies


Donate to Yale Environment 360
Yale Environment 360 Newsletter



About e360
Submission Guidelines

E360 en Español

Universia partnership
Yale Environment 360 articles are now available in Spanish and Portuguese on Universia, the online educational network.
Visit the site.


e360 Digest
Video Reports


Business & Innovation
Policy & Politics
Pollution & Health
Science & Technology


Antarctica and the Arctic
Central & South America
Middle East
North America

e360 VIDEO

The 2015 Yale e360 Video Contest winner documents a Northeastern town's bitter battle over a wind farm.
Watch the video.


The latest
from Yale
Environment 360
is now available for mobile devices at e360.yale.edu/mobile.

e360 VIDEO

A 2015 Yale e360 Video Contest winner captures stunning images of wild salmon runs in Alaska.
Watch the video.

e360 VIDEO

Colorado wildfires
An e360 video goes onto the front lines with Colorado firefighters confronting deadly blazes fueled by a hotter, drier climate.
Watch the video.


A three-part series Tainted Harvest looks at the soil pollution crisis in China, the threat it poses to the food supply, and the complexity of any cleanup.
Read the series.

header image
Top Image: aerial view of Iceland. © Google & TerraMetrics.