Northeast Ohio weather and science blog covering severe storms, long term outlooks, climate, behavioral meteorology, technology and other observations
Showing posts with label computers. Show all posts
Showing posts with label computers. Show all posts
Friday, January 31, 2014
Don't Believe Snowfall Forecasts A Week Out
This pattern gets very tricky with a slightly southerly flow (WSW to ENW) this weekend and especially over the next week. The probability for more "panhandle snows" is growing.
In this age of the internet where every possible computer model and projection is available 24/7 on hundreds of websites and apps, anyone can post snapshots of these computer outputs especially when a rumor of heavy snow gains steam (next week). The problem with this is twofold. First, most people believe that these neat looking maps mean more accurate forecasts especially farther out. Secondly, most people treat these snapshots as Gospel and believe that these computer model depictions are actual forecasts. Nothing could be further from the truth. The phrases "could happen" with "mostly likely" to happen become interchangeable. Both phrases couldn't be more different. Wxbrad has an excellent post on this here.
"Could happen" scenarios bubble up from the seeds nestled in a common computer model misconception. Many believe that they provide forecasts. Not true. They are only guides. Nothing more. They come in two forms or outputs. One is called a deterministic solution, the other is an ensemble. A deterministic is ONLY ONE possible outcome with a set of initial conditions. An ensemble is a blend or average of a bunch of deterministic solutions. It smooths out the extremes giving us an average of the multiple outputs. The problem lies within the INITIAL CONDITIONS. Not all weather conditions are known for each geographic point in an area (in this case, northern Ohio). So there are data gaps before the model even runs. So unless you know the weather conditions for each and every point in northern Ohio (say every 50 or 100 feet) the computer output will have gaps. The overall solution will be estimated and smoothed out where these gaps exist. Imagine the gaps between Cleveland and Westlake or Akron and Medina. Actual solutions for these gaps are not known so the output is approximated.
We learn to use both the ensemble and deterministic in our assessment of each weather pattern and forecast for the area. Computer models are only a guide, an interpretation of the weather scenario, nothing more. We learn the pros, cons and biases inherent in each model and apply them to the current weather situation. Meteorologists deal in "mostly likely" scenarios after taking all of the available data and computer models into account. WE create forecasts that are "mostly likely" to occur. Look how the computer output (GFS) for snowfall accumulation for next week has changed in both depth and location over the last 3 days.
Be careful of Facebook posts that show solutions more than 5 days out. This is only one possible solution with one set of initial conditions showing a "could happen" scenario. Don't get me wrong. Its fun to speculate. But "Could happen" scenarios are not a healthy way of looking at the weather (just look at the devolution of Facebook comment threads). "Mostly likely" scenarios are safer and work better in the long run.
Trust the meteorologist not the computer.
Labels:
computers,
models,
projections,
psychology,
snowfall,
Weather
Tuesday, June 21, 2011
Is Forecasting the Weather Art or Science?
In this technological world that we live in where the resources for weather related information are readily available for ANYONE in seconds, it still surprises me how many of us still hang onto the belief that simply because we have "super-fast computers", weather forecasting should be a science that is an already mastered discipline. In the minds of most, because of advancements in technology, forecasting should be an old science relic that should have been perfected by now.
I am a firm believer that weather foreacsting is made up of two parts: Science and Art. The science encompasses objective observation and analysis. The art deals with formulating your forecast so it best fits everyones "perception" of what is happening-- a poor-man's exercise in psycho-analysis. More on that in a moment.
First the science:
Contrary to what many believe, forecasting accuracy is MUCH BETTER than it was 10 or 15 years ago. This is in part to several factors: The first is the development and implementation of satellite data. The second is faster computers. The third is more advanced weather simulations (called computer models)
Satellites monitor each and every square inch of the planet. Soil moisture, ground temperature, atmospheric temperatures, infrared radiation, wind profiles, pollution, dust, pressure, ice coverage...you name it. All of this data is compiled and shuttled onto websites each second of each day. The first decade of the 2000s will be remembered as the time when volumes of satellite data became available on the internet to most everyone. Want to analyze ocean surface temperatures? You can do it. Want the dataset for ozone over Antarctica? Its right there! Our understanding of the oceans and atmosphere is so much greater with this library of satellite data so readily available.
Computers are much faster and getting smaller each year. A personal computer from 2006 is grossly outdated. In 2015, the best and faster computer in 2011 will be a turtle in comparison. Faster computers means faster and more detailed computer simulations of thunderstorms, hurricanes, ocean currents and other patterns. Combine the faster computers with more detailed data and you get a much better simulation on what the specific weather will be for a certain area.
That said, simulations have and will ALWAYS have limitations. First, simulations by their very nature are not exact answers. They are approximations. The complex math that describes the atmosphere is one big approximation. Factor these inexact simulations created by humans with super-fast computers, also made by humans and you get two things: MUCH better forecasts that still have some degree of error.
Now the art (psychology):

Weather accuracy is highly subjective. If you mention on the air that "90% of the area will get thunderstorms today" and 90% of the area gets rain and storms, your accuracy is pretty darn good. Yet for the 10% who didn't get any rain, you are the worst forecaster in history!
Your "weather reality" is what is over your head at any given time. Much of the public as a whole views the weather around them with a biased lens. Substitute this "weather reality" with politics, the economy, religion, crime, your friends, it doesn't matter. We are all biased to some extent. That's what makes us human. Its our built in selective perception of the weather and events around us that gives us perspective. The art of forecasting is formulating your words based on how people will "perceive" what is going to happen.
20 years ago, the only sources of weather were: television, radio, newspaper and word of mouth. Now, add real-time Internet and smart phone updates, 24 hour cable. Its and endless bombardment of weather both beautiful and destructive. We are all conditioned partly with this overflow of information to gauge the weather events as something new. How many times have we heard "I've never seen anything like this before!" after a weather event? The most recent weather is overemphasized because its fresh in our minds. This shapes our viewpoint on weather a few days to a few weeks in the future.
Most outside of the field of weather find it very difficult to grasp the fact that the weather is one big approximation. Weather should be exact; we all want a forecast that fits a nice and neat one-size-fits-all package. I'd like to say that I make a forecast whether short or long term with a cold, rational eye rather than my biased, emotional side. But I don't. I take into account how the general public will react to my EVERY word knowing that most selectively perceive the weather to fit their "sphere of reality". I learned that quickly years ago. For all of the simulations, super-computers, highly detailed satellite data, it doesn't matter how exact your forecast is or what scientific reasoning you used in coming to your conclusion, people will ignore the facts and the data that disagree with their perceptions and will "rationalize" what they want and react accordingly. More often than not, the reactions are negative. Worse still, its accumulative. The more we selectively perceive the weather to fit our negative connotation, the more negative our reaction and the more rigid our bias becomes. Its a vicious circle that feeds on itself.
This is called the Disconfirmation Bias. Its the tendency to accept supportive evidence of a belief uncritically, but to discount evidence that challenges that belief.
Here is an example: Go back to last winter. The first big snowstorm forecast calls for "4-8 inches" for the following day. In your backyard, you get 3 inches yet 80% of the area received 6 inches. You say "what happened to the 4-8 inches?" Second snowstorm, the forecast calls for "6 to 10 inches". You get 6 inches. The majority of the area received 9 inches. You say "what happened to the "6 to 10 inches?". By the third snowstorm, you are already frustrated by the "lack of accuracy" so you are primed to think negatively. The forecast calls for 5 to 10 inches. You get 5 inches and you say "what happened to the other 5 inches?"
The forecast was accurate given the range in the snowfall prediction. Since you were preconditioned to believe the forecast would be way off because of your established bias, no amount of evidence in the world will break you of that bias!
Weather is an old science. Weather forecasting is a field that continues to grow. But the heart of a forecast lies in molding the science to fit the psychology. Human nature is tough and stubborn. I'll try to be better sculptor.
I am a firm believer that weather foreacsting is made up of two parts: Science and Art. The science encompasses objective observation and analysis. The art deals with formulating your forecast so it best fits everyones "perception" of what is happening-- a poor-man's exercise in psycho-analysis. More on that in a moment.
First the science:
Contrary to what many believe, forecasting accuracy is MUCH BETTER than it was 10 or 15 years ago. This is in part to several factors: The first is the development and implementation of satellite data. The second is faster computers. The third is more advanced weather simulations (called computer models)
Satellites monitor each and every square inch of the planet. Soil moisture, ground temperature, atmospheric temperatures, infrared radiation, wind profiles, pollution, dust, pressure, ice coverage...you name it. All of this data is compiled and shuttled onto websites each second of each day. The first decade of the 2000s will be remembered as the time when volumes of satellite data became available on the internet to most everyone. Want to analyze ocean surface temperatures? You can do it. Want the dataset for ozone over Antarctica? Its right there! Our understanding of the oceans and atmosphere is so much greater with this library of satellite data so readily available.
Computers are much faster and getting smaller each year. A personal computer from 2006 is grossly outdated. In 2015, the best and faster computer in 2011 will be a turtle in comparison. Faster computers means faster and more detailed computer simulations of thunderstorms, hurricanes, ocean currents and other patterns. Combine the faster computers with more detailed data and you get a much better simulation on what the specific weather will be for a certain area.
That said, simulations have and will ALWAYS have limitations. First, simulations by their very nature are not exact answers. They are approximations. The complex math that describes the atmosphere is one big approximation. Factor these inexact simulations created by humans with super-fast computers, also made by humans and you get two things: MUCH better forecasts that still have some degree of error.
Now the art (psychology):

Weather accuracy is highly subjective. If you mention on the air that "90% of the area will get thunderstorms today" and 90% of the area gets rain and storms, your accuracy is pretty darn good. Yet for the 10% who didn't get any rain, you are the worst forecaster in history!
Your "weather reality" is what is over your head at any given time. Much of the public as a whole views the weather around them with a biased lens. Substitute this "weather reality" with politics, the economy, religion, crime, your friends, it doesn't matter. We are all biased to some extent. That's what makes us human. Its our built in selective perception of the weather and events around us that gives us perspective. The art of forecasting is formulating your words based on how people will "perceive" what is going to happen.
20 years ago, the only sources of weather were: television, radio, newspaper and word of mouth. Now, add real-time Internet and smart phone updates, 24 hour cable. Its and endless bombardment of weather both beautiful and destructive. We are all conditioned partly with this overflow of information to gauge the weather events as something new. How many times have we heard "I've never seen anything like this before!" after a weather event? The most recent weather is overemphasized because its fresh in our minds. This shapes our viewpoint on weather a few days to a few weeks in the future.
Most outside of the field of weather find it very difficult to grasp the fact that the weather is one big approximation. Weather should be exact; we all want a forecast that fits a nice and neat one-size-fits-all package. I'd like to say that I make a forecast whether short or long term with a cold, rational eye rather than my biased, emotional side. But I don't. I take into account how the general public will react to my EVERY word knowing that most selectively perceive the weather to fit their "sphere of reality". I learned that quickly years ago. For all of the simulations, super-computers, highly detailed satellite data, it doesn't matter how exact your forecast is or what scientific reasoning you used in coming to your conclusion, people will ignore the facts and the data that disagree with their perceptions and will "rationalize" what they want and react accordingly. More often than not, the reactions are negative. Worse still, its accumulative. The more we selectively perceive the weather to fit our negative connotation, the more negative our reaction and the more rigid our bias becomes. Its a vicious circle that feeds on itself.
This is called the Disconfirmation Bias. Its the tendency to accept supportive evidence of a belief uncritically, but to discount evidence that challenges that belief.
Here is an example: Go back to last winter. The first big snowstorm forecast calls for "4-8 inches" for the following day. In your backyard, you get 3 inches yet 80% of the area received 6 inches. You say "what happened to the 4-8 inches?" Second snowstorm, the forecast calls for "6 to 10 inches". You get 6 inches. The majority of the area received 9 inches. You say "what happened to the "6 to 10 inches?". By the third snowstorm, you are already frustrated by the "lack of accuracy" so you are primed to think negatively. The forecast calls for 5 to 10 inches. You get 5 inches and you say "what happened to the other 5 inches?"
The forecast was accurate given the range in the snowfall prediction. Since you were preconditioned to believe the forecast would be way off because of your established bias, no amount of evidence in the world will break you of that bias!
Weather is an old science. Weather forecasting is a field that continues to grow. But the heart of a forecast lies in molding the science to fit the psychology. Human nature is tough and stubborn. I'll try to be better sculptor.
Wednesday, April 21, 2010
Happy 45th Birthday Moore's Law
If you follow computer technology then you have probably heard of Moore's Law. Gordon Moore, co-founder of Intel Corportation came up with his famous law back in 1965 sighting the rapid increase of circuits on a single chips. THE ORIGINAL ARTICLE IS HERE
An article on wired.com pointed out that Moore's Law is often misunderstood. The article goes to say that the paper "referred to the number of transistors that could be cost-effectively produced on a single integrated circuit, and he somewhat optimistically predicted that this number would double every year."
The full article is here: http://www.wired.com/thisdayintech/2010/04/0419moores-law-published/#ixzz0lj2nMhEC
Some highlights of the original paper published in 1965 are:
1. That means by 1975, the number of components per integrated circuit for minimum cost
will be 65,000
2. Computer processing power would double every two years.
3. The cost of computing is cut in half every two years. In other words. As the circuitry gets more complicated, the cost drops.
According to a press release from Intel back in September 2009, the new 22 nanometer chips contain the smallest SRAM cell used in working circuits ever reported at .092 square microns. You can fit 10,000 of these cells per millimeter. Find your ruler, located the small hash marks on the metric side. Now imagine 10,000 cells between each hash mark.
Eventually, the physical limits of microchips will be realized. As Mr. Moore said in this article a few years ago:
"Moore reiterated, however, that there really are fundamental limits to his law, regardless of materials. Indeed, while he admitted to being “perpetually amazed” at how technologists have been pushing those limits out ahead of us, Moore said the end times are near. So when can you expect the law that has driven you to replace your computer every 2-3 years to be obsolete? You’ve got ten-to-15 years..." Wired.com
Subscribe to:
Posts (Atom)





