Friday, June 26, 2015

The Signal and the Noise: The Art and Science of Prediction

#author.Nate Silver
checkout local library thru Kindle.
FINISHED.20150715

#note.//Thanks Kindle!

We need to stop, and admit it: we have a prediction problem. We love to predict things—and we aren’t very good at it.
Read more at location 381
Note: 1297 highlights as of 20150625. It's not something I would quote.

...suppose instead that there is some common factor that ties the fate of these homeowners together. For instance: there is a massive housing bubble that has caused home prices to rise by 80 percent without any tangible improvement in the fundamentals. Now you’ve got trouble: if one borrower defaults, the rest might succumb to the same problems.
Read more at location 603
Note: the common factor is a global recession or depression  

passage attributed to the Greek poet Archilochus: “The fox knows many little things, but the hedgehog knows one big thing.”
Read more at location 1018    
Note: fox clan. 1285 highlights as of 2015.06.30  

Foxes, Tetlock found, are considerably better at forecasting than hedgehogs.
Read more at location 1026    
 
“They look at this probabilistic information and they’ve got to translate that into a decision. A go, no-go. A yes-or-no decision.
Read more at location 2418    
Note: But in an emergency, you need an alpha leader to make go, no-go decision for the group. It's a trade off. Leaders are usually hedgehog and make poor predictions but in a crisis they don't get confused analyzing. They make executive decisions. GO LEFT!

What happens in systems with noisy data and underdeveloped theory—like earthquake prediction and parts of economics and political science—is a two-step process. First, people start to mistake the noise for a signal. Second, this noise pollutes journals, blogs, and news accounts with false alarms, undermining good science and setting back our ability to understand how the system really works.
Read more at location 2788
 
I give you three locks to practice on—a red one, a black one, and a blue one.
Read more at location 2795
Note: This is an example of Overfittng that I should remember. I wrote a poem about it.
http://hellopoetry.com/poem/1266402/mangoman/


To borrow the title of another book, they play into our tendency to be fooled by randomness.
Read more at location 2846    
Note: I've read it. Is it on my stream?  

the theory suggests that very simple things can behave in strange and mysterious ways when they interact with one another.
Read more at location 2909    
Note: I'm fairly simple and so is JoJoBrand3! How we three simpleton interact might be very complex. Theory of complexity with Per Bak.  

Bak’s favorite example was that of a sandpile on a beach.
Read more at location 2910    
 
The more fundamental problem is that we have a demand for experts in our society but we don’t actually have that much of a demand for accurate forecasts.”
Read more at location 3371    
Note: Robin Hansen at George Mason Univ.  

crucial to develop a better understanding of ourselves, and the way we distort and interpret the signals we receive, if we want to make better predictions.
Read more at location 3866
 
Scottish philosopher David Hume, who argued that since we could not be certain that the sun would rise again, a prediction that it would was inherently no more rational than one that it wouldn’t.26 The Bayesian viewpoint, instead, regards rationality as a probabilistic matter.
Read more at location 4049    
 
Healthy skepticism needs to proceed from this basis. It needs to weigh the strength of new evidence against the overall strength of the theory, rather than rummaging through fact and theory alike for argumentative and ideological convenience,
Read more at location 6168    
 
Armstrong and Green critique of model complexity thus looks pretty good here. But the success of the more basic forecasting methods suggests that Armstrong’s critique may have won the battle but not the war.
Read more at location 6567
 
since the simple methods correctly predicted a temperature increase in line with the rise in CO2, they are also evidence in favor of the greenhouse-effect hypothesis.
Read more at location 6570
 
we’re wasting our time debating a proposition that is very much accepted within the scientific community, when we could be having a good-faith discussion about the uncertainties that do exist.”Read more at location 6667    
Note: Michael Mann at Penn State Univ.  

But at least this flawed type of thinking would have involved some thinking. If we had gone through the thought process, perhaps we could have recognized how loose our assumptions were.
Read more at location 6827
 
When a possibility is unfamiliar to us, we do not even think about it. Instead we develop a sort of mind-blindness to it. In medicine this is called anosognosia:
Read more at location 6829    
 
Aaron Clauset, a professor at the University of Colorado with a background in physics and computer science, has published papers on the mathematics of everything from the evolution of whales42 to the network dynamics of multiplayer role-playing games.
Read more at location 6948    
 
Clauset’s insight, however, is actually quite simple—or at least it seems that way with the benefit of hindsight. What his work found is that the mathematics of terrorism resemble those of another domain discussed in this book: earthquakes.
Read more at location 6955
 
Clauset’s method gives us reason to believe that attacks that might kill tens of thousands or hundreds of thousands of people are a possibility to contemplate as well. The mechanism for such an attack is unpleasant but easy enough to identify. It would most likely involve weapons of mass destruction, particularly nuclear weapons.
Read more at location 7019
 
world in which there are dangerous terrorist groups, vulnerable nuclear materials at many places around the world, and a lack of focus on the problem from U.S. policy makers.
Read more at location 7035
Note: Obama team again has correct policy, esp with recent diplomacy with Iran~20150714  

Allison’s concern stems primarily from two nuclear states: Russia and Pakistan.
Read more at location 7057    
 
We must always accept a certain amount of risk from terrorism when we want to live in a free society, whether or not we want to admit it.
Read more at location 7176    
 
In many walks of life, expressions of uncertainty are mistaken for admissions of weakness.
Read more at location 7277

No comments:

Post a Comment