2.1.1 The Battle Against Uncertainty
Do not hold your Views too firmly. Every fool is fully convinced, and everyone fully persuaded is a fool: the more erroneous his judgment the more firmly he holds it.
- Baltasar Gracián1
1. The Paradox of Financial Advice
In the world of finance, costly advice is often given very cheaply. Each day, billions of shares are traded in the stock market, with most buyers and sellers having access to the same information. Yet, they exchange stocks mainly because they have different opinions. The buyer thinks the price is undervalued, while the seller believes it's overvalued. This raises a crucial question: Why do both buyers and sellers believe the price is wrong?
Logically, if both the buyer and the seller expect a different price, then either they are both wrong or only one of them is right. They cannot both be right. Therefore, when a trade occurs, one person must believe that the person on the other side is wrong.
2. The Nature of Financial Predictions
Traders often claim they don't predict the future but have instead figured out different ways of beating the market. However, it's impossible to be a successful trader without making correct bets about the future and believing you know more about the future than the person you're trading with.
In essence, being a successful trader requires becoming something of a soothsayer or fortune teller. The ultimate objective is not to always be right, but to be more right than the people you're trading with.
Of course, in practice, it's more complicated. Traders don't simply make or lose money based on their predictions, but also on factors like leverage and timing of trades. However, generally, they need to predict the future better, all else being equal, since leverage and timing are double-edged swords.
This presumption of knowing the future extends beyond trading. A business executive who claims to know which strategy ought to be used in a given scenario is also implicitly assuming knowledge of the future.
3. Historical Perspective on Prediction and Risk
Our battle against uncertainty is ancient. In "Against the Gods: The Remarkable Story of Risk,"2 Peter Bernstein details this historic and endless battle. Throughout different epochs, influenced by the dominant ideology of the time, we have dealt with risk differently.
3.1 Ancient Approaches
The ancient Greeks refused to accept anything passed down from older societies. They sought concepts that would apply universally, focusing on proof, as exemplified by Euclidean geometry. However, they failed to discover the laws of probability, calculus, and algebra.
The Romans faced similar limitations. Their numeral system, for instance, was clumsy and unreliable. You couldn't write the number 32 as III II because it was unclear whether it meant 32, 302, or 3020.
3.2 The Arabic Contribution
A superior numbering system emerged around 500 AD, thanks to the Hindus. The Arabs encountered these numbers about 90 years after the prophet Mohammed established Islam. Omar Khayyam used this new system to create a language of calculation that became the basis for algebra. He devised a triangular arrangement of numbers that facilitated the calculation of squares, cubes, and higher powers - a foundation upon which Pascal later built his theories of choice, chance, and probability.
3.3 The Shift to Internal Calculation
Since the 1500s, social transformations have shifted our guiding compass from external, established authorities to our own internal calculus. This process of "disembedding," as Taylor terms it, has disentangled us from traditional anchors of certainty, such as religious doctrine or societal norms.
This shift profoundly impacted our perception of risk. In a world guided by external authority, risks were often seen as divine tests or cosmic punishments - inexplicable realities to be accepted rather than managed. But as the axis of authority shifted from external to internal, so did our perception of risk. Risks became challenges to be tackled using reason, knowledge, and experience.
4. Famous Failed Predictions
The history of prediction is littered with notable failures. Tom Phillips, in "Humans: A Brief History of How We F*cked It All Up,"3 provides a summary of famously bad predictions:
In 1902, Lord Kelvin predicted that transatlantic flight was impossible, stating "no balloon and no airplane will ever be practically successful." The Wright brothers flew their first flight 18 months later.
In 1912, Guglielmo Marconi, the inventor of radio, predicted that "the coming of the wireless era will make war impossible, because it will make war ridiculous." World War I began in 1914.
On October 16, 1929, Yale economist Irving Fisher predicted that "stock prices have reached what looks like a permanently high plateau." Eight days later, stock markets worldwide crashed, leading to the Great Depression.
In 1932, Albert Einstein predicted that "there is not the slightest indication that [nuclear energy] will ever be obtainable."
In 1938, British Prime Minister Neville Chamberlain, after signing a deal with Adolf Hitler, predicted, "I believe it is peace for our time." World War II began in 1939.
In 1977, Ken Olsen, president of Digital Equipment Corporation, predicted that the computer business would always be niche, saying, "There is no reason for any individual to have a computer in his home."
These examples illustrate the difficulty of predicting future developments, even for experts in their respective fields.
5. Financial Prediction Failures
The financial world has seen its share of prediction failures:
The Panic of 1837 was partly caused by over-expansive lending practices, leading to speculation in both the United States and Europe. This created an economic bubble that eventually burst, resulting in a severe depression.
In 2000, many dot-com companies went bankrupt after over-expanding and burning through investors' money.
The global financial crisis of 2007-2008 was caused by factors including subprime mortgage lending and failure of financial regulation.
In 2008, stock markets worldwide crashed again, leading to a prolonged recession and a rise in populist politics in many democracies.
6. The Unreliability of Expert Judgment
Burton Malkiel, in "A Random Walk Down Wall Street,"4 provides a sobering reminder of the fallibility of expert judgment. He cites a study of tonsillectomies in New York City where, after three rounds of examinations by different groups of doctors, only 65 out of 1,000 children were not recommended for the procedure.
This unreliability extends to other fields. Radiologists have failed to recognize lung disease in about 30 percent of X-ray plates they read. Another experiment showed that staff in psychiatric hospitals could not reliably distinguish between sane and insane patients.
Given these examples, it's not surprising that security analysts struggle to predict the future. Malkiel attributes this difficulty to five main factors:
Influence of random events
Dubious reported earnings through "creative" accounting procedures
Errors made by the analysts themselves
Loss of the best analysts to sales desks or portfolio management
Conflicts of interest facing securities analysts at firms with large investment banking operations
7. Challenges in Specific Industries
7.1 Utilities Industry
Even traditionally stable industries like utilities face prediction challenges. State public utility commission rulings have made it difficult for utilities to translate higher growth into higher profits.
7.2 High-Tech and Telecommunications
Economic forecasts for high-tech and telecommunications companies were notoriously inaccurate in the early 2000s.
7.3 Biotech Industry
The biotech industry is particularly difficult to predict. Potential blockbuster drugs often fail in Phase III trials due to inability to improve mortality or unexpected toxic side effects. For example, Celsion Corporation's stock lost 90% of its value in 2013 when a promising liver cancer drug trial failed to meet its primary endpoint.
Case Study: Bluebird bio
Bluebird bio, once a rising star in biotech, suffered multiple commercial failures:
Its leukemia treatment, bb2121, failed to meet sales expectations due to high price and limited patient eligibility.
LentiGlobin, a treatment for severe combined immunodeficiency (SCID), failed to meet FDA approval due to manufacturing concerns.
Zynteglo, a gene therapy for beta-thalassemia, failed to meet its primary efficacy endpoint in a clinical trial.
These failures highlight the unpredictability of the biotech industry and the importance of factors beyond scientific promise, such as pricing strategy and manufacturing processes.
8. Modern Approaches to Risk Management
Despite the challenges, modern finance has developed sophisticated tools for managing risk and improving predictions. Some key approaches include:
Value at Risk (VaR): This statistical technique measures and quantifies the level of financial risk within a firm or investment portfolio over a specific time frame.
Monte Carlo simulations: These computational algorithms rely on repeated random sampling to obtain numerical results, often used to model the probability of different outcomes in complex systems.
Machine Learning and Artificial Intelligence: These technologies are increasingly used to analyze vast amounts of data and identify patterns that human analysts might miss.
Stress Testing: This technique is used to determine the stability of a given system or entity. It involves testing beyond normal operational capacity, often to a breaking point, to observe the results.
While these tools have improved risk management, they are not infallible. The 2008 financial crisis revealed limitations in many risk models, particularly in accounting for systemic risk and extreme events.
9. Successful Predictions and Effective Risk Management
While this essay has focused on the challenges of prediction, it's important to note that not all predictions fail. Some individuals and institutions have demonstrated a remarkable ability to navigate uncertainty:
Warren Buffett: Known as the "Oracle of Omaha," Buffett has consistently outperformed the market over decades through careful analysis and a long-term investment approach.
Renaissance Technologies: This quantitative hedge fund has achieved extraordinary returns by using sophisticated mathematical models to identify market inefficiencies.
John Paulson: He famously predicted the subprime mortgage crisis and made billions by shorting the housing market.
Ray Dalio: The founder of Bridgewater Associates has developed a set of principles for economic analysis that have guided his firm to long-term success.
These success stories suggest that while perfect prediction is impossible, combining rigorous analysis, diverse perspectives, and a willingness to challenge conventional wisdom can lead to better decision-making in the face of uncertainty.
10. The Psychology of Prediction and Risk-Taking
The human propensity for risk-taking and prediction is deeply rooted in our psychology. Adam Smith noted the excessive confidence most individuals have in their abilities and their irrational optimism about their fortunes. While this optimism can fuel economic advancement, it can also lead to reckless behavior.
Keynes recognized that a spark of audacity is vital for risk-taking; without it, only cold, impassive calculation would remain. When faced with risk, no one bets on failure. However, this same audacity can lead to destructive outcomes when taken to extremes.
The thrill of prediction and risk-taking is akin to gambling, a fascination that has captivated humans for millennia. From ancient times to the modern era, we've been enticed by the game of chance. In finance, this manifests as traders and investors attempting to predict market movements and make profitable bets on the future.
11. The Ongoing Challenge of Prediction in Finance
The quest to predict the future, particularly in finance, remains an ongoing challenge. Despite advances in technology, data analysis, and risk management techniques, the fundamental unpredictability of complex systems like financial markets persists.
Key lessons from this exploration include:
Humility in the face of uncertainty: Even experts can be dramatically wrong in their predictions.
The importance of diversification: Given the difficulty of prediction, spreading risk across various investments remains a crucial strategy.
The value of continuous learning: As the world changes, so too must our models and understanding of risk.
The role of psychology: Understanding human biases and tendencies is crucial in making better predictions and managing risk.
The balance between risk and reward: While risk-taking is necessary for progress, it must be tempered with wisdom and prudence.
As we look to the future, the challenge of prediction in finance will likely evolve with new technologies and changing global dynamics. However, the fundamental tension between our desire to know the future and the inherent unpredictability of complex systems will remain a defining feature of financial markets and decision-making.
In this context, successful investors and financial professionals will be those who can balance confidence with humility, leverage advanced tools while recognizing their limitations, and remain adaptable in the face of an ever-changing landscape. The future, as always, remains uncertain - but our approach to navigating that uncertainty continues to evolve and improve.
1 Baltasar Gracián y Morales. The Art of Worldly Wisdom. Currency, 1992.
2Bernstein, Peter L. Against the Gods: The Remarkable Story of Risk. John Wiley & Sons, 1998.
3Phillips, Tom. Humans: A Brief History of How We F----D It All Up. Hanover Square Press, 2019.
4Malkiel, Burton Gordon. A Random Walk down Wall Street: The Time-Tested Strategy for Successful Investing. W.W. Norton & Company, 2020.
Dive Deeper into the World of Financial Prediction and Risk Management
If you enjoyed the above excerpt and If navigating the chaos of financial prediction and risk fascinates you, you're in the right place. These ideas influence everything, from personal investment choices to the movement of global markets.
I'm excited to introduce the updated version of my book, The End of Wisdom: Why Most Advice is Useless. It goes beyond the surface, cutting through the noise and offering real insights into:
The hard lessons from history's biggest prediction failures—and their ripple effects.
Candid conversations with top financial minds on how they handle risk.
Practical, no-nonsense tools to sharpen your own predictive skills.
A look at how AI and machine learning are reshaping financial forecasting—right now.
Whether you're a pro in the financial world or just looking to make smarter moves, The End of Wisdom gives you the edge you need in a world full of uncertainty.
It’s time to stop gambling on advice and start mastering the unpredictable.