AI Kills Everybody or Doomer Psyop? OpenAI's Math Breakthrough, Nike's $200B Collapse

Jacob Coxen, a researcher at Anthropic, resigned due to concerns about AI posing an existential threat to humanity, estimating a greater than 10% chance of extinction from AI within the next decade. His resignation tweet received 150 million views and was amplified by groups advocating for a federal department of AI. Evan Hubinger raised alarms about the lack of plans to address alignment issues in AI, while economist Sachs countered that Coxen's claims lacked evidence, revealing internal tensions at Anthropic regarding product safety and the implications for their upcoming IPO.

The episode compares current fears surrounding AI doomerism to historical societal anxieties over technological advancements, suggesting that such fears can lead to irrational responses. The precautionary principle is discussed, advocating for a slowdown in AI development if it poses existential risks. The fear of AI is seen as potentially rooted in human psychology, influencing societal reactions to future technologies.

Concerns are raised about regulatory efforts that may centralize control over AI development, particularly targeting open-source AI, which could threaten monopolistic practices. The narrative of existential threat is viewed as a strategy to create power structures and control public perception, with predictions indicating that autonomous weapons and cyber warfare could be the most likely pathways to human extinction from AI.

The episode highlights the risks and benefits of AI, noting the potential for new types of cyber attacks and the necessity of human involvement in AI processes. While there are more good actors than bad in AI technology, financial institutions are preparing for worst-case scenarios, and critical systems are designed with human-built redundancies for cyber defense. Current AI systems require human oversight, limiting their autonomy, although there is a prediction that future systems may automate their own training.

Anthropic faces scrutiny regarding its upcoming IPO, with concerns that the risks associated with its technology are not adequately disclosed. Employees have voiced worries about existential risks, and there is pressure on the SEC to ensure accurate risk disclosures in the S1 filing. A tweet from a senior executive has intensified these concerns, indicating troubling alignment with employee apprehensions.

OpenAI recently announced a breakthrough in solving a 200-year-old math problem related to fluid dynamics, claiming to have utilized 130 billion output tokens across 10,000 agents, equating to tens of thousands of years of human labor. However, this achievement is criticized as being based on brute force rather than unique insights. The episode also critiques the effectiveness of Zero Data Retention solutions, highlighting significant data leakage and the inadequacy of current protections for AI data compared to email data.

The need for AI data privacy rules is emphasized, particularly regarding user interactions with AI tools and the implications for intellectual property. Current terms of service for AI tools are deemed insufficient in protecting user data, risking unintentional sharing of organizational IP. The construction of AI models is described as creating a "leaky black box," which may not effectively address data leakage issues.

Nike's recent struggles are examined, noting its replacement in the S&P 100 after 18 years and an 80% stock drop from its peak market cap of $264 billion in 2021. The company's sales in China have decreased by 30%, and revenues have dropped by 10% since peaking at $51 billion in 2024. John Donahoe's direct-to-consumer strategy, which eliminated retail partners, is identified as a contributing factor to Nike's decline.

The episode critiques Nike's marketing shift towards a more inclusive narrative, arguing that it detracts from the brand's focus on mastery and excellence. The speaker believes this change, particularly marked by the ad campaign featuring Colin Kaepernick, has led to customer dissatisfaction and a decline in product quality. A return to core values of mastery and excellence could potentially win back millions of customers.

Brooks, a competitor, is highlighted for achieving nine years of double-digit revenue growth, reaching $1.6 billion, with a focus on product improvement. The speaker expresses confidence in Brooks' marketing abilities and suggests they could effectively rebrand Nike, proposing a tagline of "Do it or don't" to better reflect the brand's values.