Welcome to The Information Bottleneck!
The Information Bottleneck

The Information Bottleneck

Two AI Researchers - Ravid Shwartz Ziv, and Allen Roush, discuss the latest trends, news, and research within Generative AI, LLMs, GPUs, and Cloud Systems.

The player is loading ...
EP17: RL with Will Brown

Recent Episodes

Nov. 24, 2025

EP17: RL with Will Brown

In this episode, we talk with Will Brown, a research lead at Prime Intellect , about his journey into reinforcement learning (RL) and multi-agent systems, exploring their theoretical foundations and practical applications. We...
Nov. 17, 2025

EP16: AI News and Papers

In this episode, we discuss various topics in AI, including the challenges of the conference review process, the capabilities of Kimi K2 thinking, the advancements in TPU technology, the significance of real-world data in rob...
Nov. 13, 2025

EP15: The Information Bottleneck and Scaling Laws with Alex Alemi

In this episode, we sit down with Alex Alemi, an AI researcher at Anthropic (previously at Google Brain and Disney), to explore the powerful framework of the information bottleneck and its profound implications for modern mac...
Nov. 10, 2025

EP14: AI News and Papers

In this episode, we talked about AI news and recent papers. We explored the complexities of using AI models in healthcare (the Nature Medicine paper on GPT-5's fragile intelligence in medical contexts). We discussed the delic...
Nov. 7, 2025

EP13: Recurrent-Depth Models and Latent Reasoning with Jonas Geiping

In this episode, we host Jonas Geiping from ELLIS Institute & Max-Planck Institute for Intelligent Systems, Tübingen AI Center, Germany. We talked about his broad research on Recurrent-Depth Models and late reasoning in large...
Nov. 2, 2025

EP12: Adversarial attacks and compression with Jack Morris

In this episode of the Information Bottleneck Podcast, we host Jack Morris, a PhD student at Cornell, to discuss adversarial examples (Jack created TextAttack , the first software package for LLM jailbreaking), the Platonic r...