Chapter 04 of 5
The Value Locking Dilemma
The high-stakes race to align super-intelligence with human goals.
- The Black Box
Hidden Reasoning
Modern neural networks are so complex that even their creators cannot explain exactly how they reach specific conclusions. This lack of interpretability makes pre-calculating every risk impossible.
- The Realignment
Beyond Simple Code
As Transformers gained the power to generate, a new crisis emerged: how do we ensure a machine's objectives match our own? This is known as the Alignment Problem.
- The King Midas Effect
Literal Interpretation
AI often takes instructions too literally, achieving a goal in a way that causes unintended harm. Like the myth of Midas, getting exactly what you asked for can be a curse.
17 more cards in this chapter
Could you answer this?
What is 'Reward Hacking' in the context of AI alignment?
🧠 The Synthetic Mind
- 01The Era of Broken PromisesInside the AI Winters where logic-based systems failed to scale.
- 02The Big Bang of Big DataHow ImageNet and GPUs ignited the Deep Learning revolution in 2012.
- 03The Transformer BreakthroughUnpacking the 2017 paper that taught machines to pay attention.
- 04The Value Locking DilemmaThe high-stakes race to align super-intelligence with human goals.
- 05The Wall of Cold SiliconEnergy, data scarcity, and the physical limits of the AI boom.