Advances in Machine Learning & Artificial Intelligence(AMLAI)

Department of Family Medicine, Dong-eui Medical Center, Yangjeong-ro, Busanjin-gu, Busan, Republic of Korea

Publications

• Review Article   
  Transformer Architectures as Quantum Event Horizons: Information Scrambling, Page Curves, and Island Formation in Deep Neural Networks
  Author(s): Chur Chin*
  
  This study reinterprets the information flow within Transformer neural network architectures through the lens of quantum black hole thermodynamics, specifically the Event Horizon model and the Page Curve framework. We propose that each Transformer layer constitutes a dynamical system whose stability is governed by a Lyapunov exponent λ, analogous to Hawking radiation scrambling near a black hole event horizon. Numerical experiments using a BERT-base model demonstrate that early layers (Steps 0-6) exhibit λ > 0 (Lipschitz constant L ≈ 3.05), corresponding to a Fast Scrambling phase in which information is mixed violently across feature dimensions. At Step 7, a critical phase transition is observed: λ inverts to -0.1017, signaling the spontaneous formation of an Information Island: a stable, contracting attractor region analogous to the qua.. Read More»
  

  Abstract HTML PDF