Transformer Anecdotes: Attention Is All You Need

May 19, 2026 — 09:00 am - 09:15 am
Main Stage

Description

Stories about the paper, facts that you might not know and how it's strangely affected my life. "Attention Is All You Need" is a 2017 research paper in machine learning authored by eight scientists and engineers working at Google. The paper introduced a new deep learning architecture known as the transformer, based on the attention mechanism proposed in 2014 by Bahdanau et al.