Attention Is All You Need

May 19, 202601:45 pm - 02:00 pm
Tech Stage

Description

"Attention Is All You Need" is a 2017 research paper in machine learning authored by eight scientists and engineers working at Google. The paper introduced a new deep learning architecture known as the transformer, based on the attention mechanism proposed in 2014 by Bahdanau et al.

SAKANA AI

Sakana AI is a Tokyo-based AI startup founded in 2023, focused on nature-inspired intelligence like evolution and collective behavior. It develops efficient, accessible generative models with the...