← Graph

Transformers

concept 3 connections

Neural-network architecture introduced in the 2017 Google paper 'Attention Is All You Need'. Underlies modern LLMs; Andrei does not dive into the internals in the talk.

category
architecture
talk Building LLM powered applications in Ruby
about
Transformers concept
Names Transformers as the underlying LLM architecture.
resource Attention Is All You Need
about
Transformers concept
The paper that introduced the Transformer architecture.
concept Large Language Models
related_to
Transformers concept
LLMs are built on the Transformer architecture.

Provenance

Created in
Building LLM-Powered Applications in Ruby — Andrei Bondar... 2026-04-17 23:20
Read by
4 extractions