Which AI language product innovation was the first to use 'transformer' architecture, revolutionizing natural language processing and leading to models like GPT?

Language plays a crucial role in how products are developed, marketed, and received by consumers. Throughout history, there have been significant innovations in how language has been used in product development that fundamentally changed industries. This poll tests your knowledge of one such revolutionary linguistic innovation in the product development world.

This is a live public trivia poll on AIPolls.Net. Vote and see real-time results.

BERT (Bidirectional Encoder Representations from Transformers)
ELMO (Embeddings from Language Models)
Attention Is All You Need (Google's original transformer paper)
ULMFiT (Universal Language Model Fine-tuning)