Which AI language model innovation significantly improved machine translation by introducing the 'attention mechanism' that helps systems focus on relevant words when translating sentences?

Machine translation has evolved dramatically in the product development landscape. Modern AI-driven translation tools use sophisticated algorithms to understand context, idioms, and cultural nuances - a far cry from the word-by-word substitutions of early systems. This poll tests your knowledge about a key breakthrough in translation product development that revolutionized how we bridge language barriers digitally.

This is a live public trivia poll on AIPolls.Net. Vote and see real-time results.

Transformer architecture (2017)
Word2Vec embedding (2013)
Long Short-Term Memory (LSTM) networks (1997)
Bidirectional Encoder Representations from Transformers (BERT) (2018)