November 30, 2021
Build & Learn

Transformers for Beginners - An Introduction

What are Transformers and how do they work? How are they different from other Deep Learning models like RNNs, LSTMs? Explore the answers in this video!

Mısra Turp
Developer Educator
Mısra Turp
Developer Educator

This week we’re looking into Transformers.

Transformers were introduced a couple of years ago with the paper Attention is All You Need by Google Researchers. Since its introduction, Transformers has been widely adopted in the industry. Models like BERT, GPT-3 made groundbreaking improvements in the world of NLP and ASR using Transformers. Since then, model libraries like HuggingFace made it possible for everyone to use Transformer based models in their projects.

But what are Transformers and how do they work? How are they different from other Deep Learning models like RNNs, LSTMs? Why are they better? In this video, we learn about it all!

Title goes here

Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur.

Button Text
AI Concepts
Transformers