Lesson 3
Attention Mechanism
What to focus on
👁️ How does AI understand context?
AI looks at other words in the sentence to understand the meaning of each word.
Example 1/3
The
cat
sat
on
the
mat
💡 Key insight:
- •Attention is a mechanism that allows AI to "look at" different parts of the text.
- •Attention strength shows how important one word is for understanding another.
- •It's like reading a sentence and remembering key words.