Artificial Intelligence / AI 0510 · Atom · ~20 seconds
One Row per Word
Video not yet published
to the StudyWalks catalog
to the StudyWalks catalog
State
A fixed embedding gives each word one row forever — "bank" occupies a single position whether the sentence means rivers or loans.
Show
"She fished from the bank" and "she robbed the bank" hand the model identical rows for their pivotal word.
Watch for
Fixing the flaw requires context to bend the rows at reading time — the transformer's entrance.