All Katas - ML Katas

by: newest upvotes saves

Implementing a Multi-Headed Attention Mechanism

this month hard (>1 hr) | transformer attention scratch nlp multi-head

Expand on the previous attention exercise by implementing a **Multi-Headed Attention mechanism** from scratch. A single attention head is a dot-product attention as you've implemented. Multi-head...