All Katas - ML Katas

by: newest upvotes saves

Building a Transformer Encoder from Scratch

this month hard (>1 hr) | transformer attention scratch encoder neural

Implement a single layer of a **Transformer Encoder** from scratch, without using `torch.nn.TransformerEncoderLayer`. This requires implementing a multi-head self-attention module and a...