All Katas - ML Katas

by: newest upvotes saves

Tensor Manipulation: Sinusoidal Positional Encoding

today hard (<10 mins) | transformer attention nlp tensor

### Description Implement the sinusoidal positional encoding from the "Attention Is All You Need" paper. This technique adds information about the position of tokens in a sequence by injecting a...
Build a Transformer Encoder Block from Scratch

this week hard (<30 mins) | pytorch transformer attention nlp

### Description The Transformer architecture is built upon a fundamental component: the Encoder block. [1] Each block is responsible for processing a sequence of embeddings and refining them. Your...