Menan Velayuthan's picture

3 8 2

Menan Velayuthan

velmen

·

AI & ML interests

Machine learning with graphs

Recent Activity

reacted to Jaward's post with ❤️ 3 days ago

nanoBLT: Simplified lightweight implementation of a character-level Byte Latent Transformer model (under 500 lines of code). The model is 2x4x2 (n_layers_encoder, n_layers_latent, n_layers_decoder) layer deep trained on ~1M bytes of tiny Shakespeare with a patch size of 4. Code: https://github.com/Jaykef/ai-algorithms/blob/main/byte_latent_transformer.ipynb

upvoted an article 5 days ago

Tokenization in Transformers v5: Simpler, Clearer, and More Modular

upvoted an article 9 days ago

Gotchas in Tokenizer Behavior Every Developer Should Know

View all activity

Organizations

velmen 's datasets

None public yet