muchad/idt5-base

Indonesian Version of Multilingual T5 Transformer

Smaller version of the Google's Multilingual T5-base model with only Indonesian and some English embeddings.

This model has to be fine-tuned before it is useable on a downstream task.
Fine-tuned idT5 for the Question Generation and Question Answering tasks, available at idT5-qa-qg.

Citation

1. IEEE
2. ArXiv