Training a Tiny Language Model to Follow Prompts Across 6 Low Resource Lanuages
BULaMU creator mwebazarick released a 47M-parameter language model fine-tuned to generate stories across six low-resource East African languages plus English, trained on a corpus expanded tenfold to 40 billion tokens. Th…