On-Device Translation: Faster, Smaller, and More Private
A study on on-device English-to-Traditional-Chinese subtitle translation shows that reducing the vocabulary of the LMT-60-0.6B model from 151,000 to 64,000 tokens improves speed and privacy. The Local…