Meta and Stanford propose Fast Byte Latent Transformer, cutting inference bandwidth >50%

Researchers from Meta FAIR and Stanford introduced three inference methods for the Byte Latent Transformer that reduce memory-bandwidth costs by over 50% without subword tokenization — a meaningful efficiency advance for tokenizer-free LLM serving and multilingual fairness.