Transformer

Cartesia Shows Hierarchical H-Nets Can Cut Compute Needs for Byte-Level Language Models
Cartesia says its hierarchical network architecture, H-Net, can replace tokenization in language models and deliver up to 3-5x compute efficiency gains in controlled…

Spotify study: simple pairwise models beat Transformers on 4 of 5 benchmarks
Spotify Research reports that on four of five common sequential recommendation benchmarks, at least one simpler model limited to pairwise transitions scores higher than…