Machine learningML & AI Methods

Spectral Image Tokenizer

The paper suggests a novel method for tokenizing images for autoregressive transformer-based image generation, using a discrete wavelet transform for a coarse-to-fine representation, offering benefits like improved next-token prediction and the ability to reconstruct varying resolution images.