Masked Image Modeling

A non-generative, self-supervised framework predicting high-level feature representations of masked regions from visible context, enabling scalable and efficient visual pretraining. [Read More]

Predict handcrafted features (e.g., HOG) of masked regions instead of raw pixels. [Read More]

Randomly mask image patches and reconstruct the missing ones to learn context-aware visual representations. [Read More]