Main content
ColorMAE: Exploring data-independent masking strategies in Masked AutoEncoders
Date created: | Last Updated:
: DOI | ARK
Creating DOI. Please wait...
Category: Project
Description: We introduce ColorMAE, a simple yet effective data-independent method which generates different binary mask patterns by filtering random noise. Drawing inspiration from color noise in image processing, we explore four types of filters to yield mask patterns with different spatial and semantic priors. ColorMAE requires no additional learnable parameters or computational overhead in the network, yet it significantly enhances the learned representations. This work was accepted at ECCV 2024.
Add important information, links, or images here to describe your project.
Files
Files can now be accessed and managed under the Files tab.