This repo contains the code developed to study the impact of different pre-training data distributions on the downstream fine-tuned performance of Masked Autoencoders. The report can be accessed here.
The "instruction.pdf" file contains detailed instructions on how to reproduce the results contained in the report.