Scalable Visual Representation Learning
Published:
Model performance
At the Morgridge Institute for Research, I trained and benchmarked DINOv2, diffusion, and hierarchical VQ-VAE architectures on 1.5 million multi-channel Cell Painting images. DINOv2 representations increased gene-classification AUROC by 18% relative to an ImageNet-pretrained baseline.
Infrastructure performance
I implemented distributed training across 64 A100 GPUs using DeepSpeed ZeRO-3. The optimized training stack reduced epoch latency from 6.4 hours to 1.7 hours, delivering 3.8× higher throughput and 54% lower compute cost.
I also developed a discrete latent pipeline using VQ-VAE token spaces for conditional diffusion of unseen perturbations and temporal transitions. The project combined architecture benchmarking, multi-node training, performance profiling, and cost optimization.
