Do Astronomical Foundation Models Know When They Will Fail?

Abstract

Astronomical foundation models are increasingly used as reusable representations across surveys, but it is unclear when the same object remains consistently represented across instruments or whether a model can warn us before transfer fails. We present a conformal framework for auditing cross-survey representations using cross-matched Legacy Survey--HSC, HSC--JWST, and SDSS--HSC objects. Astronomy-specific AstroPT embeddings show lower translation errors and tighter conformal regions than genera…