UchUchU
cs.LGastro-ph.IM

Native Geometry vs. Linear Recoverability: How Alignment Changes Platonic Scaling

Angus Hoy, Austin Lutterbach, Jasper Chong, Aman Kumar, Michael J. Smith

Abstract

Do larger models learn increasingly similar representations of the same world? The Platonic Representation Hypothesis (PRH) predicts that they should, but similar can mean native cosine geometry---nearest-neighbour structure induced by cosine similarity before any learned alignment---or linear recoverability: correspondence revealed by a supervised linear map. Using matched Legacy Survey and Hyper Suprime-Cam (HSC) embeddings across five model families, we find that Ridge alignment strengthens t…

Source:arXiv / PDF

Looking for companies in this field?

UchUchU maintains a database of Japanese companies in the space industry.