FOTO: Figure-Level Semantic Search for Astronomy

Abstract

Astronomy papers carry much of their content in figures, but literature search indexes text, so there is no way to find a plot by describing what it shows. We present FOTO, a figure-level search tool over 482,750 captions from 53,839 peer-reviewed astro-ph papers. Each figure is indexed once by its title and caption, embedded with a 110M-parameter open model that runs locally, and a large language model is applied only to the retrieved shortlist, where it verifies real figures rather than genera…