Search papers, labs, and topics across Lattice.
The authors introduce IPO-Mine, a toolkit and dataset for analyzing long, multimodal IPO filings, addressing the lack of standardized resources for studying these complex financial documents. The IPO-Toolkit parses filings into section-structured text and extracts images, while the IPO-Dataset comprises over 109,000 filings and 76,000 images from 1994 to 2026. Experiments using this dataset reveal that state-of-the-art multimodal models struggle to align with expert human judgments in tasks like chart quality assessment, highlighting challenges in reasoning over real-world regulatory documents.
Multimodal models can't reliably judge financial chart quality in IPO filings, diverging significantly from human experts and revealing a gap in real-world reasoning.
An Initial Public Offering (IPO) filing is a document released when a private firm goes public, allowing individual (retail) investors to purchase its shares. These filings describe a firm's business, financials, and risks and are long, multimodal documents with narrative text and images. Despite their importance to financial markets, there is no large-scale, standardized dataset or benchmark for studying IPO filings with modern language and multimodal models. These documents pose significant challenges: filings frequently exceed 500,000 tokens and lack consistent structural organization. We introduce the IPO-Toolkit, an open-source framework for downloading and parsing IPO filings into standardized section-structured text and extracted images. The toolkit segments filings, extracts embedded images, and produces structured outputs that enable large-scale, reproducible analysis workflows over long, multimodal documents. Using this infrastructure, we construct the IPO-Dataset, a large, section-structured, multimodal dataset covering more than 109,000 IPO filings and amendments from 1994 to 2026 and containing over 76,000 images. We establish structured evaluation tasks over extracted financial charts, including chart quality and misleadingness assessment. Our experiments show that state-of-the-art multimodal models often diverge from expert human judgments on these tasks, exposing alignment challenges in multimodal reasoning over long, real-world regulatory documents. Beyond benchmarking, the IPO-Dataset enables large-scale analysis of section-level textual variation and cross-industry differences in visual and textual disclosure practices. Our code, dataset, and website are publicly available under CC-BY-4.0.
