Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces scalable methods for approximating quadratic entropy ($p^T d p$) for arbitrary distributions $p$ and common negative-type distances $d$, specifically Euclidean and spherical geodesic. By employing random feature embeddings and projections, the approach achieves significant computational complexity reduction, further optimized for varying $p$ with constant $d$ through amortization of matrix multiplications and control variates. Empirical validation on Open Graph Benchmark datasets demonstrates superior performance over direct pair sampling in identifying interdisciplinary research patterns.
Random features and projections unlock efficient quadratic entropy estimation for complex distributions and distances, revealing nuanced interdisciplinary research landscapes.
We detail scalable methods for approximating the quadratic entropy $p^T d p$ for arbitrary distributions $p$ and common distances $d$ of negative type. We focus on the Euclidean and spherical geodesic cases, which both use random feature embeddings and projections to dramatically improve computational complexity within a simple framework. Amortization of a single large matrix multiplication and control variates further enable computation at large scale with low memory and runtime in situations where $d$ is held constant while $p$ varies. We demonstrate this with a comparison against direct pair sampling and bibliometric/scientometric examples on Open Graph Benchmark datasets, revealing papers, fields, and institutions with both particularly narrow and broad interdisciplinary reach from their citations and text features alone.