Search papers, labs, and topics across Lattice.
This study integrates large language models (LLMs) as synthetic clinical experts to enhance the modeling of longitudinal rare-disease data, specifically targeting spinal muscular atrophy (SMA). By querying LLMs on patient observations to derive clinical judgments, the researchers developed a variational-autoencoder-based approach that incorporates these insights into the model fitting process, significantly improving the preservation of clinical interpretations. The results showed a reduction in disagreement between original and reconstructed SMA type labels from 11% to 7%, demonstrating the effectiveness of LLMs in improving clinical representation and predictive accuracy in rare-disease modeling.
Reducing clinical label disagreement by 36% reveals how LLMs can transform rare-disease modeling by embedding expert knowledge directly into representation learning.
Due to the limited amount of information, modeling longitudinal rare-disease data can benefit from integrating clinical knowledge. Yet, elicitation of expert knowledge and formalization for model fitting is challenging, in particular due to limited time of clinical experts. To nevertheless make domain knowledge accessible during model fitting, we use large language models (LLMs) as synthetic clinical experts to supervise a variational-autoencoder-based approach that learns low-dimensional latent summaries of visit-level observations. Specifically, LLMs are queried offline on textual descriptions of patient observations to obtain judgments, e.g., the suspected clinical category. To improve the variational autoencoder fit, we train a differentiable surrogate model on these judgments and augment the loss function to encourage reconstructions that preserve the clinical-label distribution of their corresponding input profile. In an application to longitudinal motor-function assessments from children with spinal muscular atrophy, we map visit-level clinical profiles to low-dimensional representations that are linked by a multivariate mixed-effects model. The synthetic expert loss discourages reconstructions that remain numerically close in data space but alter the clinical interpretation of the reconstructed motor function profile, such as by crossing a disease-type boundary. We thus reduced disagreement between original and reconstructed SMA type labels from about 11 to 7 percent. Furthermore, informing the latent representation by the synthetic expert improved prediction of motor function milestones compared with unsupervised latent representations and a data-level baseline. These results suggest that incorporating LLMs into model fitting can make clinical knowledge available to representation learning and improve clinical faithfulness for longitudinal rare-disease data.
