Search papers, labs, and topics across Lattice.
To eliminate the computational bottlenecks of ill-posed 3D anatomical reconstruction from single radiographs, this work establishes a joint 2D-3D statistical shape model that explicitly learns the co-variation between 2D projections and 3D volumes in a shared latent space. By parameterizing deformations via stationary velocity fields and jointly decomposing them with principal component analysis, the framework replaces slow iterative 3D-to-2D projection loops with direct latent-space coordinate lifting. Evaluated on the NMDID dataset for femoral reconstruction, the model outperforms standard 3D-only shape baselines while accelerating inference 4-fold to under three seconds per subject.
Expensive iterative 3D-to-2D projection loops are entirely unnecessary for anatomical reconstruction: directly learning cross-dimensional deformation co-variation enables sub-3-second 3D mesh lifting from standard radiographs.
Three-dimensional femoral reconstruction from radiographs supports surgical planning, implant sizing, and post-operative follow-up, but remains ill-posed as X-ray projections discard depth information. Existing methods often incorporate a 3D statistical shape model (SSM) as a shape prior to guide reconstructions toward anatomically plausible shapes, relying on iterative 3D-to-2D projection matching. Yet, these approaches are computationally expensive and constrain their SSM to a single dimensionality, leaving the statistical relationship between 2D observations and 3D geometry largely unexploited and unexplored. We instead propose a joint 2D-3D SSM that explicitly captures the co-variation between 2D and 3D segmentations in a shared latent space. During training, 2D and 3D segmentations are registered to a common 3D template and its corresponding 2D projections, and the resulting stationary velocity fields are jointly decomposed using principal component analysis (PCA). This joint modeling allows the 2D-to-3D mapping to be learned directly from data rather than computing correspondences at inference time. For unseen subjects, the 3D shape is recovered directly by lifting the 2D latent coordinates to the 3D PCA subspace, thereby eliminating the need for iterative 3D-to-2D projection. Experiments on NMDID demonstrate that the proposed joint 2D-3D SSM outperforms a widely-used 3D-only SSM baseline while achieving inference approximately 4 times faster, at under 3 seconds per subject. The code is available at: https://github.com/florence-dellaniello-picard/joint2d3d-ssm.
