Search papers, labs, and topics across Lattice.
This paper introduces LiftXR, a novel framework for reconstructing CT volumes from bi-planar X-ray images by first establishing a 3D anatomical layout, which significantly enhances the accuracy of intensity estimation. The method interleaves geometry-guided layout recovery with intensity rendering, allowing for a more structured approach to the inherently ambiguous problem of X-ray-to-CT reconstruction. Experimental results on two public datasets show that LiftXR not only sets a new state of the art in reconstruction performance but also improves downstream segmentation tasks, indicating better anatomical fidelity.
Establishing a 3D anatomical layout from X-rays dramatically enhances CT reconstruction accuracy, outperforming existing methods and improving downstream segmentation.
X-ray imaging can be approximately modeled as the projection of an underlying volumetric attenuation field, with each measurement recording the accumulated attenuation along a corresponding ray path. Reconstructing a CT volume from only a few X-ray views is therefore severely ill-posed, as the projections collapse depth information and leave 3D locations of anatomical regions and their corresponding intensity distributions highly entangled and ambiguous. We observe that once the spatial organization of anatomical regions is established, estimating their CT intensities becomes substantially more tractable. Motivated by this, we propose LiftXR, an interleaved, geometry-guided framework that explicitly incorporates spatial layout recovery into CT reconstruction. Specifically, a layout lifter first generates a 3D anatomical layout from bi-planar X-rays, providing spatial guidance for an intensity renderer to reconstruct a CT volume. An anatomical parser then performs volumetric perception on the reconstruction, exploiting its spatially resolved boundary and intensity cues to recover a refined anatomical layout. This transition from projection-conditioned layout generation to reconstruction-conditioned anatomical perception allows the parsed layout to provide feedback for region-specific intensity calibration. Extensive experiments on two public datasets demonstrate that LiftXR consistently outperforms recent X-ray-to-CT reconstruction methods, establishing a new state of the art. Moreover, the reconstructed CT achieves superior performance in external downstream segmentation, indicating improved anatomical fidelity. Code will be released.
