AI-based association analysis

We developed a novel AI tool to overcome the interpretability and confounding issues in deep-learning-based association analysis.

AI has greatly enhanced medical image analysis, yet its use in epidemiological imaging studies remains limited due to visualization challenges in non-linear models and confounder control. Addressing this, we introduce an AI method emphasizing semantic feature interpretation and resilience against multiple confounders. Our approachโ€™s merits are tested in three scenarios: 1) extracting confounder-free features from a 2D synthetic dataset; 2) assessing the link between prenatal alcohol exposure and childrenโ€™s facial shapes using 3D mesh data; 3) exploring the relationship between global cognition and brain images with a 3D MRI dataset.

The scripts for this project can be found in this Gitlab link.

The distribution of the 2-D latent space for the synthetic images in the test set of Experiment 1, and the eleven reconstructed images sampling along the brightness-related vector, (a) without (i.e., vector ๐‘โƒ—) and (b) with correction (vector ๐‘โˆ—โƒ—) for the confounding of circle radius, together with the predicted brightness ๐‘กฬ‚ (Eq. 6 and Eq. 7). Z1-axis: the first dimension of the latent space; Z2-axis: the second dimension. Each data point in the latent space represents an input image, which is denoted by its radius and brightness. After training, eleven frames were reconstructed by sampling eleven points along the vector ๐‘โƒ— and ๐‘โˆ—โƒ— (Eq. 6, Eq. 7) to visualize the confounding effects.
Association between global cognition and brain images with a 3D MRI dataset. Reconstructed supratentorial modulated grey matter maps using the sampled latent features along the direction of increasing g-factor (a) without correcting for confounders, and (b) with correcting for age, sex, and educational years. The results are generated using the semi-supervised model, averaged over the five folds, and masked out the statistically non-significant region. Color bar shows the direction and magnitude of the changes of GM density.

References

2023

  1. arXiv
    AI-based association analysis for medical imaging using latent-space geometric confounder correction
    arXiv, Nov 2023

2021

  1. miccai 2021
    Projection-Wise Disentangling for Fair and Interpretable Representation Learning. Application to 3D Facial Shape Analysis
    Lecture Notes in Computer Science, Sep 2021