AIDA

Explainable multimodal deep learning for personalized oncology, with a focus on robust fusion, missing modalities, and clinical validation in non-small cell lung cancer.

AIDA

Clinical Application

AIDA

Explainable multimodal deep learning for personalized oncology, with a focus on robust fusion, missing modalities, and clinical validation in non-small cell lung cancer.

Multimodal Deep Learning Explainable AI Personalized Oncology

Overview

AIDA develops explainable multimodal deep learning for healthcare scenarios where single-modality pipelines are not enough. The project investigates when and how to fuse heterogeneous evidence, how to learn stronger shared representations, and how to maintain robustness when data are incomplete or some modalities are missing.

The translational application is personalized oncology in non-small cell lung cancer, where radiomic, pathomic, and electronic health record data are combined to predict response, relapse, progression-free survival, and overall survival. The project also studies clinical trust through explainability mechanisms designed for physicians and domain experts.

Research Directions

  • Multimodal representation learning across radiomics, pathomics, and electronic health records.
  • Explainable AI methods for attention, counterfactual reasoning, and user-facing clinical transparency.
  • Prospective validation in non-small cell lung cancer with comparison against conventional clinical markers.

Related Publications

  1. Handling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancer
    Filippo Ruffini, Camillo Maria Caruso, Claudia Tacconi, Lorenzo Nibid, Francesca Miccolis, Marta Lovino, Carlo Greco, Edy Ippolito, Michele Fiore, Alessio Cortellini, and 9 more authors
    2026
    multimodal learning clinical prediction medical imaging
    AIDA digilung
  2. Predicting lung cancer survival with attention-based CT slices combination
    Domenico Paolo, Carlo Greco, Edy Ippolito, Michele Fiore, Sara Ramella, Paolo Soda, Matteo Tortora, Alessandro Bria, and Rosa Sicilia
    2026
  3. Not another imputation method: A transformer-based model for missing values in tabular datasets
    Camillo Maria Caruso, Paolo Soda, and Valerio Guarrasi
    2026
    multimodal learning clinical prediction foundation models
  4. Next-Gen Health: from Multimodal AI to Foundation Models
    Rosa Sicilia, Fatih Aksu, Alessandro Bria, Alice Natalina Caragliano, Camillo Maria Caruso, Ermanno Cordelli, Arianna Francesconi, Valerio Guarrasi, Giulio Iannello, Guido Manni, and 8 more authors
    2025
    foundation models generative AI multimodal learning medical imaging
  5. Hierarchical embedding attention for overall survival prediction in lung cancer from unstructured EHRs
    Domenico Paolo, Carlo Greco, Alessio Cortellini, Sara Ramella, Paolo Soda, Alessandro Bria, and Rosa Sicilia
    2025
    oncology foundation models generative AI
  6. Benchmarking GAN-Based vs Classical Data Augmentation on Biomedical Images
    Massimiliano Mantegna, Lorenzo Tronchin, Matteo Tortora, and Paolo Soda
    2025
  7. Medicine Without Boundaries: Generative AI for Translating Medical Data Across Modalities
    Valerio Guarrasi, Francesco Di Feola, Giulio Iannello, Irene Iele, Linlin Shen, Massimiliano Mantegna, Daniele Molino, Elena Mulero Ayllon, Ludovica Pompilio, Aurora Rofena, and 4 more authors
    2025
    generative AI multimodal learning foundation models medical imaging
  8. A systematic review of intermediate fusion in multimodal deep learning for biomedical applications
    Valerio Guarrasi, Fatih Aksu, Camillo Maria Caruso, Francesco Di Feola, Aurora Rofena, Filippo Ruffini, and Paolo Soda
    2025
    multimodal learning
  9. Multi-scale texture loss for CT denoising with GANs
    Francesco Di Feola, Lorenzo Tronchin, Valerio Guarrasi, and Paolo Soda
    2025
    generative AI radiomics
  10. Transformer-based AI approach to unravel long-term, time-dependent prognostic complexity in patients with advanced NSCLC and PD-L1 ≥50%: insights from the pembrolizumab 5-year global registry
    Alessio Cortellini, Valentina Santo, Leonardo Brunetti, Edoardo Garbo, David J Pinato, Giulia La Cava, Jarushka Naidoo, Artur Katz, Monica Loza, Joel W Neal, and 90 more authors
    2025
    clinical prediction oncology explainability
  11. MARIA: A multimodal transformer model for incomplete healthcare data
    Camillo Maria Caruso, Paolo Soda, and Valerio Guarrasi
    2025
    multimodal learning foundation models clinical prediction
  12. Can Foundation Models Really Segment Tumors? A Benchmarking Odyssey in Lung CT Imaging
    Elena Mulero Ayllón, Massimiliano Mantegna, Linlin Shen, Paolo Soda, Valerio Guarrasi, and Matteo Tortora
    2025
    foundation models medical imaging
  13. Multi-stage intermediate fusion for multimodal learning to classify non-small cell lung cancer subtypes from CT and PET
    Fatih Aksu, Fabrizia Gelardi, Arturo Chiti, and Paolo Soda
    2025
    radiomics oncology multimodal learning
  14. Exploring Negated Entites for Named Entity Recognition in Italian Lung Cancer Clinical Reports
    Domenico Paolo, Alessandro Bria, Carlo Greco, Marco Russano, Sara Ramella, Paolo Soda, and Rosa Sicilia
    2024
  15. A deep learning approach for overall survival prediction in lung cancer with missing values
    Camillo Maria Caruso, Valerio Guarrasi, Sara Ramella, and Paolo Soda
    2024
    clinical prediction oncology
  16. Towards AI-driven Next Generation Personalized Healthcare and Well-being
    Fatih Aksu, Alessandro Bria, Alice Natalina Caragliano, Camillo Maria Caruso, Wenting Chen, Ermanno Cordelli, Omar Coser, Arianna Francesconi, Leonardo Furia, Valerio Guarrasi, and 13 more authors
    2024
    medical imaging multimodal learning generative AI clinical prediction
  17. Toward a Multimodal Deep Learning Approach for Histological Subtype Classification in NSCLC
    Fatih Aksu, Fabrizia Gelardi, Arturo Chiti, and Paolo Soda
    2024
    oncology multimodal learning medical imaging
  18. Virtual Scanner: Leveraging Resilient Generative AI for Radiological Imaging in the Era of Medical Digital Twins
    Carolina Adornato, Cecilia Assolito, Ermanno Cordelli, Francesco Di Feola, Valerio Guarrasi, Giulio Iannello, Lorenzo Marcoccia, Elena Mulero Ayllon, Rebecca Restivo, Aurora Rofena, and 4 more authors
    2024
    medical imaging generative AI multimodal learning clinical prediction
  19. Named Entity Recognition in Italian Lung Cancer Clinical Reports using Transformers
    Domenico Paolo, Alessandro Bria, Carlo Greco, Marco Russano, Sara Ramella, Paolo Soda, and Rosa Sicilia
    2023
    oncology foundation models medical imaging
  20. Mask-Aware Transformers Enable Robust Learning from Incomplete Volumetric Medical Imaging
    Camillo Maria Caruso, Riccardo Bruni, and Valerio Guarrasi