Current state of radiomic research in pancreatic cancer: focusing on study design and reproducibility of findings

Objectives: To critically appraise methodology and reproducibility of published studies on CT radiomics of pancreatic ductal adenocarcinoma (PDAC). Methods: PRISMA literature search of MEDLINE, PubMed, and Scopus databases was conducted from June to August 2022 relating to CT radiomics human research articles pertaining to PDAC diagnosis, treatment, and/ or prognosis, utilising Image Biomarker Standardisation Initiative-compliant (IBSI) radiomic software. Keyword search included [pancreas OR pancreatic] AND [radiomic OR [quantitative AND imaging] OR [texture AND analysis]]. Analysis included cohort size, CT protocol used, radiomic feature (RF) extraction, segmentation, and selection, software used, outcome correlation, and statistical methodology, with focus on reproducibility. Results: Initial search yielded 1112 articles; however, only 12 articles met all inclusion/exclusion criteria. Cohort sizes ranged from 37 to 352 (median = 106, mean = 155.8). CT slice thickness varied among studies (4 using ≤ 1 mm, 5 using > 1 to 3 mm, 2 using > 3 to 5 mm, 1 not specifying). CT protocol varied (5 using a single portal-venous (pv)-phase, 5 using a pancreas protocol, 1 study using a non-contrast protocol). RF extraction and segmentation were heterogeneous (RF extraction: 5 using pv-phase, 2 using late arterial, 4 using multi-phase, 1 using non-contrast phase; RF selection: 3 pre-selected, 9 software-selected). 2D/3D RF segmentation was diverse (2D in 6, 3D in 4, 2D and 3D in 2 studies). Six different radiomics software were used. Research questions and cohort characteristics varied, ultimately leading to non-comparable outcome results. Conclusion: The current twelve published IBSI-compliant PDAC radiomic studies show high variability and often incomplete methodology resulting in low robustness and reproducibility. Clinical relevance statement: Radiomics research requires IBSI compliance, data harmonisation, and reproducible feature extraction methods for non-invasive imaging biomarker discoveries to be valid. This will ensure a successful clinical implementation and ultimately an improvement of patient outcomes as part of precision and personalised medicine. Key Points: • Current state of radiomics research in pancreatic cancer shows low software compliance to the Image Biomarker Standardisation Initiative (IBSI). • IBSI-compliant radiomics studies in pancreatic cancer are heterogeneous and not comparable, and the majority of study designs showed low reproducibility. • Improved methodology and standardisation of practice in the emerging field of radiomics has the potential of this non-invasive imaging biomarker in the management of pancreatic cancer.