Proceedings of SPIE

3D echocardiography (3DE) is the standard modality for visualizing heart valves and their surrounding anatomical structures. Commercial cardiovascular ultrasound systems commonly offer a set of parameters that allow clinical users to modify, in real time, visual aspects of the information contained in the echocardiogram. To our knowledge, there is currently no work that demonstrates if the methods currently used by commercial platforms are optimal. In addition, current platforms have limitations in adjusting the visibility of anatomical structures, such as reducing information that obstructs anatomical structures without removing essential clinical information...

Data scarcity and data imbalance are two major challenges in training deep learning models on medical images, such as brain tumor MRI data. The recent advancements in generative artificial intelligence have opened new possibilities for synthetically generating MRI data, including brain tumor MRI scans. This approach can be a potential solution to mitigate the data scarcity problem and enhance training data availability. This work focused on adapting the 2D latent diffusion models to generate 3D multi-contrast brain tumor MRI data with a tumor mask as the condition...

Head and neck squamous cell carcinoma (HNSCC) has a high mortality rate. In this study, we developed a Stokes-vector-derived polarized hyperspectral imaging (PHSI) system for H&E-stained pathological slides with HNSCC and built a dataset to develop a deep learning classification method based on convolutional neural networks (CNN). We use our polarized hyperspectral microscope to collect the four Stokes parameter hypercubes (S0, S1, S2, and S3) from 56 patients and synthesize pseudo-RGB images using a transformation function that approximates the human eye's spectral response to visual stimuli...

Neuroblastoma is the most common type of extracranial solid tumor in children and can often result in death if not treated. High-intensity focused ultrasound (HIFU) is a non-invasive technique for treating tissue that is deep within the body. It avoids the use of ionizing radiation, avoiding long-term side-effects of these treatments. The goal of this project was to develop the rendering component of an augmented reality (AR) system with potential applications for image-guided HIFU treatment of neuroblastoma...

While minimally invasive laparoscopic surgery can help reduce blood loss, reduce hospital time, and shorten recovery time compared to open surgery, it has the disadvantages of limited field of view and difficulty in locating subsurface targets. Our proposed solution applies an augmented reality (AR) system to overlay pre-operative images, such as those from magnetic resonance imaging (MRI), onto the target organ in the user's real-world environment. Our system can provide critical information regarding the location of subsurface lesions to guide surgical procedures in real time...

Biopsies play a crucial role in diagnosis of various diseases including cancers. In this study, we developed an augmented reality (AR) system to improve biopsy procedures and increase targeting accuracy. Our AR-guided biopsy system uses a high-speed motion tracking technology and an AR headset to display a holographic representation of the organ, lesions, and other structures of interest superimposed on real physical objects. The first application of our AR system is prostate biopsy. By incorporating preoperative scans, such as computed tomography (CT) or magnetic resonance imaging (MRI), into real-time ultrasound-guided procedures, this innovative AR-guided system enables clinicians to see the lesion as well as the organs in real time...

During surgery of delicate regions, differentiation between nerve and surrounding tissue is crucial. Hyperspectral imaging (HSI) techniques can enhance the contrast between types of tissue beyond what the human eye can differentiate. Whereas an RGB image captures 3 bands within the visible light range ( e.g., 400 nm to 700 nm), HSI can acquire many bands in wavelength increments that highlight regions of an image across a wavelength spectrum. We developed a workflow to identify nerve tissues from other similar tissues such as fat, bone, and muscle...

Prostate cancer ranks among the most prevalent types of cancer in males, prompting a demand for early detection and noninvasive diagnostic techniques. This paper explores the potential of ultrasound radiofrequency (RF) data to study different anatomic zones of the prostate. The study leverages RF data's capacity to capture nuanced acoustic information from clinical transducers. The research focuses on the peripheral zone due to its high susceptibility to cancer. The feasibility of utilizing RF data for classification is evaluated using ex-vivo whole prostate specimens from human patients...

Energy sensitive and photon counting detectors can provide improved tissue visualization and material quantification capabilities in Cone Beam Computed Tomography (CBCT) systems. However, their implementation in CBCT systems is more challenging, which is in part due to high fluence of scattered X-rays in wide cone angle CBCT geometry. Specifically, high scatter contamination in lower energy spectrum challenges reconstruction of high fidelity CBCT images by using lower energy X-rays. To address this problem, we investigated a robust scatter rejection with 2D antiscatter grids in a benchtop photon counting and compact CBCT system...

Radiomics has been widely recognized for its effectiveness in decoding tumor phenotypes through the extraction of quantitative imaging features. However, the robustness of radiomic methods to estimate clinically relevant biomarkers non-invasively remains largely untested. In this study, we propose Cascaded Data Processing Network (CDPNet), a radiomic feature learning method to predict tumor molecular status from medical images. We apply CDPNet to an epigenetic case, specifically targeting the estimation of O6-methylguanine-DNA-methyltransferase ( MGMT ) promoter methylation from Magnetic Resonance Imaging (MRI) scans of glioblastoma patients...

Glioblastoma (GBM) is the most common and aggressive brain tumor with short overall survival (OS) of about 15 months. Understanding the causal factors affecting the patient survival is crucial for disease prognosis and treatment planning. Although previous efforts on survival prediction using multi-omics data has yielded useful predictive models, the causation of the correlated genetic risk factors has not been addressed. Recent advances in causal deep learning models enable the study of causality from complex dataset...

PURPOSE: To rule out hemorrhage, non-contrast CT (NCCT) scans are used for early evaluation of patients with suspected stroke. Recently, artificial intelligence tools have been developed to assist with determining eligibility for reperfusion therapies by automating measurement of the Alberta Stroke Program Early CT Score (ASPECTS), a 10-point scale with > 7 or ≤ 7 being a threshold for change in functional outcome prediction and higher chance of symptomatic hemorrhage, and hypodense volume...

Coronary CT angiography (cCTA) is a fast non-invasive imaging exam for coronary artery disease (CAD) but struggles with dense calcifications and stents due to blooming artifacts, potentially causing stenosis overestimation. Virtual monoenergetic images (VMIs) at higher keV (e.g., 100 keV) from photon counting detector (PCD) CT have shown promise in reducing blooming artifacts and improving lumen visibility through its simultaneous high-resolution and multi-energy imaging capability. However, most cCTA exams are performed with single-energy CT (SECT) using conventional energy-integrating detectors (EID)...

The world health organization's global tuberculosis (TB) report for 2022 identifies TB, with an estimated 1.6 million, as a leading cause of death. The number of new cases has risen since 2020, particularly the number of new drug-resistant cases, estimated at 450,000 in 2021. This is concerning, as treatment of patients with drug resistant TB is complex and may not always be successful. The NIAID TB Portals program is an international consortium with a primary focus on patient centric data collection and analysis for drug resistant TB...

Coronary computed tomography angiography (cCTA) is a widely used non-invasive diagnostic exam for patients with coronary artery disease (CAD). However, most clinical CT scanners are limited in spatial resolution from use of energy-integrating detectors (EIDs). Radiological evaluation of CAD is challenging, as coronary arteries are small (3-4 mm diameter) and calcifications within them are highly attenuating, leading to blooming artifacts. As such, this is a task well suited for high spatial resolution. Recently, photon-counting-detector (PCD) CT became commercially available, allowing for ultra-high resolution (UHR) data acquisition...

The Channelized Hotelling observer (CHO) is well correlated with human observer performance in many CT detection/classification tasks but has not been widely adopted in routine CT quality control and performance evaluation, mainly because of the lack of an easily available, efficient, and validated software tool. We developed a highly automated solution - CT image quality evaluation and Protocol Optimization (CTPro), a web-based software platform that includes CHO and other traditional image quality assessment tools such as modulation transfer function and noise power spectrum...

Deep learning-based image reconstruction and noise reduction (DLIR) methods have been increasingly deployed in clinical CT. Accurate assessment of their data uncertainty properties is essential to understand the stability of DLIR in response to noise. In this work, we aim to evaluate the data uncertainty of a DLIR method using real patient data and a virtual imaging trial framework and compare it with filtered-backprojection (FBP) and iterative reconstruction (IR). The ensemble of noise realizations was generated by using a realistic projection domain noise insertion technique...

Dual-energy computed tomography (DECT) enables material decomposition for tissues and produces additional information for PET/CT imaging to potentially improve the characterization of diseases. PET-enabled DECT (PDECT) allows the generation of PET and DECT images simultaneously with a conventional PET/CT scanner without the need for a second x-ray CT scan. In PDECT, high-energy <mml:math xmlns:mml="https://www.w3.org/1998/Math/MathML"><mml:mstyle><mml:mi>γ</mml:mi></mml:mstyle></mml:math>-ray CT (GCT) images at 511 keV are obtained from time-of-flight (TOF) PET data and are combined with the existing x-ray CT images to form DECT imaging...

Minimally invasive surgery (MIS) has expanded broadly in the field of abdominal and pelvic surgery. However, there are still prevalent issues surrounding intracorporeal surgery, such as iatrogenic injury, anastomotic leakage, or the presence of positive tumor margins after resection. Current approaches to address these issues and advance laparoscopic imaging techniques often involve fluorescence imaging agents, such as indocyanine green (ICG), to improve visualization, but these have drawbacks. Hyperspectral imaging (HSI) is an emerging optical imaging modality that takes advantage of spectral characteristics of different tissues...

Hyperspectral imaging (HSI) technologies have enabled a range of experimental techniques and studies in the fluorescence microscopy field. Unfortunately, a drawback of many HSI microscope platforms is increased acquisition time required to collect images across many spectral bands, as well as signal loss due to the need to filter or disperse emitted fluorescence into many discrete bands. We have previously demonstrated that an alternative approach of scanning the fluorescence excitation spectrum can greatly improve system efficiency by decreasing light losses associated with emission filtering...