A lightweight hybrid CNN-transformer model for smoke removal in laparoscopic surgery images
Abstract
Introduction: In laparoscopic surgery, which is a minimally invasive procedure, endoscopic cameras are very common in visual guidance. Nevertheless, surgical smoke produced during electrocautery and laser ablation greatly impairs the quality of images produced by decreasing contrast, blurring edges, and distorting color data. This deterioration is experienced with both the visibility of the surgeon and computer vision-based surgical assistance system performance. Physics-based and image enhancement models are ineffective due to unrealistic assumptions of the smoke distribution, whereas deep learning methods are typically complicated.
Methods: It is based on the Progressive Frequency-Aware Network (PFAN), which is a lightweight CNN-Transformer hybrid that isolates smoke and tissue signal in the frequency domain. PFAN uses Multi-scale Bottleneck-Inverting (MBI) blocks to restore high-frequency details and Locally-Enhanced Axial Attention Transformer (LAT) blocks to learn global contextual details. In order to improve the quality of reconstruction and structural preservation, we suggest another Hybrid Attention-Residual UNet model that incorporates residual learning and dual attention (channel and spatial attention) to a conditional GAN. To enhance the elimination and localization of smoke compared to PFAN, the suggested hybrid model aims at spatial refinement of features and adaptive weighting of features.
Results: The experimental findings prove that the suggested hybrid…
Read the paper
Related studies
- Learning from First-Generation Qualitative Approaches in the IS Discipline: An Evolutionary View and Some Implications for Authors and Evaluators (PART 1/2)
- Commentary on the clinical and preclinical dosage limits of interstitially administered magnetic fluids for therapeutic hyperthermia based on current practice and efficacy models
- Prosthesis: New Technological Opportunities and Innovative Biomedical Devices
- The history and future of neural modeling for cochlear implants
- Ryanodine receptors: waking up from refractoriness
- Novel Transgenic Rabbit Model Sheds Light on the Puzzling Role of Matrix Metalloproteinase-12 in Atherosclerosis
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.