Embedded Systems

Precise Localization Within the GI Tract by Combining Classification of CNNs and Time-Series Analysis of HMMs

by Julia Werner, Christoph Gerum, Moritz Reiber, Jörg Nick, and Oliver Bringmann
In International Workshop on Machine Learning in Medical Imaging, pages 174–183, 2023.

Keywords: Medical Image Analysis, Wireless Capsule Endoscopy, GI Tract Localization


This paper presents a method to efficiently classify the gastroenterologic section of images derived from Video Capsule Endoscopy (VCE) studies by exploring the combination of a Convolutional Neural Network (CNN) for classification with the time-series analysis properties of a Hidden Markov Model (HMM). It is demonstrated that successive time-series analysis identifies and corrects errors in the CNN output. Our approach achieves an accuracy of 98.04% on the Rhode Island (RI) Gastroenterology dataset. This allows for precise localization within the gastrointestinal (GI) tract while requiring only approximately 1M parameters and thus, provides a method suitable for low power devices.