A review of silhouette extraction algorithms for use within visual hull pipelines

ASCENSO, Guido, YAP, Moi Hoon, ALLEN, Thomas, CHOPPIN, Simon S. and PAYTON, Carl (2020). A review of silhouette extraction algorithms for use within visual hull pipelines. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 1-22.

Preview

PDF Choppin_ReviewSillhouetteExtraction(AM).pdf - Accepted Version All rights reserved. Download (1MB) | Preview

Abstract

Markerless motion capture would permit the study of human biomechanics in environments where marker-based systems are impractical, e.g. outdoors or underwater. The visual hull tool may enable such data to be recorded, but it requires the accurate detection of the silhouette of the object in multiple camera views. This paper reviews the top-performing algorithms available to date for silhouette extraction, with the visual hull in mind as the downstream application; the rationale is that higher-quality silhouettes would lead to higher-quality visual hulls, and consequently better measurement of movement. This paper is the first attempt in the literature to compare silhouette extraction algorithms that belong to different fields of Computer Vision, namely background subtraction, semantic segmentation, and multi-view segmentation. It was found that several algorithms exist that would be substantial improvements over the silhouette extraction algorithms traditionally used in visual hull pipelines. In particular, FgSegNet v2 (a background subtraction algorithm), DeepLabv3+ JFT (a semantic segmentation algorithm), and Djelouah 2013 (a multi-view segmentation algorithm) are the most accurate and promising methods for the extraction of silhouettes from 2D images to date, and could seamlessly be integrated within a visual hull pipeline for studies of human movement or biomechanics.

Item Type:	Article
Identification Number:	https://doi.org/10.1080/21681163.2020.1790040
Page Range:	1-22
SWORD Depositor:	Symplectic Elements
Depositing User:	Symplectic Elements
Date Deposited:	03 Aug 2020 15:19
Last Modified:	17 Jul 2021 01:18
URI:	https://shura.shu.ac.uk/id/eprint/26853

Actions (login required)

View Item

Downloads

Publication Metrics