A review of silhouette extraction algorithms for use within visual hull pipelines

ASCENSO, Guido, YAP, Moi Hoon, ALLEN, Thomas, CHOPPIN, Simon S. and PAYTON, Carl (2020). A review of silhouette extraction algorithms for use within visual hull pipelines. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 1-22.

[img] PDF
Choppin_ReviewSillhouetteExtraction(AM).pdf - Accepted Version
Restricted to Repository staff only until 17 July 2021.
All rights reserved.

Download (1MB)
Official URL: https://www.tandfonline.com/doi/full/10.1080/21681...
Link to published version:: https://doi.org/10.1080/21681163.2020.1790040
Related URLs:

    Abstract

    Markerless motion capture would permit the study of human biomechanics in environments where marker-based systems are impractical, e.g. outdoors or underwater. The visual hull tool may enable such data to be recorded, but it requires the accurate detection of the silhouette of the object in multiple camera views. This paper reviews the top-performing algorithms available to date for silhouette extraction, with the visual hull in mind as the downstream application; the rationale is that higher-quality silhouettes would lead to higher-quality visual hulls, and consequently better measurement of movement. This paper is the first attempt in the literature to compare silhouette extraction algorithms that belong to different fields of Computer Vision, namely background subtraction, semantic segmentation, and multi-view segmentation. It was found that several algorithms exist that would be substantial improvements over the silhouette extraction algorithms traditionally used in visual hull pipelines. In particular, FgSegNet v2 (a background subtraction algorithm), DeepLabv3+ JFT (a semantic segmentation algorithm), and Djelouah 2013 (a multi-view segmentation algorithm) are the most accurate and promising methods for the extraction of silhouettes from 2D images to date, and could seamlessly be integrated within a visual hull pipeline for studies of human movement or biomechanics.

    Item Type: Article
    Identification Number: https://doi.org/10.1080/21681163.2020.1790040
    Page Range: 1-22
    SWORD Depositor: Symplectic Elements
    Depositing User: Symplectic Elements
    Date Deposited: 03 Aug 2020 15:19
    Last Modified: 03 Aug 2020 15:30
    URI: http://shura.shu.ac.uk/id/eprint/26853

    Actions (login required)

    View Item View Item

    Downloads

    Downloads per month over past year

    View more statistics