A parameter leveraging method for unsupervised big data modelling

MWITONDI, Kassim and KHORSHEED, Eman (2016). A parameter leveraging method for unsupervised big data modelling. Journal of Statistics Applications & Probability, 5 (2), 203-211.

Full text not available from this repository.
Official URL: http://dx.doi.org/10.18576/jsap/050201

Abstract

Increasingly sophisticated methods and tools are needed for tracking the dynamics and detecting inherent structures in modern day highly voluminous multi-faceted. Data scientists have long realized that tackling global challenges such as climate change, terrorism and food security cannot be contained within the frameworks and models of conventional data analysis. For example, separating noise from meaningful data in even a low-dimensional data with heavy tails and/or overlaps is quite challenging and standard non-linear approaches do not always succeed. Tracking the dynamics of multi-faceted data involving complex systems is tantamount to tracking agent-based complex systems with many interacting agents. Dimensional-reduction methods are commonly used to try and capture structures inherent in data but they do not generally lead to optimal solutions mainly because their optimisation functions and theoretical methods typically rely on special structures. We propose a parameter leveraging method for unsupervised big data modelling. The method searches for structures in data and creates a series of sub-structures which are subsequently merged or split. The strategy is to present the algorithm with a set of periodic data as one complex system. It then uses the patterns in the sub-structures to determine the overall behaviour of the complex system. Applications on solar magnetic activity cycles and seismic data show that the proposed method out-performs conventional unsupervised methods. We illustrate how the method can be extended to supervised modelling.

Item Type: Article
Research Institute, Centre or Group - Does NOT include content added after October 2018: Cultural Communication and Computing Research Institute > Communication and Computing Research Centre
Departments - Does NOT include content added after October 2018: Faculty of Science, Technology and Arts > Department of Computing
Identification Number: https://doi.org/10.18576/jsap/050201
Page Range: 203-211
Depositing User: Helen Garner
Date Deposited: 28 Jul 2016 15:04
Last Modified: 18 Mar 2021 17:15
URI: https://shura.shu.ac.uk/id/eprint/13047

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics