Self-organizing kernel-based convolutional echo state network for human action recognition / Lee Gin Chong

Lee , Gin Chong (2022) Self-organizing kernel-based convolutional echo state network for human action recognition / Lee Gin Chong. PhD thesis, Universiti Malaya.

[img] PDF (The Candidate's Agreement)
Restricted to Repository staff only

Download (202Kb)
    [img] PDF (Thesis PhD)
    Restricted to Repository staff only until 31 December 2023.

    Download (3453Kb)


      The research works on three-dimensional (3D)-skeleton-joints-based human action recognition (HAR) remains demanding. Among the approaches, Echo State Networks (ESNs) are a reservoir computing method that considers skeleton joints human actions as multivariate time series and attempts to identify and model the dynamical temporal features in 3D space. Despite the random initialization of the ESN's input and reservoir weights may reduce the computational cost, this may raise instability and variance in generalization and hence diminish reproducibility. Moreover, ESN remains a black-box algorithm. Notably, it lacks explainability consideration to understand the input-dependent reservoir dynamics, specifically while configuring the optimal hyperparameters for HAR. Besides, following the body of Convolutional Echo State Network (ConvESN) work to incorporate modeling dynamics and multiscale temporal feature in handling HAR problem, the model may be very sensitive to the selection of hyperparameters in Convolutional Neural Network (CNN). This work addresses these issues by proposing a novel approach known as Self-Organizing Convolutional Echo State Network (SO-ConvESN) for HAR. Specifically, this work proposes an unsupervised self-organizing network for learning node centroids and interconnectivity maps compatible with the deterministic initialization of ESN reservoir weights. To ensure stability and echo state property (ESP) in the self-organizing reservoir, this work further exploits the Recurrent Plots (RPs) and Recurrence Quantification Analysis (RQA) techniques for explainability and characterization of the dynamics of the self-organizing reservoir and hence tuning two critical ESN hyperparameters: input scaling (

      Item Type: Thesis (PhD)
      Additional Information: Thesis (PhD) – Faculty of Computer Science & Information Technology, Universiti Malaya, 2022.
      Uncontrolled Keywords: Echo state networks; Action recognition; Self-organizing networks; Deep neural networks
      Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
      T Technology > T Technology (General)
      Divisions: Faculty of Computer Science & Information Technology
      Depositing User: Mr Mohd Safri Tahir
      Date Deposited: 07 Jun 2023 02:15
      Last Modified: 07 Jun 2023 02:15

      Actions (For repository staff only : Login required)

      View Item