An Iterative Method for Canonical Polyadic Decomposition of Tensors
type: CreativeWork
description: The Singular Value Decomposition (SVD) of matrices is widely used in least-squares regression, image and data processing, principal component analysis and many other applications. Often only the larger singular values of the matrix are needed to reconstruct the matrix and those below a given threshold can be neglected, truncating the series for an efficient approximation of the original matrix. For the case of tensors which are higher dimensional counterparts of matrices, such a decomposition is not as straightforward to define and obtain. In particular, an approximate decomposition that can be improved iteratively would be ideal, allowing one to stop the iterations when a desired level of accuracy is reached, without having to compute all components first and then truncate the series. In this work, we develop such an approach. We begin with matrices and first present an iterative approach for finding the singular values and their corresponding left and right vectors for a matrix, starting with the largest singular value in the SVD. We discuss the accuracy and convergence rate of the method, as well as its run-time and performance for ill-conditioned matrices or those with repeated or nearby singular values. Our method generalizes readily to the case of tensors, although in that case it is a Canonical Polyadic Decomposition (CPD) of the tensor that is obtained. The CPD partitions a tensor into a sum of rank-one tensors, similar to SVD for matrices, but without the orthogonality of the resulting vector components. We coin the acronym NOTSVD, which stands for Non-Orthogonal Tensor Singular Value Decomposition, to refer to our novel method. We show examples of applying the method to sample three-dimensional tensors. One such example is the compression of RGB images whose three color components are each a matrix, together forming a three-dimensional tensor. We show that the tensor decomposition is capable of better compression, for the same level of accuracy, than apply…
abstract: The Singular Value Decomposition (SVD) of matrices is widely used in least-squares regression, image and data processing, principal component analysis and many other applications. Often only the larger singular values of the matrix are needed to reconstruct the matrix and those below a given threshold can be neglected, truncating the series for an efficient approximation of the original matrix. For the case of tensors which are higher dimensional counterparts of matrices, such a decomposition is not as straightforward to define and obtain. In particular, an approximate decomposition that can be improved iteratively would be ideal, allowing one to stop the iterations when a desired level of accuracy is reached, without having to compute all components first and then truncate the series. In this work, we develop such an approach. We begin with matrices and first present an iterative approach for finding the singular values and their corresponding left and right vectors for a matrix, starting with the largest singular value in the SVD. We discuss the accuracy and convergence rate of the method, as well as its run-time and performance for ill-conditioned matrices or those with repeated or nearby singular values. Our method generalizes readily to the case of tensors, although in that case it is a Canonical Polyadic Decomposition (CPD) of the tensor that is obtained. The CPD partitions a tensor into a sum of rank-one tensors, similar to SVD for matrices, but without the orthogonality of the resulting vector components. We coin the acronym NOTSVD, which stands for Non-Orthogonal Tensor Singular Value Decomposition, to refer to our novel method. We show examples of applying the method to sample three-dimensional tensors. One such example is the compression of RGB images whose three color components are each a matrix, together forming a three-dimensional tensor. We show that the tensor decomposition is capable of better compression, for the same level of accuracy, than apply…
author: Munayco, Ionela Silviana
keywords: Algorithm, NOTSVD, Tensor Decomposition, Mathematics
date published: 2022-01-01T08:00:00Z
date modified: 2026-07-24T01:39:59Z
provider: Claremont Graduate University
publisher: Networked Digital Library of Theses and Dissertations
type: WebPage
source organization: Claremont Graduate University