Question

I am training 1000 images of 28x28 size. But before training, I am performing ZCA whitening on my data by taking the reference from How to implement ZCA Whitening? Python.

Since I have 1000 data images of size 28x28, after flattening, it becomes 1000x784. But as given in the code below, whether X is my image dataset of 1000x784?

If it is so, then it means the ZCAMatrix size is 1000x1000. In this case, for prediction I have a image of size 28x28, or we can say, size of 1x784.So it doesn't make sense to multiply ZCAMatrix to the image.

So I think, X is the transpose of image data set. Am I right? If I am right, then the size of ZCAMatrix is 784x784.

Now how should I calculate the ZCA whitened image, whether I should use np.dot(ZCAMatrix, transpose_of_image_to_be_predict) or np.dot(image_to_be_predict, ZCAMatrix)? Suggestion would be greatly appreciate.

def zca_whitening_matrix(X):
    """
    Function to compute ZCA whitening matrix (aka Mahalanobis whitening).
    INPUT:  X: [M x N] matrix.
        Rows: Variables
        Columns: Observations
    OUTPUT: ZCAMatrix: [M x M] matrix
    """
    # Covariance matrix [column-wise variables]: Sigma = (X-mu)' * (X-mu) / N
    sigma = np.cov(X, rowvar=True) # [M x M]
    # Singular Value Decomposition. X = U * np.diag(S) * V
    U,S,V = np.linalg.svd(sigma)
        # U: [M x M] eigenvectors of sigma.
        # S: [M x 1] eigenvalues of sigma.
        # V: [M x M] transpose of U
    # Whitening constant: prevents division by zero
    epsilon = 1e-5
    # ZCA Whitening matrix: U * Lambda * U'
    ZCAMatrix = np.dot(U, np.dot(np.diag(1.0/np.sqrt(S + epsilon)), U.T)) # [M x M]
    return ZCAMatrix

And an example of the usage:

X = np.array([[0, 2, 2], [1, 1, 0], [2, 0, 1], [1, 3, 5], [10, 10, 10] ]) # Input: X [5 x 3] matrix
ZCAMatrix = zca_whitening_matrix(X) # get ZCAMatrix
ZCAMatrix # [5 x 5] matrix
xZCAMatrix = np.dot(ZCAMatrix, X) # project X onto the ZCAMatrix
xZCAMatrix # [5 x 3] matrix

Answer 1

我从Keras代码here获得了参考资料。

很明显，在我的情况下，协方差矩阵将给出784x784矩阵，其中执行奇异值分解。它提供3个矩阵用于计算 principal_components ， principal_components 用于查找ZCA白化数据。

现在我的问题是

我应该如何计算ZCA白化图像，我是否应该使用 np.dot（ZCAMatrix，transpose_of_image_to_be_predict）或 np.dot（image_to_be_predict，ZCAMatrix）？建议会很大升值。

为此，我从here获得了参考资料。

在这里，我需要使用np.dot(image_to_be_predict, ZCAMatrix)来计算ZCA白化图像。

ZCA whitening in python for Machine learning

1 个答案: