Question

我正在实施一个RNN，而不是我发现的例子，它们只减少了最后一步输出的成本

x = tf.placeholder ("float", [features_dimension, None, n_timesteps])
y = tf.placeholder ("float", [labels_dimension, None, n_timesteps])

# Define weights
weights = {'out': tf.Variable (tf.random_normal ([N_HIDDEN, labels_dimension]))}
biases = {'out': tf.Variable (tf.random_normal ([labels_dimension]))}

def RNN (x, weights, biases):
    # Prepare data shape to match `rnn` function requirements
    # Current data input shape: (features_dimension, BATCH_SIZE, n_timesteps)
    # Required shape: `n_timesteps` tensors list of shape (BATCH_SIZE, features_dimension)
    # We make a division of the data to split it in individual vectors that
    # will be fed for each timestep

    # Permuting features_dimension and n_timesteps
    # Shape will be (n_timesteps, BATCH_SIZE, features_dimension)
    x = tf.transpose (x, [2, 1, 0])
    # Reshaping to (BATCH_SIZE*n_timesteps, features_dimension) (we are removing the depth dimension with this)
    x = tf.reshape(x, [BATCH_SIZE*n_timesteps, features_dimension])
    # Split the previous 2D tensor to get a list of `n_timesteps` tensors of
    # shape (batch_size, features_dimension).
    x = tf.split (x, n_timesteps, 0)

    # Define a lstm cell with tensorflow
    lstm_cell = rnn.BasicLSTMCell (N_HIDDEN, forget_bias=1.0)
    # Get lstm cell output
    outputs, states = rnn.static_rnn (lstm_cell, x, dtype=tf.float32)
    # Linear activation; outputs contains the array of outputs for all the
    # timesteps
    pred = tf.matmul (outputs, weights['out']) + biases['out']

但是，对象outputs是包含Tensor元素的n_timesteps列表，因此pred = tf.matmul (outputs, weights['out']) + biases['out']会抛出错误

ValueError：Shape必须是等级2，但对于＆＃39; MatMul＆＃39;是等级3。（OP：输入形状为[100,128,16]，[16,1]。

。我该怎么做这个乘法？

Answer 1

解决方案是将tf.stack张量列表转换为3d张量，然后使用tf.map_fn对每个2d张量沿着维度0应用乘法运算：

    # Transform the list into a 3D tensor with dimensions (n_timesteps, batch_size, N_HIDDEN)
    outputs = tf.stack(outputs)

    def pred_fn(current_output):
        return tf.matmul(current_output, weights['out']) + biases['out']
    # Use tf.map_fn to apply pred_fn to each tensor in outputs, along dimension 0 (timestep dimension)
    pred = tf.map_fn(pred_fn, outputs)

如何在TensorFlow中通过单张量乘以张量列表？

1 个答案: