a SicW=@sdZddlmZddlmZddlmZddlmZddlmZddlm Z ddlm Z dd l m Z dd l mZdd lmZed gd Gddde jZedgd Gddde ZdS)z Long Short-Term Memory V1 layer.) activations) constraints) initializers) regularizers) InputSpec)lstm) rnn_utils)RNN) tf_logging) keras_exportzkeras.layers.LSTMCell)v1cs"eZdZdZd fd d ZZS) LSTMCellaW Cell class for the LSTM layer. Args: units: Positive integer, dimensionality of the output space. activation: Activation function to use. Default: hyperbolic tangent (`tanh`). If you pass `None`, no activation is applied (ie. "linear" activation: `a(x) = x`). recurrent_activation: Activation function to use for the recurrent step. Default: hard sigmoid (`hard_sigmoid`). If you pass `None`, no activation is applied (ie. "linear" activation: `a(x) = x`). use_bias: Boolean, whether the layer uses a bias vector. kernel_initializer: Initializer for the `kernel` weights matrix, used for the linear transformation of the inputs. recurrent_initializer: Initializer for the `recurrent_kernel` weights matrix, used for the linear transformation of the recurrent state. bias_initializer: Initializer for the bias vector. unit_forget_bias: Boolean. If True, add 1 to the bias of the forget gate at initialization. Setting it to true will also force `bias_initializer="zeros"`. This is recommended in [Jozefowicz et al., 2015]( http://www.jmlr.org/proceedings/papers/v37/jozefowicz15.pdf) kernel_regularizer: Regularizer function applied to the `kernel` weights matrix. recurrent_regularizer: Regularizer function applied to the `recurrent_kernel` weights matrix. bias_regularizer: Regularizer function applied to the bias vector. kernel_constraint: Constraint function applied to the `kernel` weights matrix. recurrent_constraint: Constraint function applied to the `recurrent_kernel` weights matrix. bias_constraint: Constraint function applied to the bias vector. dropout: Float between 0 and 1. Fraction of the units to drop for the linear transformation of the inputs. recurrent_dropout: Float between 0 and 1. Fraction of the units to drop for the linear transformation of the recurrent state. Call arguments: inputs: A 2D tensor. states: List of state tensors corresponding to the previous timestep. training: Python boolean indicating whether the layer should behave in training mode or in inference mode. Only relevant when `dropout` or `recurrent_dropout` is used. tanh hard_sigmoidTglorot_uniform orthogonalzerosNc sBtj|f|||||||| | | | | ||||ddd|dS)Nimplementation) activationrecurrent_activationuse_biaskernel_initializerrecurrent_initializerbias_initializerunit_forget_biaskernel_regularizerrecurrent_regularizerbias_regularizerkernel_constraintrecurrent_constraintbias_constraintdropoutrecurrent_dropoutr)super__init__pop)selfunitsrrrrrrrrrrr r!r"r#r$kwargs __class__T/var/www/html/django/DPS/env/lib/python3.9/site-packages/keras/layers/rnn/lstm_v1.pyr&Ts, zLSTMCell.__init__)rrTrrrTNNNNNNrr)__name__ __module__ __qualname____doc__r& __classcell__r-r-r+r.r s"5r zkeras.layers.LSTMcseZdZdZd5fd d Zd6fd d ZeddZeddZeddZ eddZ eddZ eddZ eddZ eddZedd Zed!d"Zed#d$Zed%d&Zed'd(Zed)d*Zed+d,Zed-d.Zed/d0Zfd1d2Zed3d4ZZS)7LSTMaTLong Short-Term Memory layer - Hochreiter 1997. Note that this cell is not optimized for performance on GPU. Please use `tf.compat.v1.keras.layers.CuDNNLSTM` for better performance on GPU. Args: units: Positive integer, dimensionality of the output space. activation: Activation function to use. Default: hyperbolic tangent (`tanh`). If you pass `None`, no activation is applied (ie. "linear" activation: `a(x) = x`). recurrent_activation: Activation function to use for the recurrent step. Default: hard sigmoid (`hard_sigmoid`). If you pass `None`, no activation is applied (ie. "linear" activation: `a(x) = x`). use_bias: Boolean, whether the layer uses a bias vector. kernel_initializer: Initializer for the `kernel` weights matrix, used for the linear transformation of the inputs.. recurrent_initializer: Initializer for the `recurrent_kernel` weights matrix, used for the linear transformation of the recurrent state. bias_initializer: Initializer for the bias vector. unit_forget_bias: Boolean. If True, add 1 to the bias of the forget gate at initialization. Setting it to true will also force `bias_initializer="zeros"`. This is recommended in [Jozefowicz et al., 2015]( http://www.jmlr.org/proceedings/papers/v37/jozefowicz15.pdf). kernel_regularizer: Regularizer function applied to the `kernel` weights matrix. recurrent_regularizer: Regularizer function applied to the `recurrent_kernel` weights matrix. bias_regularizer: Regularizer function applied to the bias vector. activity_regularizer: Regularizer function applied to the output of the layer (its "activation"). kernel_constraint: Constraint function applied to the `kernel` weights matrix. recurrent_constraint: Constraint function applied to the `recurrent_kernel` weights matrix. bias_constraint: Constraint function applied to the bias vector. dropout: Float between 0 and 1. Fraction of the units to drop for the linear transformation of the inputs. recurrent_dropout: Float between 0 and 1. Fraction of the units to drop for the linear transformation of the recurrent state. return_sequences: Boolean. Whether to return the last output in the output sequence, or the full sequence. return_state: Boolean. Whether to return the last state in addition to the output. go_backwards: Boolean (default False). If True, process the input sequence backwards and return the reversed sequence. stateful: Boolean (default False). If True, the last state for each sample at index i in a batch will be used as initial state for the sample of index i in the following batch. unroll: Boolean (default False). If True, the network will be unrolled, else a symbolic loop will be used. Unrolling can speed-up a RNN, although it tends to be more memory-intensive. Unrolling is only suitable for short sequences. time_major: The shape format of the `inputs` and `outputs` tensors. If True, the inputs and outputs will be in shape `(timesteps, batch, ...)`, whereas in the False case, it will be `(batch, timesteps, ...)`. Using `time_major = True` is a bit more efficient because it avoids transposes at the beginning and end of the RNN calculation. However, most TensorFlow data is batch-major, so by default this function accepts input and emits output in batch-major form. Call arguments: inputs: A 3D tensor. mask: Binary tensor of shape `(samples, timesteps)` indicating whether a given timestep should be masked. An individual `True` entry indicates that the corresponding timestep should be utilized, while a `False` entry indicates that the corresponding timestep should be ignored. training: Python boolean indicating whether the layer should behave in training mode or in inference mode. This argument is passed to the cell when calling it. This is only relevant if `dropout` or `recurrent_dropout` is used. initial_state: List of initial state tensors to be passed to the first call of the cell. rrTrrrNrFc s|dd}|dkrtdd|vr6d|di}ni}t|f|||||||| | | | ||||||d|ddd |}tj|f|||||d |t| |_t d d g|_ dS) Nrrrzm`implementation=0` has been deprecated, and now defaults to `implementation=1`.Please update your layer call.enable_caching_devicedtype trainableT)rrrrrrrrrrr r!r"r#r$rr6r7)return_sequences return_state go_backwardsstatefulunroll)ndim) r'loggingwarningr getr%r&ractivity_regularizerr input_spec)r(r)rrrrrrrrrrrBr r!r"r#r$r8r9r:r;r<r*r cell_kwargscellr+r-r.r&s\    z LSTM.__init__cstj||||dS)N)masktraining initial_state)r%call)r(inputsrFrGrHr+r-r.rIsz LSTM.callcCs|jjSN)rEr)r(r-r-r.r)#sz LSTM.unitscCs|jjSrK)rErrLr-r-r.r'szLSTM.activationcCs|jjSrK)rErrLr-r-r.r+szLSTM.recurrent_activationcCs|jjSrK)rErrLr-r-r.r/sz LSTM.use_biascCs|jjSrK)rErrLr-r-r.r3szLSTM.kernel_initializercCs|jjSrK)rErrLr-r-r.r7szLSTM.recurrent_initializercCs|jjSrK)rErrLr-r-r.r;szLSTM.bias_initializercCs|jjSrK)rErrLr-r-r.r?szLSTM.unit_forget_biascCs|jjSrK)rErrLr-r-r.rCszLSTM.kernel_regularizercCs|jjSrK)rErrLr-r-r.rGszLSTM.recurrent_regularizercCs|jjSrK)rErrLr-r-r.rKszLSTM.bias_regularizercCs|jjSrK)rEr rLr-r-r.r OszLSTM.kernel_constraintcCs|jjSrK)rEr!rLr-r-r.r!SszLSTM.recurrent_constraintcCs|jjSrK)rEr"rLr-r-r.r"WszLSTM.bias_constraintcCs|jjSrK)rEr#rLr-r-r.r#[sz LSTM.dropoutcCs|jjSrK)rEr$rLr-r-r.r$_szLSTM.recurrent_dropoutcCs|jjSrK)rErrLr-r-r.rcszLSTM.implementationcs|jt|jt|j|jt|jt|jt|j |j t |j t |j t |jt |jt|jt|jt|j|j|j|jd}|t|jt}|d=tt|t|S)N)r)rrrrrrrrrrrBr r!r"r#r$rrE) r)r serializerrrrrrrrrrrrrBrr r!r"r#r$rupdater config_for_enable_caching_devicerEr% get_configdictlistitems)r(config base_configr+r-r.rPgsJ     " zLSTM.get_configcCs*d|vr|ddkrd|d<|fi|S)Nrrrr-)clsrTr-r-r. from_configszLSTM.from_config)rrTrrrTNNNNNNNrrFFFFF)NNN)r/r0r1r2r&rIpropertyr)rrrrrrrrrrr r!r"r#r$rrP classmethodrWr3r-r-r+r.r4~szXI                  (r4N)r2kerasrrrrkeras.engine.input_specrkeras.layers.rnnrrkeras.layers.rnn.base_rnnr tensorflow.python.platformr r? tensorflow.python.util.tf_exportr r r4r-r-r-r.s           ]