a Sic@@sndZddlZddlmmZddlmZddl m Z ddl m Z ddlmZeddGd d d e jZdS) z"Normalization preprocessing layer.N)backend)base_preprocessing_layer)preprocessing_utils) keras_exportzkeras.layers.Normalizationz5keras.layers.experimental.preprocessing.NormalizationcseZdZdZdfdd ZfddZdfd d Zd d Zd dZddZ ddZ ddZ ddZ fddZ ddZZS) NormalizationaMA preprocessing layer which normalizes continuous features. This layer will shift and scale inputs into a distribution centered around 0 with standard deviation 1. It accomplishes this by precomputing the mean and variance of the data, and calling `(input - mean) / sqrt(var)` at runtime. The mean and variance values for the layer must be either supplied on construction or learned via `adapt()`. `adapt()` will compute the mean and variance of the data and store them as the layer's weights. `adapt()` should be called before `fit()`, `evaluate()`, or `predict()`. For an overview and full list of preprocessing layers, see the preprocessing [guide](https://www.tensorflow.org/guide/keras/preprocessing_layers). Args: axis: Integer, tuple of integers, or None. The axis or axes that should have a separate mean and variance for each index in the shape. For example, if shape is `(None, 5)` and `axis=1`, the layer will track 5 separate mean and variance values for the last axis. If `axis` is set to `None`, the layer will normalize all elements in the input by a scalar mean and variance. Defaults to -1, where the last axis of the input is assumed to be a feature dimension and is normalized per index. Note that in the specific case of batched scalar inputs where the only axis is the batch axis, the default will normalize each index in the batch separately. In this case, consider passing `axis=None`. mean: The mean value(s) to use during normalization. The passed value(s) will be broadcast to the shape of the kept axes above; if the value(s) cannot be broadcast, an error will be raised when this layer's `build()` method is called. variance: The variance value(s) to use during normalization. The passed value(s) will be broadcast to the shape of the kept axes above; if the value(s) cannot be broadcast, an error will be raised when this layer's `build()` method is called. invert: If True, this layer will apply the inverse transformation to its inputs: it would turn a normalized input back into its original form. Examples: Calculate a global mean and variance by analyzing the dataset in `adapt()`. >>> adapt_data = np.array([1., 2., 3., 4., 5.], dtype='float32') >>> input_data = np.array([1., 2., 3.], dtype='float32') >>> layer = tf.keras.layers.Normalization(axis=None) >>> layer.adapt(adapt_data) >>> layer(input_data) Calculate a mean and variance for each index on the last axis. >>> adapt_data = np.array([[0., 7., 4.], ... [2., 9., 6.], ... [0., 7., 4.], ... [2., 9., 6.]], dtype='float32') >>> input_data = np.array([[0., 7., 4.]], dtype='float32') >>> layer = tf.keras.layers.Normalization(axis=-1) >>> layer.adapt(adapt_data) >>> layer(input_data) Pass the mean and variance directly. >>> input_data = np.array([[1.], [2.], [3.]], dtype='float32') >>> layer = tf.keras.layers.Normalization(mean=3., variance=2.) >>> layer(input_data) Use the layer to de-normalize inputs (after adapting the layer). >>> adapt_data = np.array([[0., 7., 4.], ... [2., 9., 6.], ... [0., 7., 4.], ... [2., 9., 6.]], dtype='float32') >>> input_data = np.array([[1., 2., 3.]], dtype='float32') >>> layer = tf.keras.layers.Normalization(axis=-1, invert=True) >>> layer.adapt(adapt_data) >>> layer(input_data) NFc stjfi|tjdd|dur2d}nt|trD|f}nt|}||_ t|t j rft dt|t j rzt d|du|dukrt d ||||_||_||_dS)NrTzJNormalization does not support passing a Variable for the `mean` init arg.zNNormalization does not support passing a Variable for the `variance` init arg.zcWhen setting values directly, both `mean` and `variance` must be set. Got mean: {} and variance: {})super__init__rkeras_kpl_gaugeget_cellset isinstanceinttupleaxistfVariable ValueErrorformat input_meaninput_varianceinvert)selfrmeanvariancerkwargs __class__rd/var/www/html/django/DPS/env/lib/python3.9/site-packages/keras/layers/preprocessing/normalization.pyr ys6    zNormalization.__init__csttttfr4tddDr4tdt t t fddj Drttd j tfddj D_jD]$}|durtd j |qfd dtD_fd dtD_fd dtD_tfd djD}jdurzjd |jddd_jd|jddd_jddtjddd_n\jt|}jt|}t|j}t|j}t |j_!t |j_"dS)Ncss|]}t|tjVqdSN)rr TensorShape).0shaperrr sz&Normalization.build..zNormalization only accepts a single input. If you are passing a python list or tuple as a single input, please convert to a numpy array or `tf.Tensor`.c3s |]}| kp|kVqdSr r)r"andimrrr$zPAll `axis` values must be in the range [-ndim, ndim). Found ndim: `{}`, axis: {}cs g|]}|dkr|n|qS)rrr"dr&rr r(z'Normalization.build..zqAll `axis` values to be kept must have known shape. Got axis: {}, input shape: {}, with unknown axis at index: {}csg|]}|jvr|qSr _keep_axisr)rrrr+r(csg|]}|jvrdndqS)rr,r)r.rrr+scs"g|]}|jvr|ndqS)r/r,r)) input_shaperrrr+sc3s|]}|VqdSr rr))r0rrr$r(rzerosF)namer#dtype initializer trainableronescountr)#r buildrlistrallrrr!as_listlenanyrrsortedr-range _reduce_axisZ_reduce_axis_mask_broadcast_shaper add_weight compute_dtype adapt_meanadapt_varianceint64r7finalize_statenpr6rreshapecastrr)rr0r*Zmean_and_var_shaperrr)r0r'rrr8sx       zNormalization.buildcstj|||ddS)a Computes the mean and variance of values in a dataset. Calling `adapt()` on a `Normalization` layer is an alternative to passing in `mean` and `variance` arguments during layer construction. A `Normalization` layer should always either be adapted over a dataset or passed `mean` and `variance`. During `adapt()`, the layer will compute a `mean` and `variance` separately for each position in each axis specified by the `axis` argument. To calculate a single `mean` and `variance` over the input data, simply pass `axis=None`. In order to make `Normalization` efficient in any distribution context, the computed mean and variance are kept static with respect to any compiled `tf.Graph`s that call the layer. As a consequence, if the layer is adapted a second time, any models using the layer should be re-compiled. For more information see `tf.keras.layers.experimental.preprocessing.PreprocessingLayer.adapt`. `adapt()` is meant only as a single machine utility to compute layer state. To analyze a dataset that cannot fit on a single machine, see [Tensorflow Transform]( https://www.tensorflow.org/tfx/transform/get_started) for a multi-machine, map-reduce solution. Arguments: data: The data to train on. It can be passed either as a `tf.data.Dataset`, or as a numpy array. batch_size: Integer or `None`. Number of samples per state update. If unspecified, `batch_size` will default to 32. Do not specify the `batch_size` if your data is in the form of datasets, generators, or `keras.utils.Sequence` instances (since they generate batches). steps: Integer or `None`. Total number of steps (batches of samples) When training with input tensors such as TensorFlow data tensors, the default `None` is equal to the number of samples in your dataset divided by the batch size, or 1 if that cannot be determined. If x is a `tf.data` dataset, and 'steps' is None, the epoch will run until the input dataset is exhausted. When passing an infinitely repeating dataset, you must specify the `steps` argument. This argument is not supported with array inputs. ) batch_sizestepsN)r adapt)rdatarKrLrrrrMs.zNormalization.adaptc Cs*|jdurtd|j|j|js,td||}t||j j }tj j ||j d\}}tj||jj d}|j rt||j }t|}nd}||j}tj||jdtj||jd}d|} |j | ||} |j|j | d| ||| d|} |j | |j| |j|dS) NzCannot `adapt` a Normalization layer that is initialized with static `mean` and `variance`, you passed mean {} and variance {}.z-`build` must be called before `update_state`.)axes)out_typer/)r3g?)rrrrbuilt RuntimeError_standardize_inputsrrJrDr3nnmomentsr@r#r7gather reduce_prodrCrEassign) rrN batch_meanbatch_variance batch_shapeZbatch_reduce_shape batch_count total_countZ batch_weightZexisting_weightZ total_meanZtotal_variancerrr update_state sB      zNormalization.update_statecCsT|jdus|jsdS|jt|j|jt|j|jt|jdSr ) rrRrDrYr zeros_likerE ones_liker7r.rrr reset_stateLs zNormalization.reset_statecCs`|jdus|jsdSt|j|j|_t|j|j|_t|j |j|_ t|j |j|_ dSr ) rrRrrIrDrArrJrCrErr.rrrrGTs zNormalization.finalize_statecCsf||}t||j}|jr@||jtt|jt S||jtt|jt SdSr ) rTrrJrCrrmaximumsqrtrrepsilonrinputsrrrcall_s   zNormalization.callcCs|Sr r)rr0rrrcompute_output_shapemsz"Normalization.compute_output_shapecCs|Sr r)r input_specrrrcompute_output_signaturepsz&Normalization.compute_output_signaturecs2t}||jt|jt|jd|S)N)rrr)r get_configupdaterutilslistify_tensorsrr)rconfigrrrrlss   zNormalization.get_configcCs(t|}|j|jkr$t||j}|Sr )rconvert_to_tensorr3rCrJrfrrrrT~s  z!Normalization._standardize_inputs)rNNF)NN)__name__ __module__ __qualname____doc__r r8rMr_rbrGrhrirkrlrT __classcell__rrrrrsX' P0,  r)runumpyrHtensorflow.compat.v2compatv2rkerasr keras.enginerZkeras.layers.preprocessingrrn tensorflow.python.util.tf_exportrPreprocessingLayerrrrrrs