a Sic%@sdZddlZddlZddlZddlZddlmmZddl m Z ddl m Z ddl mZddl mZddl mZddlmZed ed Zd d d ZddZddZddZddZddZGdddejZeZejddZddZ ejddZ!dS)!zKUtility functions shared between SavedModel saving/loading implementations.N)backend)base_layer_utils)control_flow_util) layer_utils) tf_contextlib) LazyLoader training_libzkeras.engine.trainingFc sVt}t||||\}fdd}tjjj|||d}rNt|S|SdS)aCreates fn that adds the losses returned by call_fn & returns the outputs. Args: layer: A Keras layer object call_fn: tf.function that takes layer inputs (and possibly a training arg), and returns a tuple of (outputs, list of losses). call_spec: The `CallFunctionSpec` for the layer's call function. default_training_value: Default value of the training kwarg. If `None`, the default is `tf.keras.backend.learning_phase()`. return_method: Whether to return a method bound to the layer. Returns: function that calls call_fn and returns the outputs. Losses returned by call_fn are added to the layer losses. csXr|dd}|i|\}}|trTD]}|ur.return_outputs_and_add_losses)targetdecorator_funcdecorator_argspecN)layer_uses_training_boolmaybe_add_training_argr __internal__ decoratormake_decoratortypes MethodType) rcall_fn call_specdefault_training_valuerexpects_training_argarg_specr decoratedrrruse_wrapped_call#s r,cCs\|jr dS|h}t|}|rX|}||vr.qt|ddr>dS|||t|qdS)zLReturns whether this layer or any of its children uses the training arg.T_expects_training_argF)r-list_all_layerspopgetattraddextend)rvisitedto_visitrrrras  rcCs(t|tjr|jSt|jdddSdS)NF) include_self recursive) isinstancerModellayerslistr )objrrrr.ss r.cCs.t|g}|tjddt|D|S)Ncss|]}t|VqdSN)list_all_layers_and_sublayers).0rrrr sz0list_all_layers_and_sublayers..)setupdate itertoolschain from_iterabler.)r;srrrr=|s  r=cs:|s dfStj}t|fdd}||fS)aDecorate call and optionally adds training argument. If a layer expects a training argument, this function ensures that 'training' is present in the layer args or kwonly args, with the default training value. Args: call_spec: CallFunctionSpec of the layer. wrapped_call: Wrapped call function. expects_training_arg: Whether to include 'training' argument. default_training_value: Default value of the training kwarg to include in the arg spec. If `None`, the default is `tf.keras.backend.learning_phase()`. Returns: Tuple of ( function that calls `wrapped_call` and sets the training arg, Argspec of returned function or `None` if the argspec is unchanged) Ncszjddd}Wnty,d}Yn0|durLpJtjpJt}tfddt |fddfd dS) z.wrap_with_training_arg..replace_training_and_callcsdSNTrrrMrrzHmaybe_add_training_arg..wrap_with_training_arg..csdS)NFrrrOrrrPrQ) get_arg_valueKeyErrorr call_contextrFrlearning_phaser:copyr smart_cond)rrrFr'r(rL)rrrMrwrap_with_training_args(     z6maybe_add_training_arg..wrap_with_training_arg)set_training_arg_spec full_argspecrCallFunctionSpec)r'rLr)r(r*rYrrXrr s r cCsd|jvrv|jd}t|j|}|jdur8t|jng}|jrt|j|kr|| dur||| <|j|dSns4       >  @