a /Sicã@sÐdZddlZddlmZddlmZedeƒdƒZGdd„deƒZ d)d d „Z d d„Z dd„Z Gdd„deƒZ dd„Zdd„Zdd„Zdd„Zejdd„ƒZdd„Zd*dd „Zd!d"„Zd#d$„Zd%d&„Zd'd(„ZdS)+zGradient tape utilities.éN)Ú pywrap_tfe)Ú LazyLoaderÚdistribution_strategy_contextz:tensorflow.python.distribute.distribution_strategy_contextc@s&eZdZdZdgZdd„Zdd„ZdS)ÚTapez(Represents a gradient propagation trace.Ú_tapecCs ||_dS©N)r)ÚselfÚtape©r úX/var/www/html/django/DPS/env/lib/python3.9/site-packages/tensorflow/python/eager/tape.pyÚ__init__$sz Tape.__init__cCs t |j¡Sr)rÚTFE_Py_TapeWatchedVariablesr©rr r r Úwatched_variables'szTape.watched_variablesN)Ú__name__Ú __module__Ú __qualname__Ú__doc__Ú __slots__r rr r r r rsrFTcCst ||¡}t|ƒS)z&Pushes a new tape onto the tape stack.)rÚTFE_Py_TapeSetNewr)Ú persistentZwatch_accessed_variablesr r r r Ú push_new_tape+s rcCst |j¡dS)z,Pushes an existing tape onto the tape stack.N)rÚTFE_Py_TapeSetAddr©r r r r Ú push_tape1srcCst |j|¡dS)z2Marks this tensor to be watched by the given tape.N)rÚTFE_Py_TapeWatchr)r Útensorr r r Úwatch6src@s6eZdZdZdgZdd„Zdd„Zdd„Zd d „Zd S) ÚVariableWatchera/A scope that tracks all trainable variable accesses within it. This explicitly ignores variables that are not marked as trainable. Sample usage: var = tf.Variable(0.0) with VariableWatcher() as variable_watcher: var.assign_add(1.0) assert variable_watcher.watched_variables == [var] Ú_variable_watchercCs d|_dSr)rrr r r r KszVariableWatcher.__init__cCst ¡|_|Sr)rÚTFE_Py_VariableWatcherNewrrr r r Ú __enter__Ns zVariableWatcher.__enter__cCst |j¡dSr)rÚTFE_Py_VariableWatcherRemover)rÚtypÚvalueÚ tracebackr r r Ú__exit__RszVariableWatcher.__exit__cCs t |j¡S)z7Returns a tuple of variables accessed under this scope.)rÚ&TFE_Py_VariableWatcherWatchedVariablesrrr r r rUsÿz!VariableWatcher.watched_variablesN) rrrrrr r!r&rr r r r r;s  rcCsPt ¡\}}|r |j |¡g}n | |¡}|D]}t |j|¡t |¡q.dS)z4Marks this variable to be watched by the given tape.N) rÚ get_strategy_and_replica_contextÚextendedÚvalue_containerÚexperimental_local_resultsrÚTFE_Py_TapeWatchVariablerÚ&TFE_Py_VariableWatcherVariableAccessed)r ÚvariableÚstrategyÚcontextÚ variablesÚvarr r r Úwatch_variable[sÿ r3cCsLt ¡\}}|r |j |¡g}n | |¡}|D]}t |¡t |¡q.dS)ztNotifies all tapes in the stack that a variable has been accessed. Args: variable: variable to be watched. N)rr(r)r*r+rÚTFE_Py_TapeVariableAccessedr-)r.r/r0r1r2r r r Úvariable_accessedhsÿ  r5csjt ¡\‰}g}|r(‡fdd„|Dƒ}n |D]}|jr,| ˆ |¡¡q,|D]}t |¡t |¡qLdS)z¼Notifies all tapes in the stack that variables have been accessed. Only trainable variables are marked as accessed. Args: variables: iterable of variables to mark as accessed. csg|]}|jrˆj |¡‘qSr )Ú trainabler)r*)Ú.0r.©r/r r Ú …sÿz&variables_accessed..N)rr(r6Úextendr+rr4r-)r1r0Úaccessedr.r2r r8r Úvariables_accessedys ÿ ÿ r<cCst |j¡dS)z!Pops the given tape in the stack.N)rÚTFE_Py_TapeSetRemoverrr r r Úpop_tape‘sr>ccs>t ¡}z"|st ¡dVW|s:t ¡n|s8t ¡0dS)z7Stop all gradient recording (backprop and forwardprop).N)rÚTFE_Py_TapeSetIsStoppedÚTFE_Py_TapeSetStopOnThreadÚTFE_Py_TapeSetRestartOnThread)Z is_stoppedr r r Ústop_recording–s ÿrBcCs t |¡S)aReturns true if any tape in the stack watches any of these tensors. Only takes GradientTapes into account, not forward accumulators. Args: tensors: Tensors to check, typically inputs to an operation. Returns: Boolean, whether any tape watches any of `tensors`. )rÚ"TFE_Py_TapeSetShouldRecordBackprop)Útensorsr r r Úshould_record_backprop£s rEcCst |||||¡dS)z0Records the operation on all tapes in the stack.N)rÚTFE_Py_TapeSetRecordOperation)Úop_typeÚoutput_tensorsÚ input_tensorsÚbackward_functionZforward_functionr r r Úrecord_operation±sþrKcCst ||||¡dS)z9Records the operation on all backward tapes in the stack.N)rÚ%TFE_Py_TapeSetRecordOperationBackprop)rGrHrIrJr r r Úrecord_operation_backprop_only¹sþrMcCst |||||¡dS)aRecords the operation on all forward accumulators in the stack. Args: op_type: a string for the operation type, used in the backprop code output_tensors: a list of Python Tensor objects output by the operation input_tensors: a list of input Tensors to the recorded operation backward_function: the function to be called to, given the gradients of the output tensors, produce the gradients of the input tensors. This function is automatically transposed to produce output gradients given input gradients. forwardprop_output_indices: indicates any output_tensors which contain JVPs. Typically these will have come from TFE_Py_PackForwardGradients. May be None or an empty sequence if there are no JVP outputs from the operation. N)rÚ(TFE_Py_TapeSetRecordOperationForwardprop)rGrHrIrJZforwardprop_output_indicesr r r Ú!record_operation_forwardprop_onlyÁsþrOcCst |¡dS)z;Deletes traces for this Tensor from all tapes in the stack.N)rÚTFE_Py_TapeSetDeleteTrace)Ú tensor_idr r r Ú delete_trace×srRcCs t ¡ S)z#Returns True if any tape is active.)rÚTFE_Py_TapeSetIsEmptyr r r r Úcould_possibly_recordÜsrT)FT)N)rÚ contextlibÚtensorflow.pythonrÚ"tensorflow.python.util.lazy_loaderrÚglobalsrÚobjectrrrrrr3r5r<r>ÚcontextmanagerrBrErKrMrOrRrTr r r r Ús2  þ    ÿ