a d=icw@sdZddlZddlZddlZddlZddlmZddlmZddlm Z ddlm Z ddl m Z ddl mZdd l mZdd l mZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlmZddlmZdZdZdZ e!Z"Gddde#Z$d8ddZ%ddZ&Gddde'Z(Gddde'Z)Gd d!d!e'Z*Gd"d#d#e+Z,Gd$d%d%e#Z-Gd&d'd'e#Z.Gd(d)d)e#Z/Gd*d+d+e#Z0Gd,d-d-e#Z1ej2d9d.d/Z3d0d1Z4d2d3Z5d4d5Z6d6d7Z7dS):0Uploads a TensorBoard logdir to TensorBoard.dev.N)message) graph_pb2) summary_pb2) types_pb2)write_service_pb2) logdir_loader)upload_tracker)util) process_graph)directory_loader)event_file_loader) io_wrapper)metadata) grpc_util) tb_logging) tensor_utili c@sReZdZdZdddZedddZeeddd Z d d Z d d Z ddZ dS)TensorBoardUploaderrNc Cs(||_||_t||_||_| |_| |_| dur4dn| |_| durFdn| |_d|_ d|_ |durnt t |_n||_|durt |jjd|_n||_|durt |jjd|_n||_|durt |jjd|_n||_dd} tjtjtjtj| d}t|j||_t j!|j|jd|_"dS) aConstructs a TensorBoardUploader. Args: writer_client: a TensorBoardWriterService stub instance logdir: path of the log directory to upload allowed_plugins: collection of string plugin names; events will only be uploaded if their time series's metadata specifies one of these plugin names upload_limits: instance of tensorboard.service.UploadLimits proto. logdir_poll_rate_limiter: a `RateLimiter` to use to limit logdir polling frequency, to avoid thrashing disks, especially on networked file systems rpc_rate_limiter: a `RateLimiter` to use to limit write RPC frequency. Note this limit applies at the level of single RPCs in the Scalar and Tensor case, but at the level of an entire blob upload in the Blob case-- which may require a few preparatory RPCs and a stream of chunks. Note the chunk stream is internally rate-limited by backpressure from the server, so it is not a concern that we do not explicitly rate-limit within the stream here. name: String name to assign to the experiment. description: String description to assign to the experiment. verbosity: Level of verbosity, an integer. Supported value: 0 - No upload statistics is printed. 1 - Print upload statistics while uploading data (default). one_shot: Once uploading starts, upload only the existing data in the logdir and then return immediately, instead of the default behavior of continuing to listen for new data in the logdir and upload them when it appears. NFicSs|ttkSN)_EVENT_FILE_INACTIVE_SECStime)Zsecsrn/home/droni/.local/share/virtualenvs/DPS-5Je3_V2c/lib/python3.9/site-packages/tensorboard/uploader/uploader.pyz.TensorBoardUploader.__init__..)Zloader_factoryZ path_filter active_filter) verbosityone_shot)#_apiZ_logdir frozenset_allowed_plugins_upload_limits_name _descriptionZ _verbosity _one_shot_request_sender_experiment_idr RateLimiter_MIN_LOGDIR_POLL_INTERVAL_SECS_logdir_poll_rate_limiterZmin_scalar_request_interval_rpc_rate_limiterZmin_tensor_request_interval_tensor_rpc_rate_limiterZmin_blob_request_interval_blob_rpc_rate_limiter functoolspartialr ZDirectoryLoaderr ZTimestampedEventFileLoaderrZIsTensorFlowEventsFilerZ LogdirLoader_logdir_loaderr Z UploadTracker_tracker)self writer_clientZlogdirallowed_plugins upload_limitsZlogdir_poll_rate_limiterrpc_rate_limitertensor_rpc_rate_limiterblob_rpc_rate_limitername descriptionrr rZdirectory_loader_factoryrrr__init__=sX,    zTensorBoardUploader.__init__)returncCs |jS)z%Returns this object's upload tracker.)r3has_datar4rrrr?szTensorBoardUploader.has_datacCs|jS)zReturns the experiment_id associated with this uploader. May be none if no experiment is set, for instance, if `create_experiment` has not been called. )r)r@rrr experiment_idsz!TensorBoardUploader.experiment_idc Csdtdtj|j|jd}t|jj |}t |j |j|j |j |j|j|j|jd|_|j |_|j S)zACreates an Experiment for this upload session and returns the ID.zCreating experiment)r;r<)r6r7r8r9r:tracker)loggerinforZCreateExperimentRequestr%r&rcall_with_retriesr!ZCreateExperiment_BatchedRequestSenderrAr#r$r-r.r/r3r(r))r4requestresponserrrcreate_experiments&  z%TensorBoardUploader.create_experimentcCs2|jdurtd|j||jrq.qdS)aUploads data from the logdir. This will continuously scan the logdir, uploading as data is added unless the uploader was built with the _one_shot option, in which case it will terminate after the first scan. Raises: RuntimeError: If `create_experiment` has not yet been called. ExperimentNotFoundError: If the experiment is deleted during the course of the upload. Nz6Must call create_experiment() before start_uploading())r( RuntimeErrorr,tick _upload_oncer'r@rrrstart_uploadings  z#TensorBoardUploader.start_uploadingcCsxtdt}|jt|}td||j}|j|j |Wdn1sj0YdS)z1Runs one upload cycle, sending zero or more RPCs.zStarting an upload cyclezLogdir sync took %.3f secondsN) rCrDrr2Zsynchronize_runsZget_run_eventsr3Z send_trackerr( send_requests)r4Zsync_start_timeZsync_duration_secs run_to_eventsrrrrLs      z TensorBoardUploader._upload_once)NNNNNNNN) __name__ __module__ __qualname____doc__r=boolr?propertystrrArIrMrLrrrrr:s  crc Cstd|t}||j_|durBtd||||j_d|j_|durhtd||||j_d|j_zt |j |Wnpt j y}zV|t jjkrt|t jjkrt|t jjkrt|WYd}~n d}~00dS)aModifies user data associated with an experiment. Args: writer_client: a TensorBoardWriterService stub instance experiment_id: string ID of the experiment to modify name: If provided, modifies name of experiment to this value. description: If provided, modifies the description of the experiment to this value Raises: ExperimentNotFoundError: If no such experiment exists. PermissionDeniedError: If the user is not authorized to modify this experiment. InvalidArgumentError: If the server rejected the name or description, if, for instance, the size limits have changed on the server. zModifying experiment %rNzSetting exp %r name to %rTz Setting exp %r description to %r)rCrDrZUpdateExperimentRequestZ experimentrAr;Zexperiment_maskr<rrEZUpdateExperimentgrpcRpcErrorcode StatusCode NOT_FOUNDExperimentNotFoundErrorPERMISSION_DENIEDPermissionDeniedErrorZINVALID_ARGUMENTInvalidArgumentErrordetails)r5rAr;r<rGerrrupdate_experiment_metadatas.  rbc Cstd|t}||_zt|j|WnTtj y}z:| tj j krTt | tj jkrjtWYd}~n d}~00dS)aPermanently deletes an experiment and all of its contents. Args: writer_client: a TensorBoardWriterService stub instance experiment_id: string ID of the experiment to delete Raises: ExperimentNotFoundError: If no such experiment exists. PermissionDeniedError: If the user is not authorized to delete this experiment. RuntimeError: On unexpected failure. zDeleting experiment %rN)rCrDrZDeleteExperimentRequestrArrEZDeleteExperimentrWrXrYrZr[r\r]r^)r5rArGrarrrdelete_experiments rcc@s eZdZdS)r_NrPrQrRrrrrr_-sr_c@s eZdZdS)r\Nrdrrrrr\1sr\c@s eZdZdS)r^Nrdrrrrr^5sr^c@seZdZdZdS)_OutOfSpaceErrorzAction could not proceed without overflowing request budget. This is a signaling exception (like `StopIteration`) used internally by `_*RequestSender`; it does not mean that anything has gone wrong. N)rPrQrRrSrrrrre9srec@s(eZdZdZddZddZddZdS) rFaHelper class for building requests that fit under a size limit. This class maintains stateful request builders for each of the possible request types (scalars, tensors, and blobs). These accumulate batches independently, each maintaining its own byte budget and emitting a request when the batch becomes full. As a consequence, events of different types will likely be sent to the backend out of order. E.g., in the extreme case, a single tensor-flavored request may be sent only when the event stream is exhausted, even though many more recent scalar events were sent earlier. This class is not threadsafe. Use external synchronization if calling its methods concurrently. c Cspi|_t||_||_t||||j|jd|_t||||j|j |jd|_ t ||||j |j |jd|_||_dS)N)rB) _tag_metadatar"r#r3_ScalarBatchedRequestSenderZmax_scalar_request_size_scalar_request_sender_TensorBatchedRequestSenderZmax_tensor_request_sizemax_tensor_point_size_tensor_request_sender_BlobRequestSendermax_blob_request_size max_blob_size_blob_request_sender) r4rAapir6r7r8r9r:rBrrrr=Rs6  z_BatchedRequestSender.__init__c Cs&||D]\}}}||jf}|j|}d}|durJd}|j}||j|<|jj}|dr||jjjkrt d||jj|jjjq ||j vr|r t d||q |j t jkr|j||||q |j t jkr|j||||q |j t jkr |j||||q |j|j|jdS)aAccepts a stream of TF events and sends batched write RPCs. Each sent request will be batched, the size of each batch depending on the type of data (Scalar vs Tensor vs Blob) being sent. Args: run_to_events: Mapping from run name to generator of `tf.Event` values, as returned by `LogdirLoader.get_run_events`. Raises: RuntimeError: If no progress can be made because even a single point is too large (say, due to a gigabyte-long tag name). FNTrz8Mismatching plugin names for %s. Expected %s, found %s.z7Skipping time series %r with unsupported plugin name %r) _run_valuestagrfgetr plugin_data plugin_nameZHasFieldrCwarningr#rDZ data_classrZDATA_CLASS_SCALARrh add_eventZDATA_CLASS_TENSORrkZDATA_CLASS_BLOB_SEQUENCEroflush) r4rOrun_nameeventvalueZtime_series_keyrZfirst_in_time_seriesrurrrrN{sT           z#_BatchedRequestSender.send_requestsccsB|D]4\}}|D]&}t||jjD]}|||fVq(qqdS)aHelper generator to create a single stream of work items. Note that `dataclass_compat` may emit multiple variants of the same event, for backwards compatibility. Thus this stream should be filtered to obtain the desired version of each event. Here, we ignore any event that does not have a `summary` field. Furthermore, the events emitted here could contain values that do not have `metadata.data_class` set; these too should be ignored. In `_send_summary_value(...)` above, we switch on `metadata.data_class` and drop any values with an unknown (i.e., absent or unrecognized) `data_class`. N)items_filter_graph_defssummaryr{)r4rOryeventsrzr{rrrrqs  z!_BatchedRequestSender._run_valuesN)rPrQrRrSr=rNrqrrrrrFCs)CrFc@sPeZdZdZddZddZddZdd Zd d Zd d Z ddZ ddZ dS)rgaHelper class for building requests that fit under a size limit. This class accumulates a current request. `add_event(...)` may or may not send the request (and start a new one). After all `add_event(...)` calls are complete, a final call to `flush()` is needed to send the final request. This class is not threadsafe. Use external synchronization if calling its methods concurrently. cCsJ|durtd||_||_||_t||_||_i|_i|_| dSNzexperiment_id cannot be None) ValueErrorr)r!r-_ByteBudgetManager_byte_budget_managerr3_runs_tags _new_request)r4rArpr8max_request_sizerBrrrr=s z$_ScalarBatchedRequestSender.__init__cCs@t|_|j|jd|_|j|j_|j |jdSz1Allocates a new request and refreshes the budget.rN) rZWriteScalarRequest_requestrclearr _num_valuesr)rArresetr@rrrrs     z(_ScalarBatchedRequestSender._new_requestc Csdz|||||WnJty^|z|||||WntyXtdYn0Yn0dSAttempts to add the given event to the current request. If the event cannot be added to the current request because the byte budget is exhausted, the request is flushed, and the event is added to the next request. zadd_event failed despite flushN_add_event_internalrerxrJr4ryrzr{rrrrrws  z%_ScalarBatchedRequestSender.add_eventcCs|j|}|dur(||}||j|<|j||jf}|durb|||j|}||j||jf<|||||jd7_dSNrrrs _create_runrrr _create_tag _create_pointrr4ryrzr{r run_proto tag_protorrrrs   z/_ScalarBatchedRequestSender._add_event_internalc Cs|j}t||jsdS|jt||j|j|jnzt |j j |WnHt jy}z.|t jjkr|ttd|WYd}~n d}~00Wdn1s0YWdn1s0Y|dSzrSends the active request after removing empty runs and tags. Starts a new, empty active request. N Upload call failed with error %s)r_prune_empty_tags_and_runsrunsr-rK_request_loggerr3Zscalars_trackerrrrEr!Z WriteScalarrWrXrYrZr[r\rCerrorrr4rGrarrrrxs"  ^z!_ScalarBatchedRequestSender.flushcCs |jjj|d}|j||S)aMAdds a run to the live request, if there's space. Args: run_name: String name of the run to add. Returns: The `WriteScalarRequest.Run` that was added to `request.runs`. Raises: _OutOfSpaceError: If adding the run would exceed the remaining request budget. r;rraddradd_runr4ryrrrrr8s  z'_ScalarBatchedRequestSender._create_runcCs*|jj|d}|j||j||S)aAdds a tag for the given value, if there's space. Args: run_proto: `WriteScalarRequest.Run` proto to which to add a tag. tag_name: String name of the tag to add (as `value.tag`). metadata: TensorBoard `SummaryMetadata` proto from the first occurrence of this time series. Returns: The `WriteScalarRequest.Tag` that was added to `run_proto.tags`. Raises: _OutOfSpaceError: If adding the tag would exceed the remaining request budget. rtagsrrCopyFromradd_tagr4rZtag_namerrrrrrIs  z'_ScalarBatchedRequestSender._create_tagcCsh|j}|j|_t|j|_t |j |j z|j |Wnt yb|jYn0dS)aAdds a scalar point to the given tag, if there's space. Args: tag_proto: `WriteScalarRequest.Tag` proto to which to add a point. event: Enclosing `Event` proto with the step and wall time data. value: Scalar `Summary.Value` proto with the actual scalar data. Raises: _OutOfSpaceError: If adding the point would exceed the remaining request budget. N)pointsrstepr make_ndarraytensoritemr{r set_timestamp wall_timer add_pointrepop)r4rrzr{pointrrrr^s   z)_ScalarBatchedRequestSender._create_pointN) rPrQrRrSr=rrwrrxrrrrrrrrgs   rgc@sXeZdZdZddZddZddZdd Zd d Zd d Z ddZ ddZ ddZ dS)riaHelper class for building WriteTensor() requests that fit under a size limit. This class accumulates a current request. `add_event(...)` may or may not send the request (and start a new one). After all `add_event(...)` calls are complete, a final call to `flush()` is needed to send the final request. This class is not threadsafe. Use external synchronization if calling its methods concurrently. cCsP|durtd||_||_||_t||_||_||_i|_i|_ | dSr) rr)r!r-rr_max_tensor_point_sizer3rrr)r4rArpr8rrjrBrrrr=s  z$_TensorBatchedRequestSender.__init__cCsRt|_|j|j|j|j_|j |jd|_ d|_ d|_ d|_ dSr)rZWriteTensorRequestrrrrr)rArrr_num_values_skipped _tensor_bytes_tensor_bytes_skippedr@rrrrs    z(_TensorBatchedRequestSender._new_requestc Csdz|||||WnJty^|z|||||WntyXtdYn0Yn0dSrrrrrrrws  z%_TensorBatchedRequestSender.add_eventcCs|j|}|dur(||}||j|<|j||jf}|durb|||j|}||j||jf<||||||jd7_dSrrrrrrrs   z/_TensorBatchedRequestSender._add_event_internalc Cs|j}t||jsdS|jt||j|j|j|j |j |j nzt |jj|WnHtjy}z.|tjjkrttd|WYd}~n d}~00Wdn1s0YWdn1s0Y|dSr)rrrr-rKrr3Ztensors_trackerrrrrrrEr!Z WriteTensorrWrXrYrZr[r\rCrrrrrrrxs& ^z!_TensorBatchedRequestSender.flushcCs |jjj|d}|j||S)aMAdds a run to the live request, if there's space. Args: run_name: String name of the run to add. Returns: The `WriteTensorRequest.Run` that was added to `request.runs`. Raises: _OutOfSpaceError: If adding the run would exceed the remaining request budget. rrrrrrrs  z'_TensorBatchedRequestSender._create_runcCs*|jj|d}|j||j||S)aAdds a tag for the given value, if there's space. Args: run_proto: `WriteTensorRequest.Run` proto to which to add a tag. tag_name: String name of the tag to add (as `value.tag`). metadata: TensorBoard `SummaryMetadata` proto from the first occurrence of this time series. Returns: The `WriteTensorRequest.Tag` that was added to `run_proto.tags`. Raises: _OutOfSpaceError: If adding the tag would exceed the remaining request budget. rrrrrrrs  z'_TensorBatchedRequestSender._create_tagcCs|j}|j|_|j|jt|j|j|j |j 7_ |j |j krt d||j|j|j |j |j|jd7_|j|j 7_dS||j|j|j|jz|j|Wnty|jYn0dS)aAdds a tensor point to the given tag, if there's space. Args: tag_proto: `WriteTensorRequest.Tag` proto to which to add a point. event: Enclosing `Event` proto with the step and wall time data. value: Tensor `Summary.Value` proto with the actual tensor data. run_name: Name of the wrong, only used for error reporting. Raises: _OutOfSpaceError: If adding the point would exceed the remaining request budget. zYTensor (run:%s, tag:%s, step: %d) too large; skipping. Size %d exceeds limit of %d bytes.rN)rrrr{rrr rrrByteSizerrCrvr;rrr_validate_tensor_valuerrrrre)r4rrzr{ryrrrrrs4    z)_TensorBatchedRequestSender._create_pointc CsLzt|Wn8tyF}z td||||fWYd}~n d}~00dS)z1Validate a TensorProto by attempting to parse it.zThe uploader failed to upload a tensor. This seems to be due to a malformation in the tensor, which may be caused by a bug in the process that wrote the tensor. The tensor has tag '%s' and is at step %d and wall_time %.6f. Original error: %sN)rrr)r4Z tensor_protorrrrrrrrr2s z2_TensorBatchedRequestSender._validate_tensor_valueN) rPrQrRrSr=rrwrrxrrrrrrrrrivs   ,ric@s8eZdZdZddZddZddZdd Zd d Zd S) ra<Helper class for managing the request byte budget for certain RPCs. This should be used for RPCs that organize data by Runs, Tags, and Points, specifically WriteScalar and WriteTensor. Any call to add_run(), add_tag(), or add_point() may raise an _OutOfSpaceError, which is non-fatal. It signals to the caller that they should flush the current request and begin a new one. For more information on the protocol buffer encoding and how byte cost can be calculated, visit: https://developers.google.com/protocol-buffers/docs/encoding cCsd|_||_dSr) _byte_budget _max_bytes)r4Z max_bytesrrrr=Psz_ByteBudgetManager.__init__cCs0|j|_|j|8_|jdkr,tddS)zResets the byte budget and calculates the cost of the base request. Args: base_request: Base request. Raises: _OutOfSpaceError: If the size of the request exceeds the entire request byte budget. rz&Byte budget too small for base requestN)rrrrJ)r4Z base_requestrrrrUs  z_ByteBudgetManager.resetcCs2|td}||jkr t|j|8_dS)zIntegrates the cost of a run proto into the byte budget. Args: run_proto: The proto representing a run. Raises: _OutOfSpaceError: If adding the run would exceed the remaining request budget. rNr_MAX_VARINT64_LENGTH_BYTESrre)r4rcostrrrrds  z_ByteBudgetManager.add_runcCs2|td}||jkr t|j|8_dS)zIntegrates the cost of a tag proto into the byte budget. Args: tag_proto: The proto representing a tag. Raises: _OutOfSpaceError: If adding the tag would exceed the remaining request budget. rNr)r4rrrrrr~s  z_ByteBudgetManager.add_tagcCs:|}|t|d}||jkr(t|j|8_dS)aIntegrates the cost of a point proto into the byte budget. Args: point_proto: The proto representing a point. Raises: _OutOfSpaceError: If adding the point would exceed the remaining request budget. rN)r _varint_costrre)r4Z point_protoZsubmessage_costrrrrrs  z_ByteBudgetManager.add_pointN) rPrQrRrSr=rrrrrrrrr@s rc@sHeZdZdZddZddZddZdd Zd d Zd d Z ddZ dS)rlacUploader for blob-type event data. Unlike the other types, this class does not accumulate events in batches; every blob is sent individually and immediately. Nonetheless we retain the `add_event()`/`flush()` structure for symmetry. This class is not threadsafe. Use external synchronization if calling its methods concurrently. cCsP|durtd||_||_||_||_||_||_d|_d|_d|_ d|_ dSr) rr)r!r-_max_blob_request_size_max_blob_sizer3 _run_name_event_value _metadata)r4rArpr8rmrnrBrrrr=s z_BlobRequestSender.__init__cCsd|_d|_d|_d|_dS)z%Declares the previous event complete.N)rrrrr@rrrrsz_BlobRequestSender._new_requestcCs||jrtd||_||_||_t|jj|_|jjdkrL||_ | n,t d|jj||jj |jj|jj|dS)rz+Tried to send blob while another is pendingrz~A blob sequence must be represented as a rank-1 Tensor. Provided data has rank %d, for run %s, tag %s, step %s ('%s' plugin) .N)rrJrrrrr_blobsndimrrxrCrvrrrrtrurrrrrrws$    z_BlobRequestSender.add_eventc Cs|jr|}tdt|j|d}t|jD]b\}}|j|j t|0}|| |||7}| t |Wdq01s0Yq0td|t|j||dS)zNSends the current blob sequence fully, and clears it to make way for the next.z$Sending %d blobs for sequence id: %srNz'Sent %d of %d blobs for sequence id: %s)r_get_or_create_blob_sequencerCrDlenr enumerater-rKr3 blob_tracker _send_blobZ mark_uploadedrTr)r4blob_sequence_idZ sent_blobs seq_indexblobrrrrrxs, .z_BlobRequestSender.flushc Cstj|j|j|jj|jjt|j |j d}t |j |jj t|vzt|jj|}|j}WnJtjy}z0|tjjkrttd|WYd}~n d}~00Wdn1s0Y|S)N)rArunrrrZfinal_sequence_lengthrr)rZGetOrCreateBlobSequenceRequestr)rrrrrrrrrr rrrrrEr!ZGetOrCreateBlobSequencerrWrXrYrZr[r\rCr)r4rGrHrrarrrrs*   6z/_BlobRequestSender._get_or_create_blob_sequencec Cst||jkr&tdt||jdS||||}t}d}zN|j|D] }|d7}qNt|}td|t||t||dWdSt j y} zB| t j j krtdWYd} ~ dStd| WYd} ~ n d} ~ 00dS) zTries to send a single blob for a given index within a blob sequence. The blob will not be sent if it was sent already, or if it is too large. Returns: The number of blobs successfully sent (i.e., 1 or 0). z=Blob too large; skipping. Size %d exceeds limit of %d bytes.rrzFUpload for %d chunks totaling %d bytes took %.3f seconds (%.3f MB/sec)iz0Attempted to re-upload existing blob. Skipping.NzWriteBlob RPC call got error %s)rrrCrv_write_blob_request_iteratorrr!Z WriteBlobrDrWrXrYrZZALREADY_EXISTSr) r4rrrZrequest_iteratorupload_start_timecountrHupload_duration_secsrarrrr9s>    z_BlobRequestSender._send_blobc csdtdt||jD]L}||||j}||jt|k}tj||||d|dt|d}|VqdS)Nr)rindexdataoffsetZcrc32cfinalize_objectZ final_crc32cZ blob_bytes)rangerrrZWriteBlobRequest)r4rrrrchunkrrGrrrrhs z/_BlobRequestSender._write_blob_request_iteratorN) rPrQrRrSr=rrwrxrrrrrrrrls &/rlccsZt}|}td|dVt|}|rHtdt|||ntd||dS)NzTrying request of %d bytesz/Upload for %d runs (%d bytes) took %.3f secondsz&Upload of (%d bytes) took %.3f seconds)rrrCrDr)rGrrZ request_bytesrrrrr}s"  rcCs"d}|dkr|d7}|dL}q|S)a'Computes the size of `n` encoded as an unsigned base-128 varint. This should be consistent with the proto wire format: Args: n: A non-negative integer. Returns: An integer number of bytes. rr)nresultrrrrs  rcCsXttt|jD]@\}}ttt|jD]\}}|js,|j|=q,|js|j|=qdSr)reversedlistrrrr)rGZrun_idxrZtag_idxrrrrrrs  rcCs||jjD]n}|jjjtjkrq|jtjkrt |j j }dd|D}dd|D}||krt j |tjd}|j |qdS)NcSsg|] }t|qSr)_filtered_graph_bytes.0xrrr rz&_filter_graph_defs..cSsg|]}|dur|qSrrrrrrrr)Zdtype)r~r{rrtrugraphs_metadataZ PLUGIN_NAMErrZRUN_GRAPH_NAMErrZ string_valrZmake_tensor_protorZ DT_STRINGr)rzvrZ filtered_dataZ new_tensorrrrr}s   r}c CsPzt|}Wn*tjtfy<tdt|YdS0t || S)Nz.Could not parse GraphDef of size %d. Skipping.) rZGraphDefZ FromStringr DecodeErrorRuntimeWarningrCrvrr Zprepare_graph_for_uiZSerializeToString)Z graph_bytesZ graph_defrrrrs r)NN)N)8rS contextlibr0rrWZgoogle.protobufrZtensorboard.compat.protorrrZtensorboard.uploader.protorZtensorboard.uploaderrr r Ztensorboard.backendr Z$tensorboard.backend.event_processingr r rZtensorboard.plugins.graphrrZtensorboard.utilrrrr+rrZ get_loggerrCobjectrrbrcrJr_r\r^ ExceptionrerFrgrirrlcontextmanagerrrrr}rrrrrs`                / ,  KqM