a d=ica@sdZddlZddlZddlZddlZddlZddlmZddlZddl m Z ddl m Z ddl m Z ddl mZddlmZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZddl mZddlmZddlmZdZdZ dZ!ddZ"d6ddZ#Gdddej$dZ%Gddde%Z&Gddde%Z'Gd d!d!e%Z(Gd"d#d#e%Z)d$d%Z*d&d'Z+Gd(d)d)e%Z,Gd*d+d+e%Z-d7d,d-Z.d.d/Z/d0d1Z0d2d3Z1Gd4d5d5ej2Z3dS)8z>Entry point and high-level logic for TensorBoard.dev uploader.N)logging)tf)experiment_pb2)export_service_pb2_grpc)write_service_pb2_grpc)auth) dry_run_stubs)exporter) flags_parser) formatters) server_info)uploader)server_info_pb2)program) base_pluginakYour use of this service is subject to Google's Terms of Service and Privacy Policy , and TensorBoard.dev's Terms of Service . This notice will not be shown again while you are logged into the uploader. To log out, run `tensorboard dev auth revoke`. diXcCsb|}d}d||tf}tj|tjdtd}|dvrRtdtjddS)z>Prompts for user consent, exiting the program if they decline.z" ***** TensorBoard Uploader *****  zContinue? (yes/NO) )yyesrN) get_ack_message_bodyjoin _MESSAGE_TOSsysstderrwriteinputlowerexit)intentbodyheaderZuser_ack_messageresponser"y/home/droni/.local/share/virtualenvs/DPS-5Je3_V2c/lib/python3.9/site-packages/tensorboard/uploader/uploader_subcommand.py_prompt_for_user_ack<s    r$c Cstttjt||}t}t|trJ|t j dt j dS| }|st|ttj}t|}|j|jd}t j d|||j\}}z t|} Wn2tjy} ztt| WYd} ~ n d} ~ 00t| td| | jj st!d| tdt"#|t$|} t"j%| jj | |d} | |&| | Wdn1sf0YdS) zRuns the main uploader program given parsed flags. Args: flags: An `argparse.Namespace`. experiment_url_callback: A function accepting a single string argument containing the full TB.dev URL of the uploaded experiment. zLogged out of uploader. N)Z force_consolerzReceived server info: <%r>zServer info response: %sz6Internal error: frontend did not specify an API server)options)'rZset_stderrthresholdWARNING _get_intentrZCredentialsStore isinstance_AuthRevokeIntentclearrrrflushZread_credentialsr$jsonloadsZOAUTH_CLIENT_CONFIGZbuild_installed_app_flowrunZauth_force_consoleZwrite_credentialsZgrpc_creds_typeZchannel_config_get_server_infoserver_info_libZCommunicationError_diestr_handle_server_infoinfo api_serverendpointerrorgrpcZcomposite_channel_credentialsZid_token_call_credentialsZsecure_channelexecute) flagsexperiment_url_callbackrstore credentialsZ client_configZflowZ channel_credsZchannel_optionsr eZcomposite_channel_credschannelr"r"r#_runIsH          "    r@c@s,eZdZdZejddZejddZdS)_IntentzA description of the user's intent in invoking this program. Each valid set of CLI flags corresponds to one intent: e.g., "upload data from this logdir", or "delete the experiment with that ID". cCsdS)zGets the message to show when executing this intent at first login. This need not include the header (program name) or Terms of Service notice. Returns: A Unicode string, potentially spanning multiple lines. Nr"selfr"r"r#rs z_Intent.get_ack_message_bodycCsdS)aCarries out this intent with the specified gRPC channel. Args: server_info: A `server_info_pb2.ServerInfoResponse` value. channel: A connected gRPC channel whose server provides the TensorBoard reader and writer services. Nr"rCr r?r"r"r#r9s z_Intent.executeN)__name__ __module__ __qualname____doc__abcabstractmethodrr9r"r"r"r#rAs  rA) metaclassc@s eZdZdZddZddZdS)r)z'The user intends to revoke credentials.cCs tddS)zMust not be called.z(No user ack needed to revoke credentialsNAssertionErrorrBr"r"r#rsz&_AuthRevokeIntent.get_ack_message_bodycCs tddS)zJExecute handled specially by `main`. Must not be called. z1_AuthRevokeIntent should not be directly executedNrLrDr"r"r#r9sz_AuthRevokeIntent.executeN)rErFrGrHrr9r"r"r"r#r)sr)c@s2eZdZdZedZddZddZddZ d S) _DeleteExperimentIntentz)The user intends to delete an experiment.aA This will delete the {num} experiment(s) on https://tensorboard.dev with the following experiment ID(s): {experiment_id_list} You have chosen to delete an experiment. All experiments uploaded to TensorBoard.dev are publicly visible. Do not upload sensitive data. cCs ||_dSN)experiment_id_list)rCrPr"r"r#__init__sz _DeleteExperimentIntent.__init__cCs|jjt|j|jdS)N)numrP)_MESSAGE_TEMPLATEformatlenrPrBr"r"r#rsz,_DeleteExperimentIntent.get_ack_message_bodyc Cs>t|}|jstdi}d}d}t|jD]}|sFd|f||<q0z t||d||f||<Wq0tjyd||f||<Yq0tj yd||f||<Yq0t j y}z d||f|f||<WYd}~q0d}~00q0d } d } | D]2\} } | |krt | | |kr| | d 7} d } q| r:t| dS) Nz2Must specify at least one experiment ID to delete. NO_ACTION DIE_ACTIONzSkipping empty experiment_id.zDeleted experiment %s.NNo such experiment %s. Either it never existed or it has already been deleted.zDCannot delete experiment %s because it is owned by a different user.z*Internal error deleting experiment %s: %s.FrT)rTensorBoardWriterServiceStubrPr FlagsErrorset uploader_libZdelete_experimentExperimentNotFoundErrorPermissionDeniedErrorr8RpcErrorvaluesprintr1) rCr r? api_clientresultsrVrW experiment_idr>Zany_die_actionerr_msgmsgactionr"r"r#r9sb       z_DeleteExperimentIntent.executeN rErFrGrHtextwrapdedentrSrQrr9r"r"r"r#rNs rNc@s4eZdZdZedZd ddZddZdd Z dS) _UpdateMetadataIntentz:The user intends to update the metadata for an experiment.aM This will modify the metadata associated with the experiment on https://tensorboard.dev with the following experiment ID: {experiment_id} You have chosen to modify an experiment. All experiments uploaded to TensorBoard.dev are publicly visible. Do not upload sensitive data. NcCs||_||_||_dSrO)rename description)rCrermrnr"r"r#rQsz_UpdateMetadataIntent.__init__cCs|jj|jdS)N)re)rSrTrerBr"r"r#rsz*_UpdateMetadataIntent.get_ack_message_bodyc Cs4t|}|j}t|jt|j|s2tdzt j |||j|jdWnt j ylt d|Ynt j yt d|Ynbt jy}zt d|WYd}~n:d}~0tjy}zt d|WYd}~n d}~00td||jdurtd|j|jdur0td t|jdS) Nz1Must specify a non-empty experiment ID to modify.rmrnrXzDCannot modify experiment %s because it is owned by a different user.z0Server cannot modify experiment as requested: %sz'Internal error modifying experiment: %szModified experiment %s.zSet name to %rzSet description to %r)rrZre_die_if_bad_experiment_namerm"_die_if_bad_experiment_descriptionrnrr[r]Zupdate_experiment_metadatar^r1r_ZInvalidArgumentErrorr8r`rr4repr)rCr r?rcrer>r"r"r#r9sL    "   z_UpdateMetadataIntent.execute)NNrir"r"r"r#rls rlc@s4eZdZdZedZd ddZddZdd Z dS) _ListIntentz/The user intends to list all their experiments.z This will list all experiments that you've uploaded to https://tensorboard.dev. TensorBoard.dev experiments are visible to everyone. Do not upload sensitive data. NcCs ||_dS)zConstructor of _ListIntent. Args: json: If and only if `True`, will print the list as pretty-formatted JSON objects, one object for each experiment. Nr,)rCr,r"r"r#rQMsz_ListIntent.__init__cCs|jSrO)_MESSAGErBr"r"r#rVsz _ListIntent.get_ack_message_bodyc Cst|}tjdddddddddd }tj||d}d}|jrHt}nt }|D].}|d7}|j } t || } t ||| qTtj|stjdntjd|tjdS)NT) rmrnZ create_timeZ update_timeZnum_runsZnum_tagsZ num_scalarsZtotal_tensor_bytesZtotal_blob_bytes) fieldmaskrz=No experiments. Use `tensorboard dev upload` to get started. zTotal: %d experiment(s) )rTensorBoardExporterServiceStubrZExperimentMask exporter_libZlist_experimentsr,r Z JsonFormatterZReadableFormatterrer0experiment_urlrbZformat_experimentrstdoutr+rr) rCr r?rcrvgencount formatterZ experimentreurlr"r"r#r9Ys>    z_ListIntent.execute)N) rErFrGrHrjrkrurQrr9r"r"r"r#rsBs rscCs$|r t|tkr tdt|fdS)NzFExperiment name is too long. Limit is %s characters. %r was provided.)rU_EXPERIMENT_NAME_MAX_CHARSr1)rmr"r"r#rp~s rpcCs$|r t|tkr tdt|fdS)NzMExperiment description is too long. Limit is %s characters. %r was provided.)rU!_EXPERIMENT_DESCRIPTION_MAX_CHARSr1)rnr"r"r#rqs rqc@s4eZdZdZedZd ddZddZdd Z dS) UploadIntentz?The user intends to upload an experiment from the given logdir.z This will upload your TensorBoard logs to https://tensorboard.dev/ from the following directory: {logdir} This TensorBoard will be visible to everyone. Do not upload sensitive data. NcCsF||_||_||_||_|dur$dn||_|dur6dn||_||_dS)NF)logdirrmrn verbositydry_runone_shotr;)rCrrmrnrrrr;r"r"r#rQs zUploadIntent.__init__cCs|jj|jdS)N)r)rSrTrrBr"r"r#rsz!UploadIntent.get_ack_message_bodyc Cs|jrt}n t|}t|jt|jt j ||j t |t ||j|j|j|jd}|jrtjj|j std|j tddS|}t ||}|jdur|||jstd|jrtdn td|d}z>z |Wnt jytdYW|jr8|s8td |j |jfd }|rL|d 7}n|d 7}|jsr|rr|d |7}tj|dtj dSt!yd}Yn0W|jr|std |j |jfd }|r|d 7}n|d 7}|js |r |d |7}tj|dtj n||jrL|sLtd |j |jfd }|r`|d 7}n|d 7}|js|r|d |7}tj|dtj 0dS)N)allowed_plugins upload_limitsrmrnrrz%s: No such directory.zbUser specified `one_shot` mode with an unavailable logdir. Exiting without creating an experiment.ztUpload started and will continue reading any new data as it's added to the logdir. To stop uploading, press Ctrl-C.zC ** This is a dry run. No data will be sent to tensorboard.dev. ** z6 New experiment created. View your TensorBoard at: %s Fz4Experiment was deleted; uploading has been cancelledzTensorBoard was run in `one_shot` mode, but did not find any uploadable data in the specified logdir: %s An empty experiment was created. To delete the empty experiment you can execute the following tensorboard dev delete --experiment_id=%sz z Interrupted.zDone.z View your TensorBoard at %srT)"rrZDryRunTensorBoardWriterStubrrZrprmrqrnr]ZTensorBoardUploaderrr0rrrrrioZgfileisdirrbZcreate_experimentrzr;Zstart_uploadingr^has_datarerr{rr+KeyboardInterrupt) rCr r?rcr rer interruptedZ end_messager"r"r#r9s                       zUploadIntent.execute)NNNNNNrir"r"r"r#rs rc@s2eZdZdZedZddZddZddZ d S) _ExportIntentz7The user intends to download all their experiment data.a^ This will download all your experiment data from https://tensorboard.dev and save it to the following directory: {output_dir} Downloading your experiment data does not delete it from the service. All experiments uploaded to TensorBoard.dev are publicly visible. Do not upload sensitive data. cCs ||_dSrO output_dir)rCrr"r"r#rQsz_ExportIntent.__init__cCs|jj|jdS)Nr)rSrTrrBr"r"r#rsz"_ExportIntent.get_ack_message_bodyc Cst|}|j}zt||}Wn&tjyFd|}t|Yn0d}z&|D]}|d7}t d|qVWn4tj y} zt d| j WYd} ~ n d} ~ 00t d||fdS)Nz#Output directory already exists: %rrrwzDownloaded experiment %sz Uploader has failed because of a timeout error. Please reach out via e-mail to tensorboard.dev-support@google.com to get help completing your export of experiment %s.z&Done. Downloaded %d experiments to: %s) rrxrryZTensorBoardExporterZOutputDirectoryExistsErrorrr[exportrbZGrpcTimeoutExceptionre) rCr r?rcoutdirr rgZnum_experimentsrer>r"r"r#r9s.  z_ExportIntent.executeNrir"r"r"r#rs rc Cs|t|tjd}|dur td|tjkrd|jrZttj |j|j |j |j |j|j|dStd|tjkr|jr|j dus|j durt|j|j |j dStdn tdn|tjkr|jrt|jStdn|tjkrt|jd S|tjkr|jrt|jStd n^|tjkrjt|tjd}|durHtd |tjkrZtStd |fntd |fdS)aDetermines what the program should do (upload, delete, ...). Args: flags: An `argparse.Namespace` with the parsed flags. experiment_url_callback: A function accepting a single string argument containing the full TB.dev URL of the uploaded experiment. Returns: An `_Intent` instance. Raises: base_plugin.FlagsError: If the command-line `flags` do not correctly specify an intent. Nz%Must specify subcommand (try --help).)rmrnrrrr;z0Must specify directory to upload via `--logdir`.roz0Must specify either `--name` or `--description`.z8Must specify experiment to modify via `--experiment_id`.z;Must specify experiment(s) to delete via `--experiment_id`.rtz-Must specify output directory via `--outdir`.z$Must specify a subcommand to `auth`.zUnknown auth subcommand %rzUnknown subcommand %r) getattrr ZSUBCOMMAND_FLAGrr[ZSUBCOMMAND_KEY_UPLOADrrospath expanduserrmrnverboserrZSUBCOMMAND_KEY_UPDATE_METADATArerlZSUBCOMMAND_KEY_DELETErNZSUBCOMMAND_KEY_LISTrsr,ZSUBCOMMAND_KEY_EXPORTrrZSUBCOMMAND_KEY_AUTHZAUTH_SUBCOMMAND_FLAGZAUTH_SUBCOMMAND_KEY_REVOKEr)rM)r:r;cmdZauth_cmdr"r"r#r'0sj               r'cCs\|jp tj}t|dg}|jr4|js4t||j|St||}|jrX|jj rX|j|j_ |S)Nplugins) originr ZDEFAULT_ORIGINrZ api_endpointr0Zcreate_server_infoZfetch_server_infor5r6)r:rrr r"r"r#r/}s     r/cCsr|j}|jtjkr0tjd|jtjn>|jtj krLt d|jn"|jrntjd|jtjdS)NzWarning [from server]: %s zError [from server]: %s%s ) compatibilityZverdictrZ VERDICT_WARNrrrdetailsr+Z VERDICT_ERRORr1)r4compatr"r"r#r3s   r3cCs*tjd|ftjtddS)Nrrw)rrrr+r)messager"r"r#r1s r1c@s:eZdZdZd ddZddZddZd d Zd d ZdS)UploaderSubcommandz)Integration point with `tensorboard` CLI.NcCs ||_dS)zConstructor of UploaderSubcommand. Args: experiment_url_callback: A function accepting a single string argument containing the full TB.dev URL of the uploaded experiment. N)_experiment_url_callback)rCr;r"r"r#rQszUploaderSubcommand.__init__cCsdS)Ndevr"rBr"r"r#rmszUploaderSubcommand.namecCst|dSrO)r define_flags)rCparserr"r"r#rszUploaderSubcommand.define_flagscCs t||jSrO)r@r)rCr:r"r"r#r.szUploaderSubcommand.runcCsdS)Nzupload data to TensorBoard.devr"rBr"r"r#helpszUploaderSubcommand.help)N) rErFrGrHrQrmrr.rr"r"r"r#rs  r)N)N)4rHrIr,rrrjZabslrr8Ztensorboard.compatrZtensorboard.uploader.protorrrZtensorboard.uploaderrrr ryr r r r0r r]rZ tensorboardrZtensorboard.pluginsrrrrr$r@ABCMetarAr)rNrlrsrprqrrr'r/r3r1ZTensorBoardSubcommandrr"r"r"r#sP                 7S?<  p0 M