a yf@@sddlZddlZddlZddlmZddlmZddlmZm Z ddl Z ddl m Z m Z mZmZddlmZmZmZmZmZmZddlmZerded n ded ZGd d d ZdS) N) HTTPStatus)Path)parse_qsurlparse)HELP_MSG HUB_WEB_ROOTPREFIXTQDM)IS_COLABLOGGERSETTINGS __version__checksemojis) HUBModelErrorzpython-z-colabz-localc@seZdZdZddZed&ddZddZd d Ze d d Z d dZ d'ddZ e ddZ ejeedddZddZd(eeeeeddddZe eejdd d!d"Ze ejdd#d$d%ZdS))HUBTrainingSessiona  HUB training session for Ultralytics HUB YOLO models. Handles model initialization, heartbeats, and checkpointing. Attributes: model_id (str): Identifier for the YOLO model being trained. model_url (str): URL for the model in Ultralytics HUB. rate_limits (dict): Rate limits for different API calls (in seconds). timers (dict): Timers for rate limiting. metrics_queue (dict): Queue for the model's metrics. model (dict): Model data fetched from Ultralytics HUB. cCsddlm}dddd|_i|_i|_i|_d|_d|_d|_d|_ | |\}}|_ |pbt d}|rpd|ind}|||_z |r||n |j|_Wn:ty|td r|jjsttd Yn0dS) a Initialize the HUBTrainingSession with the provided model identifier. Args: identifier (str): Model identifier used to initialize the HUB training session. It can be a URL string or a model key with specific format. Raises: ValueError: If the provided model identifier is invalid. ConnectionError: If connecting with global API key is not supported. ModuleNotFoundError: If hub-sdk package is not installed. r) HUBClienti,)metricsZckpt heartbeatNapi_key/models/uWARNING ⚠️ Please log in using 'yolo login API_KEY'. You can find your API Key at: https://hub.ultralytics.com/settings?tab=api+keys.)Zhub_sdkr rate_limits metrics_queuemetrics_upload_failed_queueZtimersmodel model_url model_file train_args_parse_identifierfilenamer getclient load_model Exception startswithr authenticatedr warningr)self identifierrrmodel_idZ active_key credentialsr-S/var/www/html/django/DPS/env/lib/python3.9/site-packages/ultralytics/hub/session.py__init__ s,    zHUBTrainingSession.__init__Nc Cs\z<||}|r8|tds8|||jjs8Jd|WStttfyVYdS0dS)zJClass method to create an authenticated HUBTrainingSession or return None.rzHUB model not loaded correctlyN)r&r create_modelridPermissionErrorModuleNotFoundErrorAssertionError)clsr*argssessionr-r-r.create_sessionOs z!HUBTrainingSession.create_sessioncCs|j||_|jjs"ttdtd|jj|_|jrt td|jd|j d}t j |t tdd|jjd|_d S||j|jd ttd |jdd S) zQLoads an existing model from Ultralytics HUB using the provided model identifier.u*❌ The specified HUB model does not existrzLoading trained HUB model  🚀bestZ weights_dirZhub) download_dirNrView model at )r#rdata ValueErrorrrr1rZ is_trainedprintget_weights_urlrZ check_filerr r_set_train_argsstart_heartbeatrr infor)r)r+urlr-r-r.r$\s   $zHUBTrainingSession.load_modelc Cs|dd|dd|dd|ddt|d d t|d d d d|did|jdd dd iidd|jid}|jdr|j|ddd<|j||jjsdStd|jj|_ |j |j dt td|j ddS)zGInitializes a HUB training session with the specified model identifier.batchepochsrZimgszipatienceddevicecacheram)Z batchSizerGZ imageSizerHrJrLnamer=.pt.yaml) architectureparent)configZdatasetlineagemetarTrRNrrr<r9)r"strr!replaceendswithrr0r1rrrBrr rCr)r)Z model_argspayloadr-r-r.r0ns*       zHUBTrainingSession.create_modelcCsd\}}}t|jdvr|}nX|tdr`t|}t|jj}t|j}| ddgd}nt d|dtd |||fS) a Parses the given identifier to determine the type of identifier and extract relevant components. The method supports different identifier formats: - A HUB model URL https://hub.ultralytics.com/models/MODEL - A HUB model URL with API Key https://hub.ultralytics.com/models/MODEL?api_key=APIKEY - A local filename that ends with '.pt' or '.yaml' Args: identifier (str): The identifier string to be parsed. Returns: (tuple): A tuple containing the API key, model ID, and filename as applicable. Raises: HUBModelError: If the identifier format is not recognized. )NNN>rOrPrrNrzmodel='z invalid, correct format is z/models/MODEL_ID) rsuffixr&rrpathstemrqueryr"r)r*rr+r! parsed_urlZ query_paramsr-r-r.r s   z$HUBTrainingSession._parse_identifiercCs|jr,|jdd|_|jd|_n2|jjd|_|jrR|jdn|j |_d|jvrpt dt j |jdd |_|jj |_d S) a0 Initializes training arguments and creates a model entry on the Ultralytics HUB. This method sets up training arguments based on the model's state and updates them with any additional arguments provided. It handles different states of the model, such as whether it's resumable, pretrained, or requires specific file setup. Raises: ValueError: If the model is already trained, if required dataset information is missing, or if there are issues with the provided training arguments. T)r=resumelastrrRr=zDDataset may still be processing. Please wait a minute and try again.F)verboseN)rZ is_resumableZget_dataset_urlrr@rr=r"Z is_pretrainedZget_architecturer>rZcheck_yolov5u_filenamer1r+r)r-r-r.rAs  z"HUBTrainingSession._set_train_argsrTc s>f dd} |r4tj| ddn| SdS)zdAttempts to execute `request_func` with retries, timeout handling, optional threading, and progress.c st}d}tdD]<}t|krHttdtqXi}|durttdttd|qr|nr|t j |j krt j krnn dri_|S|dkr|}rtt|dtd |j d |j sHttd td |j qXtd|q|dur drj d|S) zNAttempts to call `request_func` with retries, timeout, and optional threading.NzTimeout for request reached. z'Received no response from the request. rr z ()zRequest failed. )timeranger r(rrsleep_show_upload_progress_iterate_contentrOK status_codeMULTIPLE_CHOICESr"r_get_failure_message _should_retryupdate)t0responseimessage r6kwargsprogress_total request_funcretryr)stream_responsetimeoutrar-r. retry_requests<   "z7HUBTrainingSession.request_queue..retry_requestT)targetdaemonN) threadingThreadstart) r)rzr{r}threadraryr|r6rxr~r-rwr. request_queues-z HUBTrainingSession.request_queuecCstjtjtjh}||vS)zHDetermines if a request should be retried based on the HTTP status code.)rREQUEST_TIMEOUT BAD_GATEWAYGATEWAY_TIMEOUT)rnZ retry_codesr-r-r.rqs z HUBTrainingSession._should_retry)rtr{r}cCs||jr&|r"d|d|dSdS|jtjkr\|j}d|dd|dd |d dSz|d d WStyYd S0dS)a0 Generate a retry message based on the response status code. Args: response: The HTTP response object. retry: The number of retry attempts allowed. timeout: The maximum timeout duration. Returns: (str): The retry message. z Retrying zx for zs.rKzRate limit reached (zX-RateLimit-Remaining/zX-RateLimit-Limitz). Please retry after z Retry-AfterrvzNo JSON message.zUnable to read JSON.N)rqrnrTOO_MANY_REQUESTSheadersjsonr"AttributeError)r)rtr{r}rr-r-r.rps   z'HUBTrainingSession._get_failure_messagecCs|j|jj|jddS)z(Upload model metrics to Ultralytics HUB.T)rr)rrupload_metricsrcopyrbr-r-r.r7sz!HUBTrainingSession.upload_metricsF)epochweightsis_bestmapfinalreturnc Cst|}|sf|d|j}|rL|rLttdt||nttd|ddS|j |j j |t ||||dd| |r| jnddd dS) a Upload a model checkpoint to Ultralytics HUB. Args: epoch (int): The current training epoch. weights (str): Path to the model weights file. is_best (bool): Indicates if the current model is the best one so far. map (float): Mean average precision of the model. final (bool): Indicates if the model is the final model after training. r`u0 WARNING ⚠️ Model 'best.pt' not found, copying 'last.pt' to 'best.pt' and uploading. This often happens when resuming training in transient environments like Google Colab. For more reliable training, consider using Ultralytics HUB Cloud. Learn more at https://docs.ultralytics.com/hub/cloud-training.u2 WARNING ⚠️ Model upload issue. Missing model .N iT) rrrrrr{r}rryr|)ris_file with_namerZr r(rshutilrrr upload_modelrVstatst_size)r)rrrrrr`r-r-r.r;s. zHUBTrainingSession.upload_model)content_lengthrtrcCsTt|dddd0}|jddD]}|t|qWdn1sF0YdS)aD Display a progress bar to track the upload progress of a file download. Args: content_length (int): The total size of the content to be downloaded in bytes. response (requests.Response): The response object from the file download request. Returns: None BT)totalunitZ unit_scaleZ unit_divisor chunk_sizeN)r iter_contentrrlen)rrtZpbarr=r-r-r.rkjs z(HUBTrainingSession._show_upload_progress)rtrcCs|jddD]}q dS)z Process the streamed HTTP response data. Args: response (requests.Response): The response object from the file download request. Returns: None rrN)r)rt_r-r-r.rlzs z#HUBTrainingSession._iterate_content)N)rrcTTNN)FrF)__name__ __module__ __qualname____doc__r/ classmethodr8r$r0 staticmethodr rArrqrequestsResponseintrprrVboolfloatrrkrlr-r-r-r.rsF / $ # B  /r)rrrhhttprpathlibr urllib.parserrrZultralytics.hub.utilsrrrr Zultralytics.utilsr r r r rrZultralytics.utils.errorsrZ AGENT_NAMErr-r-r-r.s