a yf`@s2ddlmZddlmZddlZGdddZdS))List)urlsplitNc@s<eZdZdZd eeedddZejeejdddZ d S) TritonRemoteModela Client for interacting with a remote Triton Inference Server model. Attributes: endpoint (str): The name of the model on the Triton server. url (str): The URL of the Triton server. triton_client: The Triton client (either HTTP or gRPC). InferInput: The input class for the Triton client. InferRequestedOutput: The output request class for the Triton client. input_formats (List[str]): The data types of the model inputs. np_input_formats (List[type]): The numpy data types of the model inputs. input_names (List[str]): The names of the model inputs. output_names (List[str]): The names of the model outputs. )urlendpointschemecs8|s2|s2t|}|jddd}|j}|j}||_||_|dkrtddlm }|j |jddd|_ |j |}n4ddl m}|j |jddd|_ |j j |ddd }t|d d d d |d <tjtjtjd|j|_|j|_dd|dD|_fdd|jD|_dd|dD|_dd|d D|_dS)a Initialize the TritonRemoteModel. Arguments may be provided individually or parsed from a collective 'url' argument of the form ://// Args: url (str): The URL of the Triton server. endpoint (str): The name of the model on the Triton server. scheme (str): The communication scheme ('http' or 'grpc'). /rhttpNF)rverbosesslT)Zas_jsonconfigoutputcSs |dS)Nname)get)xrT/var/www/html/django/DPS/env/lib/python3.9/site-packages/ultralytics/utils/triton.py;z,TritonRemoteModel.__init__..)key)Z TYPE_FP32Z TYPE_FP16Z TYPE_UINT8cSsg|] }|dqS)Z data_typer.0rrrr Arz.TritonRemoteModel.__init__..inputcsg|] }|qSrrrZtype_maprrrBrcSsg|] }|dqSrrrrrrrCrcSsg|] }|dqSrrrrrrrDr)rpathstripsplitrnetlocrrZtritonclient.httpr ZInferenceServerClient triton_clientZget_model_configZtritonclient.grpcZgrpcsortednpZfloat32Zfloat16Zuint8InferRequestedOutput InferInput input_formatsnp_input_formats input_names output_names)selfrrrZsplitsclientr rrr__init__s,   zTritonRemoteModel.__init__)inputsreturnc sg}|djt|D]d\}}|jj|kr>|j|}j|g|jj|dd}| || |qfddj D}j j j||dfddj DS)z Call the model with the given inputs. Args: *inputs (List[np.ndarray]): Input data to the model. Returns: (List[np.ndarray]): Model outputs. rZTYPE_rcsg|]}|qSr)r$rZ output_name)r*rrrYrz.TritonRemoteModel.__call__..)Z model_namer-outputscsg|]}|qSr)Zas_numpyastyper/) input_formatr0rrr\r)Zdtype enumerater'r1r%r(shaper&replaceZset_data_from_numpyappendr)r!Zinferr)r*r-Z infer_inputsirZ infer_inputZ infer_outputsr)r2r0r*r__call__Fs  (  zTritonRemoteModel.__call__N)rr) __name__ __module__ __qualname____doc__strr,r#Zndarrayrr8rrrrr s-r)typingr urllib.parsernumpyr#rrrrrs