a OSic3@sdZddlZddlZddlZddlmZmZddlmZm Z m Z m Z ddl m Z e e ee e fee ee e ffe fZGdddZejjejjejjejjejjejjejjejjejjejjejjejjejjejjejjhZ ejj!j"ejj!j#ejj!j$ejj!j%ejj!j&ejj!j'ejj!j(ejj!j)ejj!j*ejj!j+ejj!j,ejj!j-ejj!j.ejj!j/ejj!j0ejj!j1ejj!j2ejj!j3ejj!j4ej5ej6ej4ej7ej8ej9ej:ej;ejdd d d d d ddddddddddddddddddhZ?d d!Z@d"d#ZAd$d%ZBd&d'ZCe eDe d(d)d*ZEd+d,ZFd-d.ZGd/d0ZHd1d2ZId3d4ZJd5d6ZKd7d8ZLd9d:ZMd;d<ZNd=d>ZOePd?d@dAZQdBdCZRdDdEZSejTejTePdFdGdHZUeVeVePejWePeeVeVfdIdJdKZXdLdMZYdNdOZZdS)Pz? Utils shared by different modes of quantization (eager/graph) N) QuantTypequant_type_to_str)TupleAnyUnionCallable)is_parametrizedc@seZdZdZdS) MatchAllNodezo A node pattern that matches all nodes, used in defining fusion patterns in FX Graph Mode Quantization N)__name__ __module__ __qualname____doc__rrW/var/www/html/django/DPS/env/lib/python3.9/site-packages/torch/ao/quantization/utils.pyr sr relurelu_ contiguousdetachdetach_ hardsigmoid hardsigmoid_permuterepeatrepeat_interleavereshaperesize_shapesigmoidsigmoid_sizesqueezesqueeze_tanhtanh_ transpose unsqueeze unsqueeze_viewcCsR|jdko|jtv}|jdko&|jtv}|jdkoFt|t|jtv}|||fS)N call_function call_methodZ call_module)optarget func_list method_listtypestrmodule_type_list)nodemodulesZis_call_functionZis_call_methodZis_call_modulerrr check_nodebs r3cCs|}|||SN)copyupdate)Z default_dictZadditional_dictdrrrget_combined_dictis r8cCs|tjkp|tjkSr4)torchper_tensor_affineper_tensor_symmetricqschemerrr is_per_tensorns r>cCs|tjtjtjfvSr4)r9per_channel_affine per_channel_affine_float_qparamsper_channel_symmetricr<rrris_per_channelrsrB)objfqnreturncCstt|d|S)zO Given an obj and a fqn such as "foo.bar.baz", returns gm.foo.bar.baz. .) functoolsreducegetattrsplit)rCrDrrrgetattr_from_fqnwsrKcCst|dr|jnd}|j}||d}|s,|St|rr9r:rBrAr?ch_axis RuntimeErrorcalculate_qparams)Zobserver_or_fake_quantr=rLZqparamsrNrOrrrget_qparam_dict}s"    rTcCsHt|}t|}||i}t||vs|dus J|}|}t|dr,|jnd}|j|j|fS)zk returns the qconfig tuple for qconfig: (activation_dtype, weight_dtype, activation_compute_dtype) N compute_dtype)r[r]rPrprL)rXr[r]rprrrrds  rdcCs|dus J|}|}tjtjtjg}|j|vrf|j|vrFtjSt |dr`|j |vr`tj Stj S|jtj kr|jtjkrtj S|jtj krtjStd|j|jdS)NrpzKUnrecognized dtype combination in get_quant_type: activation({}),weight({}))r[r]r9r_r`rlrLrSTATICrPrpDYNAMICZ WEIGHT_ONLYrare ExceptionrW)rXr[r]Z static_dtypesrrrrUs$      rU)min_valmax_valrEcCs|dks|dkr&tddS|dks>|dkr~|tdkrd|tdkrdtddS||ksJd||nt||ksJd||dS)z Checks if the given minimum and maximum values are valid, meaning that they exist and the min value is less than the max value. rzMmust run observer before calling calculate_qparams. Returning default values.Finfz-infz!min {} should be less than max {}T)numelwarningswarndimrerWr9all)rtrurrrcheck_min_max_valid s( r|) quant_min quant_maxhas_customized_qrangerL reduce_rangerEc Cs&|r|tjkrd\}}nd\}}||}}|durD|durD||}}||d} |tjkrzd| krndksnJdn(|tjkrd| krdksnJd |r|d |d }}nd|tjkr|rd \}}nd \}}nB|tjkr|rd \}}nd\}}n|tjkrd\}}nd\}}||fS)ztCalculates actual qmin and qmax based on the quantization range, observer datatype and if range is reduced. )r)rNrzRquantization range should be positive and not exceed the maximum bit range (=256).lzYquantization range should be positive and not exceed the maximum bit range (=4294967296).)i?)i)rr)ir)r)r9rjr`r_) r}r~rrLrZinitial_quant_minZinitial_quant_maxZcustom_quant_minZcustom_quant_maxZ qrange_lenrrrcalculate_qmin_qmax*sL                rcCs8|dd}t|dkr$d|dfS|d|dfSdS)z, Turn 'foo.bar' into ['foo', 'bar'] rFrrN)rsplitlen)r+rrrr _parent_name_s   rcCs:t|jdkrdSt|r2t|jdko0d|jvSdSdS)z Checks if module._modules is empty or if module is a parametrization, checks that module._modules only has the 'parametrizations' module rTrparametrizationsFN)r_modulesr)modulerrr)has_no_children_ignoring_parametrizationsis r)[r rxrGr9Z torch.ao.quantization.quant_typerrtypingrrrrZtorch.nn.utils.parametrizerPatternr nnReLUReLU6AdaptiveAvgPool1dAdaptiveAvgPool2dAdaptiveAvgPool3d AvgPool1d AvgPool2d AvgPool3d MaxPool1d MaxPool2d MaxPool3dIdentity HardsigmoidSigmoidTanhr0 functionaladaptive_avg_pool1dadaptive_avg_pool2dadaptive_avg_pool3delu hardswish instance_norm layer_norm leaky_relusilumishdropout max_pool1d max_pool2d max_pool3drhardtanh hardtanh_rrr$rr stacksumr"r%catr,meanr-r3r8r>rBr/rKrTrZr\r^rcrhrirkrmrnboolrordrUTensorr|intrLrrrrrrrs (     5