a yf1@s dZddlZddlZddlZddlmZdZd!ddZGdddej Z Gd d d e Z Gd d d ej Z Gd dde Z GdddejZGdddej ZGdddej ZGdddej ZGdddej ZGdddej ZGdddej ZGdddej ZGdd d ej ZdS)"zConvolution modules.N) ConvConv2 LightConvDWConvDWConvTranspose2d ConvTransposeFocus GhostConvChannelAttentionSpatialAttentionCBAMConcatRepConvcs`dkr4t|tr"|ddnfdd|D}|dur\t|trN|dn dd|D}|S)zPad to 'same' shape outputs.rcsg|]}|ddqS)r.0xdrW/var/www/html/django/DPS/env/lib/python3.9/site-packages/ultralytics/nn/modules/conv.py zautopad..NcSsg|] }|dqSrrrrrrr r) isinstanceint)kprrrrautopads , rcs:eZdZdZeZd fdd ZddZd d Z Z S) rzeStandard convolution with args(ch_in, ch_out, kernel, stride, padding, groups, dilation, activation).rNTc sfttj||||t|||||dd|_t||_|durH|jnt |tj rX|nt |_ dS)@Initialize Conv layer with given arguments including activation.FgroupsdilationbiasTN) super__init__nnConv2drconv BatchNorm2dbn default_actrModuleIdentityact selfc1c2rsrgrr/ __class__rrr&)s $ z Conv.__init__cCs||||SzFApply convolution, batch normalization and activation to input tensor.r/r+r)r1rrrrforward0sz Conv.forwardcCs|||S)z*Perform transposed convolution of 2D data.r/r)r:rrr forward_fuse4szConv.forward_fuse)rrNrrT __name__ __module__ __qualname____doc__r'SiLUr,r&r;r= __classcell__rrr6rr$s rcs:eZdZdZdfdd Zdd Zd d Zd d ZZS)rz+Simplified RepConv module with Conv fusing.rNTc sDtj||||||||dtj||d|td||||dd|_dS)r r5rr/rFr!N)r%r&r'r(rcv2r0r6rrr&<szConv2.__init__cCs ||||||Sr8)r/r+r)rGr:rrrr;Asz Conv2.forwardcCs||||S)zLApply fused convolution, batch normalization and activation to input tensor.r9r:rrrr=EszConv2.forward_fusecCst|jjj}dd|jddD}|jjj|dddd|d|dd|d|ddf<|jjj|7_|d|j |_ dS)zFuse parallel convolutions.cSsg|] }|dqSrrrrrrrLrz$Conv2.fuse_convs..rNrrrG) torchZ zeros_liker)weightdatashaperGclone __delattr__r=r;)r1wirrr fuse_convsIs B zConv2.fuse_convs)rErNrrT) r?r@rArBr&r;r=rPrDrrr6rr9s rcs2eZdZdZdeffdd ZddZZS)rz Light convolution with args(ch_in, ch_out, kernel). https://github.com/PaddlePaddle/PaddleDetection/blob/develop/ppdet/modeling/backbones/hgnet_v2.py rcs2tt||ddd|_t||||d|_dS)r rFr/N)r%r&rconv1rconv2)r1r2r3rr/r6rrr&Zs zLightConv.__init__cCs|||S)z%Apply 2 convolutions to input tensor.)rSrRr:rrrr;`szLightConv.forward) r?r@rArBr'ZReLUr&r;rDrrr6rrSsrcs"eZdZdZdfdd ZZS)rzDepth-wise convolution.rTc s&tj||||t||||ddS)z8Initialize Depth-wise convolution with given parameters.rFNr%r&mathgcd)r1r2r3rr4rr/r6rrr&hszDWConv.__init__)rrrTr?r@rArBr&rDrrr6rresrcs"eZdZdZdfdd ZZS)rz!Depth-wise transpose convolution.rrc s&tj||||||t||ddS)z9Initialize DWConvTranspose2d class with given parameters.)r"NrT)r1r2r3rr4p1p2r6rrr&pszDWConvTranspose2d.__init__)rrrrrWrrr6rrmsrcs:eZdZdZeZd fdd ZddZd d Z Z S) rzConvolution transpose 2d layer.rrTcshttj|||||| d|_|r2t|nt|_|durJ|jnt |tj rZ|nt|_ dS)zRInitialize ConvTranspose2d layer with batch normalization and activation function.r$TN) r%r&r'ConvTranspose2dconv_transposer*r.r+r,rr-r/)r1r2r3rr4rr+r/r6rrr&zs zConvTranspose.__init__cCs||||S)zMApplies transposed convolutions, batch normalization and activation to input.)r/r+r\r:rrrr;szConvTranspose.forwardcCs|||S)z@Applies activation and convolution transpose operation to input.)r/r\r:rrrr=szConvTranspose.forward_fuse)rrrTTr>rrr6rrus rcs*eZdZdZd fdd ZddZZS) rz"Focus wh information into c-space.rNTc s*tt|d||||||d|_dS)zfInitializes Focus object with user defined channel, convolution, padding, group and activation values.rQN)r%r&rr))r1r2r3rr4rr5r/r6rrr&s zFocus.__init__c Csr|t|dddddddf|dddddddf|dddddddf|dddddddffdS)z Applies convolution to concatenated tensor and returns the output. Input shape is (b,c,w,h) and output shape is (b,4c,w/2,h/2). .Nrr)r)rHcatr:rrrr;sz Focus.forward)rrNrTr?r@rArBr&r;rDrrr6rrsrcs*eZdZdZdfdd ZddZZS) r z:Ghost Convolution https://github.com/huawei-noah/ghostnet.rTc sFt|d}t||||d||d|_t||ddd||d|_dS)zfInitializes Ghost Convolution module with primary and cheap operations for efficient feature learning.rNrQr)r%r&rcv1rG)r1r2r3rr4r5r/Zc_r6rrr&s zGhostConv.__init__cCs ||}t|||fdS)zJForward propagation through a Ghost Bottleneck layer with skip connection.r)rarHr^rG)r1ryrrrr;s zGhostConv.forward)rrrTr_rrr6rr sr cs^eZdZdZeZdfdd Zdd Zd d Z d d Z e ddZ ddZ ddZZS)rz RepConv is a basic rep-style block, including training and deploy status. This module is used in RT-DETR. Based on https://github.com/DingXiaoH/RepVGG/blob/main/repvgg.py rErTFc st|dkr|dksJ||_||_||_|dur>|jnt|tjrN|nt |_ | rx||krx|dkrxtj |dnd|_ t ||||||dd|_t ||d|||d|dd|_dS) zXInitializes Light Convolution layer with inputs, outputs & optional activation function.rErT)Z num_featuresNF)rr5r/r)r%r&r5r2r3r,rr'r-r.r/r*r+rrRrS) r1r2r3rr4rr5rr/r+Zdeployr6rrr&s (&zRepConv.__init__cCs|||S)Forward process.r<r:rrrr=szRepConv.forward_fusecCs6|jdurdn||}||||||S)rcNr)r+r/rRrS)r1rZid_outrrrr;szRepConv.forwardcCsN||j\}}||j\}}||j\}}|||||||fS)zjReturns equivalent kernel and bias by adding 3x3 kernel, 1x1 kernel and identity kernel with their biases.)_fuse_bn_tensorrRrSr+_pad_1x1_to_3x3_tensor)r1Z kernel3x3Zbias3x3 kernel1x1Zbias1x1ZkernelidZbiasidrrrget_equivalent_kernel_biassz"RepConv.get_equivalent_kernel_biascCs$|dur dStjj|gdSdS)z"Pads a 1x1 tensor to a 3x3 tensor.Nr)rrrr)rHr'Z functionalpad)rfrrrreszRepConv._pad_1x1_to_3x3_tensorc Cs|dur dSt|trH|jj}|jj}|jj}|jj}|jj}|jj}nt|t j rt |ds|j |j }tj|j |ddftjd} t|j D]} d| | | |ddf<qt| |jj|_|j}|j}|j}|j}|j}|j}||} || dddd} || |||| fS)zbGenerates appropriate kernels and biases for convolution by fusing branches of the neural network.N)rr id_tensorrE)Zdtyper)rrr)rIr+ running_mean running_varr$epsr'r*hasattrr2r5npZzerosZfloat32rangerHZ from_numpytoZdevicerisqrtZreshape) r1branchkernelrkrlgammabetarmZ input_dimZ kernel_valuerOZstdtrrrrds2      zRepConv._fuse_bn_tensorc Cst|drdS|\}}tj|jjj|jjj|jjj|jjj |jjj |jjj |jjj dd d|_||jj_||jj_|D] }|q|d|dt|dr|dt|d r|d t|d r|d dS) zaCombines two convolution layers into a single layer and removes unused attributes from the class.r)NT) in_channels out_channels kernel_sizestridepaddingr#r"r$FrRrSnmr+ri)rnrgr'r(rRr)rxryrzr{r|r#r"Zrequires_grad_rIrJr$ parametersZdetach_rM)r1rtr$pararrrrPs6              zRepConv.fuse_convs)rErrrrTFF)r?r@rArBr'rCr,r&r=r;rg staticmethodrerdrPrDrrr6rrs  rcs<eZdZdZeddfdd ZejejdddZZ S) r zaChannel-attention module https://github.com/open-mmlab/mmdetection/tree/v3.0.0rc1/configs/rtmdet.N)channelsreturncs<ttd|_tj||ddddd|_t|_dS)zXInitializes the class and sets the basic configurations and instance variables required.rrTrZN) r%r&r'ZAdaptiveAvgPool2dpoolr(fcSigmoidr/)r1rr6rrr&s  zChannelAttention.__init__)rrcCs|||||S)ziApplies forward pass using activation on convolutions of the input, optionally using batch normalization.)r/rrr:rrrr;szChannelAttention.forward) r?r@rArBrr&rHZTensorr;rDrrr6rr sr cs*eZdZdZdfdd ZddZZS)r zSpatial-attention module.csNt|dvsJd|dkr&dnd}tjdd||dd|_t|_d S) z>Initialize Spatial-attention module with kernel size argument.>rErzkernel size must be 3 or 7rrErrF)r|r$N)r%r&r'r(rarr/)r1rzr|r6rrr&'s  zSpatialAttention.__init__c Cs<|||ttj|dddtj|ddddgdS)zGApply channel and spatial attention on input for feature recalibration.rT)Zkeepdimr)r/rarHr^meanmaxr:rrrr;/szSpatialAttention.forward)rr_rrr6rr $sr cs*eZdZdZdfdd ZddZZS)r z%Convolutional Block Attention Module.rcs"tt||_t||_dS)z>Initialize CBAM with given input channel (c1) and kernel size.N)r%r&r channel_attentionr spatial_attention)r1r2rzr6rrr&7s  z CBAM.__init__cCs|||S)z+Applies the forward pass through C1 module.)rrr:rrrr;=sz CBAM.forward)rr_rrr6rr 4sr cs*eZdZdZdfdd ZddZZS)r z.Concatenate a list of tensors along dimension.rcst||_dS)z;Concatenates a list of tensors along a specified dimension.N)r%r&r)r1 dimensionr6rrr&Es zConcat.__init__cCst||jS)z.Forward pass for the YOLOv8 mask Proto module.)rHr^rr:rrrr;JszConcat.forward)rr_rrr6rr Bsr )Nr)rBrUnumpyrorHZtorch.nnr'__all__rr-rrrrr[rrrr rr r r r rrrrs&  h