qyiV tSrSSKrSSKrSSKJrJr SSKrSSKrSSK J r SSK J r SSKJr SSKJrJr SS KJrJrJrJrJrJr SS KJrJr SS KJrJrJ r J!r!J"r" \ "5(aSS K#J$r$ SS K%J&r&J'r' \(aSSK(J)r) \!RT"\+5r,"SS\SS9r-S/S\.\/-\R`-S\1S\1S\2S\24 Sjjr3S\2S\R`S\R`S\R`4Sjr4Sr5S \R`S!\.\R`\R`44S"jr6S0S#\R`S$\R`S%\1S!\R`4S&jjr7S#\R`S'\R`S(\R`S)\R`S!\R`4 S*jr8S+\R`S!\R`4S,jr9\"S-S.\ 55r:S./r;g)1z"Image processor class for VitPose.N) TYPE_CHECKINGUnion) functional)TorchvisionBackend) BatchFeature)group_images_by_shapereorder_images)IMAGENET_DEFAULT_MEANIMAGENET_DEFAULT_STDChannelDimension ImageInputPILImageResamplingSizeDict) ImagesKwargsUnpack) TensorTypeauto_docstringis_scipy_availableloggingrequires_backends)inv)affine_transformgaussian_filter)VitPoseEstimatorOutputc:\rSrSr%Sr\S-\S'\S-\S'Srg)VitPoseImageProcessorKwargs7a5 do_affine_transform (`bool`, *optional*): Whether to apply an affine transformation to the input images based on the bounding boxes. normalize_factor (`float`, *optional*, defaults to `200.0`): Width and height scale factor used for normalization when computing center and scale from bounding boxes. Ndo_affine_transformnormalize_factor) __name__ __module__ __qualname____firstlineno____doc__bool__annotations__float__static_attributes__r"q/home/mande/repo/quber/.venv/lib/python3.13/site-packages/transformers/models/vitpose/image_processing_vitpose.pyrr7s$dl"r,rF)totalbox image_width image_heightr!padding_factorcUSSupVpxX- n [R"XWS--XhS--/[RS9n XyU-:a US-U - nO XyU-:aX-n[R"Xs- X- /[RS9n X-n X4$)aa Encodes a bounding box in COCO format into (center, scale). Args: box (`Tuple`, `List`, or `np.ndarray`): Bounding box in COCO format (top_left_x, top_left_y, width, height). image_width (`int`): Image width. image_height (`int`): Image height. normalize_factor (`float`): Width and height scale factor. padding_factor (`float`): Bounding box padding factor. Returns: tuple: A tuple containing center and scale. - `np.ndarray` [float32](2,): Center of the bbox (x, y). - `np.ndarray` [float32](2,): Scale of the bbox width & height. N?dtype?)nparrayfloat32) r/r0r1r!r2 top_left_x top_left_ywidthheight aspect_ratiocenterscales r-box_to_center_and_scalerCDs:-0G)JE-L XXzCK/sl1JKSUS]S] ^F f$$|+ & &% HHe.0IJRTR\R\ ]E  "E =r,theta size_inputsize_dst size_targetc[R"U5n[R"S[RS9nUSUS- nUSUS- n[R "U5U-US'[R "U5*U-US'USUS-[R "U5-SUS-[R "U5--SUS---US '[R "U5U-US '[R "U5U-US 'USUS-[R "U5-SUS-[R "U5-- SUS---US 'U$) a Calculate the transformation matrix under the constraint of unbiased. Paper ref: Huang et al. The Devil is in the Details: Delving into Unbiased Data Processing for Human Pose Estimation (CVPR 2020). Source: https://github.com/open-mmlab/mmpose/blob/master/mmpose/core/post_processing/post_transforms.py Args: theta (`float`): Rotation angle in degrees. size_input (`np.ndarray`): Size of input image [width, height]. size_dst (`np.ndarray`): Size of output image [width, height]. size_target (`np.ndarray`): Size of ROI in input plane [w, h]. Returns: `np.ndarray`: A matrix for transformation. )rr6rrrrrrgr5rrIrrrrrrI)r9deg2radzerosr;mathcossin)rDrErFrGmatrixscale_xscale_ys r-get_warp_matrixrXpsX( JJu E XXfBJJ /FqkKN*GqkKN*G88E?W,F4LHHUO#g-F4L z!}txx.z!}1DtxxPU1VVY\_jkl_mYmmF4L88E?W,F4L88E?W,F4L z!}txx.z!}1DtxxPU1VVY\_jkl_mYmmF4L Mr,c [URS5Vs/sH o0SU4PM nn[R"U/SQ/5n[ U5nUSUSUSUSUSUS 4uUS'US'US'US'US 'US'UVs/sHn[ XvUS S 9PM nn[R "USS 9nU$s snfs snf) aO This function implements cv2.warpAffine function using affine_transform in scipy. See https://docs.scipy.org/doc/scipy/reference/generated/scipy.ndimage.affine_transform.html and https://docs.opencv.org/4.x/d4/d61/tutorial_warp_affine.html for more details. Note: the original implementation of cv2.warpAffine uses cv2.INTER_LINEAR. .)rrrrNrMrKrJrOrLr) output_shapeorderaxis)rangeshaper9vstackrrstack) srcMsizeichannelsM_scipyM_invchannelnew_srcs r-scipy_warp_affinerls &+399R=%9:%9CF %9H:iiI'G LE d  d  d  d  d  d TPE$KteDk5;d U4[\dd[cPWTK[cGdhhwR(G N#;es B7 B<heatmapsreturnc[U[R5(d [S5eURS:wa [ S5eUR upp4URXS45n[R"US5RXS45n[R"US5RXS45n[R"US5R[R5nUSS2SS2S 4U-USS2SS2S 4'USS2SS2S4U-USS2SS2S4'[R"[R"US5S :US5nX4$) aGet keypoint predictions from score maps. Args: heatmaps (`np.ndarray` of shape `(batch_size, num_keypoints, height, width)`): Model predicted heatmaps. Returns: tuple: A tuple containing aggregated results. - coords (`np.ndarray` of shape `(batch_size, num_keypoints, 2)`): Predicted keypoint location. - scores (`np.ndarray` of shape `(batch_size, num_keypoints, 1)`): Scores (confidence) of the keypoints. zHeatmaps should be np.ndarrayr4z Heatmaps should be 4-dimensionalrZrIr)rrrINrg) isinstancer9ndarray TypeErrorndim ValueErrorr`reshapeargmaxamaxtileastyper;where) rm batch_size num_keypoints_r>heatmaps_reshapedidxscorespredss r-get_keypoint_predictionsrs$ h + +788}};<<*2..'Jq ((*R)HI ))%q ) 1 1:a2P QC WW& * 2 2Jq3Q RF GGC # * *2:: 6E1a7^e+E!Q'N1a7^u,E!Q'N HHRWWVY/#5ub AE =r,coordsbatch_heatmapskernelcvURup4pVURSnUS:XdX7:Xd [S5e[US- S-5n[R"UV V s/sH!n U V s/sHn [ U SX4SS9PM sn PM# sn n 5n[R "USS 5n[R"U5n[R"US S S 9R5n US S-USS-US---n XS-US--[R"SX4-5RSU5-- n U R[5RSS5n Xn XS-nXU-S-nXU-S-nXU- S- nXS- nXS- U- nSUU- -nSUU- -n[R"UU/SS9nURXtSS5nUSU -- U-nUSU -- U-nSUU- U- U -U -U- U- U--n[R"UUUU/SS9nURXtSS5n[RRU[R "[R"5R$[R&"S5--5nU[R("SUU5R+5-nU$s sn fs sn n f)aDARK post-pocessing. Implemented by unbiased_data_processing. Paper references: - Huang et al. The Devil is in the Details: Delving into Unbiased Data Processing for Human Pose Estimation (CVPR 2020). - Zhang et al. Distribution-Aware Coordinate Representation for Human Pose Estimation (CVPR 2020). Args: coords (`np.ndarray` of shape `(num_persons, num_keypoints, 2)`): Initial coordinates of human pose. batch_heatmaps (`np.ndarray` of shape `(batch_size, num_keypoints, height, width)`): Batched heatmaps as predicted by the model. A batch_size of 1 is used for the bottom up paradigm where all persons share the same heatmap. A batch_size of `num_persons` is used for the top down paradigm where each person has its own heatmaps. kernel (`int`, *optional*, defaults to 3): Gaussian kernel size (K) for modulation. Returns: `np.ndarray` of shape `(num_persons, num_keypoints, 2)` ): Refined coordinates. rrzQThe batch size of heatmaps should be 1 or equal to the batch size of coordinates.rIg?rK)sigmaradiusaxesgMbP?2)rJrJrNrNedge)mode).r).rrZrr5r]zijmn,ijnk->ijmk)r`rtintr9r:rcliplogpadflattenarangerury concatenatelinalgrfinfor;epseyeeinsumsqueeze)rrrr{r|r?r> num_coordsrrmheatmapbatch_heatmaps_padindexi_ix1iy1ix1y1ix1_y1_ix1_iy1_dxdy derivativedxxdyydxyhessians r-"post_dark_unbiased_data_processingrs*0>/C/C,JvaJ !Oz7lmm &1*" #FXX+ *go ofn[b_WC8Hv Vfn o* N WW^UB7NVVN+N0PW]^ffh 6NQ &.1"4!C CE aiFQJ '"))Az7Q*R*Z*Z[]_l*m mmE LL  % %b! ,E  "B QY 'C U]Q. /C u}q0 1E !23G ai (D ai%/ 0D d B d BRq1J##Jq!DJ B, C B, C s"R'",t3d:WD ECnnc3S1:GoojA>GiimmGbhhrzz&:&>&>&JJKG bii)7J?GGIIF M; p s J5 %J0<J5 0J5 rArB output_sizecURSS;a [S5e[U5S:wa [S5e[U5S:wa [S5e[U5S:wa [S5eUS-nUSUS S - - nUS USS - - n[R"U5nUS S 2S 4U-US -US S -- US S 2S 4'US S 2S4U-US-USS -- US S 2S4'U$) a'Get final keypoint predictions from heatmaps and apply scaling and translation to map them back to the image. Note: num_keypoints: K Args: coords (`np.ndarray` of shape `(num_keypoints, ndims)`): * If ndims=2, corrds are predicted keypoint location. * If ndims=4, corrds are composed of (x, y, scores, tags) * If ndims=5, corrds are composed of (x, y, scores, tags, flipped_tags) center (`np.ndarray` of shape `(2,)`): Center of the bounding box (x, y). scale (`np.ndarray` of shape `(2,)`): Scale of the bounding box wrt original image of width and height. output_size (`np.ndarray` of shape `(2,)`): Size of the destination heatmaps in (height, width) format. Returns: np.ndarray: Predicted coordinates in the images. r)rIr4z5Coordinates need to have either 2, 4 or 5 dimensions.rIz9Center needs to have 2 elements, one for x and one for y.z,Scale needs to consist of a width and heightz2Output size needs to consist of a height and widthi@rr8Nr5)r`rtlenr9 ones_like)rrArBrrWrV target_coordss r-transform_predsr s2||Ai'PQQ 6{aTUU 5zQGHH ;1MNN EMEAh+a.3./GAh+a.3./GLL(M A,06!9Trkwargsc &>[TU]"S0UD6 g)Nr")super__init__)selfr __class__s r-rVitPoseImageProcessor.__init___s "6"r,imagesboxesrnc &>[TU]"X40UD6$)z boxes (`list[list[list[float]]]` or `np.ndarray`): List or array of bounding boxes for each image. Each box should be a list of 4 floats representing the bounding box coordinates in COCO format (top_left_x, top_left_y, width, height). )r preprocess)rrrrrs r-r VitPoseImageProcessor.preprocessbsw!&:6::r,Ndo_convert_rgbinput_data_formatdevicez torch.devicec PURXXES9nX&S'UR"U40UD6$)z"Handle extra inputs beyond images.)rrrrr)_prepare_image_like_inputs _preprocess)rrrrrrrs r-_preprocess_image_like_inputs3VitPoseImageProcessor._preprocess_image_like_inputsps>00L]1  w1&11r,imagez torch.TensorrArBrotationrec[XBS-[R"URUR45S- US-5nUR SSS5R 5R5n[XvURUR4S9n[R"U5R SSS5RUR5n U $)z7Apply an affine transformation to a torch tensor image.g@r8rrrIr)rcrdre) rXr9r:r>r?permutecpunumpyrltorch from_numpytor) rrrArBrretransformationimage_nptransformed_np transformeds r-r&VitPoseImageProcessor.affine_transforms) slBHHdjj$++-F$G#$MuW\} ==Aq)--/557*xQUQ\Q\^b^h^hPij&&~6>>q!QGJJ5<<X r, do_resizeresamplez7PILImageResampling | tvF.InterpolationMode | int | Nonedo_center_crop crop_size do_rescalerescale_factor do_normalize image_mean image_stddo_padpad_sizedisable_groupingreturn_tensorsr r!c UbqU(aj/n[UU5HVunnUHJn[UURURUS9unnUR UUUSUS9nUR U5 ML MX Un[ XS9unn0nUR5HunnURUXxXU 5nUUU'M! [UU5n [SU 0US9$)z!Custom preprocessing for VitPose.)r0r1r!r)rre)rr)data tensor_type) ziprCr>r?rappendr itemsrescale_and_normalizer r)!rrrrerrrrrrrrrrrrr r!rrtransformed_imagesr image_boxesr/rArBtransformed_imagegrouped_imagesgrouped_images_indexprocessed_images_groupedr`stacked_imagesprocessed_imagess! r-r!VitPoseImageProcessor._preprocesss.  !4!# &)&%&8"{&C$;$(JJ%)[[)9 %MFE )-(=(=eVU]^ei(=(j%&--.?@''9(F/DV/o,,#% %3%9%9%; !E>!77 LV_N/= $U + &< **BDXY.2B!CQ_``r,rmrcURupVpx[U5up[XUS9n [U5Hn [ XX,X<Xx/S9X'M X4$)zRGet final keypoint predictions from heatmaps and transform them back to the image.r)rArBr)r`rrr_r) rrmrArBrr{r}r?r>rrrrfs r-keypoints_from_heatmaps-VitPoseImageProcessor.keypoints_from_heatmapss](0~~$ v1(;26FSz"A&ux `f_noEH#}r,outputsr kernel_size threshold target_sizesc4[US5 URRupg nUbU[U5:wa [ S5e[ R "US4[ RS9n [ R "US4[ RS9n [[R"U65n [U5Hrn Ub.X\SX\Sp[ R"XX/5nXU-X'URSURS nn[XUUS 9unnUXSS24'UXSS24'Mt URURR!5R#5XUS 9unn[ R "US 4[ RS9nU SS2SS24USS2SS24'U SS2SS24USS2SS 24'[$R&"U5n[$R&"U5n[$R("SU5n[$R&"[+U55n/n[-UUU5nUHon/nUHSn[/U5unnn UR15nUn!UbUU:n"UU"nUU"nU!U"n!UUU!U S .n#UR3U#5 MU UR3U5 Mq U$)a^ Transform the heatmaps into keypoint predictions and transform them back to the image. Args: outputs (`VitPoseEstimatorOutput`): VitPoseForPoseEstimation model outputs. boxes (`list[list[list[float]]]` or `np.ndarray`): List or array of bounding boxes for each image. Each box should be a list of 4 floats representing the bounding box coordinates in COCO format (top_left_x, top_left_y, width, height). kernel_size (`int`, *optional*, defaults to 11): Gaussian kernel size (K) for modulation. threshold (`float`, *optional*, defaults to None): Score threshold to keep object detection predictions. target_sizes (`torch.Tensor` or `list[tuple[int, int]]`, *optional*): Tensor of shape `(batch_size, 2)` or list of tuples (`tuple[int, int]`) containing the target size `(height, width)` of each image in the batch. If unset, predictions will be resize with the default value. Returns: `list[list[Dict]]`: A list of dictionaries, each dictionary containing the keypoints and boxes for an image in the batch as predicted by the model. rNzTMake sure that you pass in as many target sizes as the batch dimension of the logitsrIr6rrr>r?)r0r1rr4) keypointsrlabelsbbox)rrmr`rrtr9rQr;list itertoolschainr_r:rerCrrrrtensorrrrnextrr)$rrrrrrr{r|r}centersscalesflattened_boxesrfr0r1 scale_factorr>r?rArBrr all_boxesposesr bboxes_xyxyresultspose_bbox_pairs image_bboxes image_resultsposescore bbox_xyxykeypoints_labelskeep pose_results$ r-post_process_pose_estimation2VitPoseImageProcessor.post_process_pose_estimations8 $(*1*:*:*@*@' 1a  # c,6G(Gst t((J?"**=:q/<y67z"A',8OA,> PQ@R\!xxK(^_ %4%7,%F" IIg. (0C6E3O4FTYhnoMFE"GqDM Fa4L#44    " ( ( *GK5 vHHj!_BJJ? #AqsFO !QqS&"1ac6N !QqS& U#f%a/ll#5i#@A 79eV[9!L;=M!)-o)>&eY #) ( 9,D:D!$KE'7'=$,0EM]gpq $$[1" NN= )"r,r")N)TrN) )r NN)-r#r$r%r&r'r valid_kwargsmodel_input_namesr rr rrerrr r!rrrrrr*r9rqrrr(r rstrrrcompilerdisabletuplerrrrrrrr+ __classcell__)rs@r-rrPsO@.L'(&J$IC (DJL#(C!D# ; ;De%&3 ;45 ;  ; ;&59 22De%&3d:2 2 , 2 c>)*T1 2 2" ^^e U|      D%)"'*.'-a^$-a-a -a L -a  -a-a-a-a-aDK'$.-a4;&--at -aT/-a+-a j(4/!-a""#-a$ %-a&bjj 4''-a* +-ah **   zz   &"&8< F)FDe%&3F F 4< F !4;.5 FFr,r)rg?)r)r7s) ' 7;2E5 ?8   H % #,e #"$ )  "))) )  )X"5"bjj"BJJ"]_]g]g"J4rzzeBJJ