bi2UddlmZddlmZmZmZmZddlmZddl m Z ddl m Z m Z ddlmZe r dd lmZdd l mZeed efZeed <Gd deZGddeZdedeeefdZGddeZdS))Sequence)Any TypeAlias TypedDictUnion)overload) is_pil_image)is_vision_availablerequires_backends)Pipeline)Image load_imagez Image.Image ImagePairc$eZdZUeed<eed<dS)KeypointxyN)__name__ __module__ __qualname__float__annotations__c/root/projects/butler/venv/lib/python3.11/site-packages/transformers/pipelines/keypoint_matching.pyrr"s" HHH HHHHHrrc.eZdZUeed<eed<eed<dS)Matchkeypoint_image_0keypoint_image_1scoreN)rrrrrrrrrr r 's1 LLLLLrr imagesreturncd}dt|trNt|dkrtfd|Dr|gStfd|Dr|St |)N)z-Input images must be a one of the following :z - A pair of images.z - A list of pairs of images.cJt|pt|tS)z"images is a PIL Image or a string.)r isinstancestr)images r_is_valid_imagez-validate_image_pairs.._is_valid_image4sE""z'validate_image_pairs..9s-#Q#Q__U%;%;#Q#Q#Q#Q#Q#Qrc3K|]G}t|to-t|dkotfd|DVHdS)r c3.K|]}|VdSr-rr.s rr0z1validate_image_pairs...>s-CCuOOE**CCCCCCrN)r(rlenall)r/ image_pairr+s rr0z'validate_image_pairs..;s}   z8 , , DJ1$ DCCCC CCCCC      r)r(rr3r4 ValueError)r$ error_messager+s @rvalidate_image_pairsr8-sM ===&(##  v;;!  #Q#Q#Q#Q&#Q#Q#Q Q Q 8O     %        M ] # ##rc BeZdZdZdZdZdZdZfdZddZ e dde d e d e d eefd Ze ddee d e d e d eeefd Z ddee e zd e d e d eeeeezffd ZddZdZdd eefdZxZS)KeypointMatchingPipelinez Keypoint matching pipeline using any `AutoModelForKeypointMatching`. This pipeline matches keypoints between two images. FTcZtj|i|t|ddS)Nvision)super__init__r )selfargskwargs __class__s rr>z!KeypointMatchingPipeline.__init__Os5$)&)))$)))))rNc0i}|||d<i}|||d<|i|fS)Ntimeout thresholdr)r?rErDpreprocess_paramspostprocess_paramss r_sanitize_parametersz-KeypointMatchingPipeline._sanitize_parametersSs>  +2 i (  .7 { + "&888rinputsrErAr%c dSr-rr?rJrErAs r__call__z!KeypointMatchingPipeline.__call__\sadadrc dSr-rrLs rrMz!KeypointMatchingPipeline.__call___smpmprc |tdt|}tj|fd|i|}t |dkr|dS|S)a Find matches between keypoints in two images. Args: inputs (`str`, `list[str]`, `PIL.Image` or `list[PIL.Image]`): The pipeline handles three types of images: - A string containing a http link pointing to an image - A string containing a local path to an image - An image loaded in PIL directly The pipeline accepts either a single pair of images or a batch of image pairs, which must then be passed as a string. Images in a batch must all be in the same format: all as http links, all as local paths, or all as PIL images. threshold (`float`, *optional*, defaults to 0.0): The threshold to use for keypoint matching. Keypoints matched with a lower matching score will be filtered out. A value of 0 means that all matched keypoints will be returned. kwargs: `timeout (`float`, *optional*, defaults to None)` The maximum time in seconds to wait for fetching images from the web. If None, no timeout is set and the call may block forever. Return: Union[list[Match], list[list[Match]]]: A list of matches or a list if a single image pair is provided, or of lists of matches if a batch of image pairs is provided. Each match is a dictionary containing the following keys: - **keypoint_image_0** (`Keypoint`): The keypoint in the first image (x, y coordinates). - **keypoint_image_1** (`Keypoint`): The keypoint in the second image (x, y coordinates). - **score** (`float`): The matching score between the two keypoints. NzFCannot call the keypoint-matching pipeline without an inputs argument!rEr r)r6r8r=rMr3)r?rJrErAformatted_inputsoutputsrBs rrMz!KeypointMatchingPipeline.__call__bsoN >eff f/77"%''"#3SSySFSS  A % %1: rcfd|D}||d}||j}d|D}||d}|S)Nc2g|]}t|S))rDr)r/r*rDs r z7KeypointMatchingPipeline.preprocess..s&III*UG444IIIrpt)r$return_tensorscg|] }|j Sr)size)r/r*s rrTz7KeypointMatchingPipeline.preprocess..s777u 777r) model_inputs target_sizes)image_processortodtype)r?r$rDrYrZpreprocess_outputss ` r preprocessz#KeypointMatchingPipeline.preprocesssnIIII&III++6$+OO #tz22 77777 .:LYY!!rcH|d}|jdi|}||dgd}|S)NrYrZ) model_outputsrZr)model)r?r^rYraforward_outputss r_forwardz!KeypointMatchingPipeline._forwards@).9 " 22\22 ,9L^_mLnKopprc `|d}|d}|j|||}|d}g}t|d|d|dD]\}}} t|d|d }t|d|d }|t |||  t|d d }|S)NrarZ)rZrEr keypoints0 keypoints1matching_scoresr )rr)r!r"r#c|dS)Nr#r)rs rz6KeypointMatchingPipeline.postprocess..s ' rT)keyreverse)r[post_process_keypoint_matchingzipritemappendr sorted) r?rcrErarZpostprocess_outputs pair_resultkp_0kp_1r#s r postprocessz$KeypointMatchingPipeline.postprocesss0'8 &~6 "2QQ  R  2!4 !$  -  -  1 2" "  h h D$ d1gllnnQ ???Dd1gllnnQ ???D   udTY^YcYcYeYefff g g g g[.B.BDQQQ r)NN)rIr-)rrr__doc___load_processor_load_image_processor_load_feature_extractor_load_tokenizerr>rHrrrrlistr rMr_rdrv __classcell__)rBs@rr:r:EsO #O*****9999ddydUdCdTXY^T_dddXd pptIp5pRUpZ^_cdi_jZkpppXp --Y)+-- - etDK( ( ------^"""" T%[rr:N)collections.abcrtypingrrrrtyping_extensionsr image_utilsr utilsr r baserPILrrr)rrrr r8r:rrrrs%$$$$$$333333333333&&&&&&&&&&&&::::::::)(((((( mS&8 9: 9:::     y   I $$(92E)F$$$$0kkkkkxkkkkkr