ZiPddlZddlmZddlmZddlmZmZmZm Z ddl m Z ddl m Z dd lmZmZerdd lmZejd ZGd d e ZedZedGddZdedeeeffdZdedeedefdZdededefdZdeedfdeeefdededef d Zd!ed"edeed#eed$eedeeeff d%ZdS)&N) dataclass)Path) TYPE_CHECKINGLiteralOptional TypedDict) constants)repo_folder_name)git_hash sha_fileobj)RepoFilez^[0-9a-f]{40}$c8eZdZUeed<eed<eed<eed<dS)Mismatchpathexpectedactual algorithmN)__name__ __module__ __qualname__str__annotations__^/root/projects/butler/venv/lib/python3.11/site-packages/huggingface_hub/utils/_verification.pyrrs4 IIIMMM KKKNNNNNrr)sha256git-sha1T)frozencpeZdZUeed<eed<eeed<eeed<eeed<eed<dS)FolderVerificationrevision checked_count mismatches missing_paths extra_paths verified_pathN) rrrrrintlistrrrrrr"r"scMMMX9crr"rootreturncFfddDS)z] Return a mapping of repo-relative path -> absolute path for all files under `root`. ci|]>}|||?Sr)is_file relative_toas_posix).0pr+s r z'collect_local_files..+s@ V V V!!))++ VAMM$   ( ( * *A V V Vr*)rglob)r+s`rcollect_local_filesr7's* W V V Vtzz# V V VVrstorage_folderr#cd|rt|r|S|dz }|dz }|rW||z }|r(|dSt d|d|d|dz }|r(|dS|st d |d d |D}t|d kr|d St d)zR Resolve a commit hash from a cache repo folder and an optional revision. refs snapshotszutf-8)encodingz Revision 'z1' could not be resolved in cache (expected file 'z').mainz+Cache repo is missing snapshots directory: z . Provide --revision explicitly.cg|]<}|t|j5|j=Sr)is_dir_REGEX_COMMIT_HASH fullmatchname)r2r3s r z3_resolve_commit_hash_from_cache..Fs?qqqQQXXZZqL^LhLhijioLpLpq!&qqqrr rzhAmbiguous cached revision: multiple snapshots found and no refs to disambiguate. Please pass --revision.) r@rAr/ read_textstrip ValueErrorr?iterdirlen)r8r#refs_dir snapshots_dirref_pathmain_ref candidatess r_resolve_commit_hash_from_cacherN.sj&00::&H"[0Mph&      @%%w%77==?? ?nhnnainnnooo& H<!!7!3399;;;    ! !xv}vvvwwwqq-"7"7"9"9qqqJ :!!} r  rrrc8|d5}|dkr-t|cdddS|dkr-t|cdddSt d|#1swxYwYdS)zM Compute the checksum of a local file using the requested algorithm. rbrNrzUnsupported hash algorithm: )openrhexr readrF)rrstreams rcompute_file_hashrUOs 4EF  v&&**,,EEEEEEEE  " "FKKMM** EEEEEEEE C CCDDD EEEEEEEEEEs'B &B=BBBremote_by_pathr local_by_pathr(c t|}t|}t||z }t||z }t||z}g} |D]} || } || } t| dd} | t| ddnd}|*t| tr| d}|r$d}t |}n*| j}d}t |}t| |}||kr&| t| |||t|t|| |||S)zHCompare remote entries and local files and return a verification result.lfsNrr)rrrr)r#r$r%r&r'r()setsortedgetattr isinstancedictgetrlowerblob_idrUappendrr"rH)rVrWr#r( remote_paths local_pathsmissingextrabothr%rel_path remote_entry local_pathrYlfs_sharrrars r verify_mapsrl\s~&&Lm$$K\K/00G ;- . .E ,, - -D!#Jnn%h/ "8, lE40025/'#x...t ?z#t44?ggh''G  ,"*I7||))++HH"*G"I7||))++H":y99 X     hHxPVbklll m m m $ii#    rrepo_id repo_type cache_dir local_dircX|it|}|st d|||p t jfSt|p t j}|t||z }| st d|dt||}|dz |z } | st d|d| d | |fS) zW Resolve the root directory to scan locally and the remote revision to verify. Nz6Local directory does not exist or is not a directory: )rmrnzRepo is not present in cache: z.. Use 'hf download' first or pass --local-dir.r;z0Snapshot directory does not exist for revision 'z': .) r expanduserresolver?rFr DEFAULT_REVISION HF_HUB_CACHEr existsrN) rmrnr#rorpr+ cache_rootr8commit snapshot_dirs rresolve_local_rootr{sEI))++3355{{}} ^\VZ\\]] ]h<)"<==i99#9::EEGGOOQQJ"27i"X"X"XXN  " "  k^ k k k   -^X F FF!K/&8L    hfFffWcfffggg  r) re dataclassesrpathlibrtypingrrrrr file_downloadr shar rhf_apircompiler@rHashAlgor"r^rr7rNrUrltupler{rrrrs !!!!!!>>>>>>>>>>>>,,,,,,&&&&&&&&"!!!!!! RZ 122y ' ( $WdWtCIWWWWDHSMVYB ED EX E# E E E E-j)-T ?- -  -  ----`   sm  ~  ~   49      r