Zi: UdZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z m Z m Z mZmZmZmZmZmZmZddlZddlmZmZmZmZmZmZmZddlmZm Z m!Z!d d l"m#Z#m$Z$e rdd l%m&Z&e'Z(ee'e fZ)ee*ee)e(d e+e,fZ-d dhZ.ej/e0Z1eGddZ2Gdde*Z3dZ4dZ5ede-de3fdZ6ededdedfdZ6dee-dee3fdZ6de-de'fdZ7de-de'de'fdZ8de'dd fdZ9de*de:fdZ;de*ded"ee*e>> b = MimeBytes(b"hello", "text/plain") >>> isinstance(b, bytes) True >>> b.mime_type 'text/plain' ``` mime_typeNr%ct||}||_t|tr| |j|_|SN)super__new__r4 isinstancer3)clsr%r4obj __class__s r1r8zMimeBytes.__new__SsFggooc4((! dI & & +9+< NCM r0r6) r'r(r)__doc__r r*r+r.r8 __classcell__)r<s@r1r3r3Bsr  }5Xc]r0r3cHtstdddl}|S)z.Make sure `numpy` is installed on the machine.zGPlease install numpy to use deal with embeddings (`pip install numpy`).rN)r ImportErrornumpy)rAs r1 _import_numpyrB^s.   ecdddLLL Lr0cLtstdddlm}|S)z,Make sure `PIL` is installed on the machine.zPlease install Pillow to use deal with images (`pip install Pillow`). If you don't want the image to be post-processed, use `client.post(...)` and get the raw response from the server.rr)rr@PILrrs r1_import_pil_imagerEgsA    `    Lr0contentreturncdSr6r/rFs r1_open_as_mime_bytesrJvs9<r0cdSr6r/rIs r1rJrJzsBE#r0c|dSt|trt|St|ttfrtt|St |drt d|}t |dr,tj t|j dnd}t|trtdt||St|tr|ds|d rt d |t|}|jd }|tj |d}t|j|St'|}|st+d |d t|t&rXt d|t|tj |dSt/rddlm}t||jrt dt5j}|jpd}|||t|d|StdtA|d)zOpen `content` as a binary file, either from a URL, a local path, raw bytes, or a PIL Image. Do nothing if `content` is None. NreadzReading content from BinaryIOnamerz3Expected binary stream (bytes), but got text stream)r4https://http://zDownloading content from z Content-TypezFile not found at z. If `data` is a string, it must either be a URL or a path to a local file. To pass raw content, please encode it as bytes first.zOpening content from rzConverting PIL Image to bytesPNG)formatzimage/zUnsupported content type: zl. Expected one of: bytes, bytearray, BinaryIO, memoryview, Path, str (URL or file path), or PIL.Image.Image.)!r9r.r3 bytearray memoryviewhasattrloggerdebugrM mimetypes guess_typer*rN TypeError startswithrgetr&rFrexistsFileNotFoundError read_bytesrrDrioBytesIOrRsavegetvaluelowertype)rFr%r4responserbufferrRs r1rJrJ~s8 t'5!!"!!!'Iz233)w(((w4 4555||~~BI'SYBZBZdI(W\):):;;A>>`d dC  SQRR R3333'3   j ) ) DW-?-? -J-J D LL>W>> ? ? ?"}}((11H (,,^<>:S:STTT T  uT']] u u u  r0clt|}tj|S)z\Encode a raw file (image, audio) into base64. Can be bytes, an opened file, a path or a URL.)rJbase64 b64encodedecode)rF raw_bytess r1 _b64_encoderms,#G,,I  I & & - - / //r0default_mime_typect|tr|dr|St|}|jp|}t j|}d|d|S)N)rPrOdata:rpz;base64,)r9r*r[rJr4rirjrk)rFrnrlr4 encoded_datas r1_as_urlrrs'3G$6$67W$X$X$G,,I#8'8I#I..5577L 59 4 4l 4 44r0 encoded_imagect}|jtjt j|S)z/Parse a base64-encoded string into a PIL Image.)rEopenr`rari b64decode)rsrs r1 _b64_to_imagerws4   E 5:bj!1-!@!@AA B BBr0cNtj|S)acParse bytes from a Response object into a Python list. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_dict` and will not complain if the returned data is a dictionary. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. r$loadsrkrIs r1_bytes_to_listr{ :gnn&& ' ''r0cNtj|S)acParse bytes from a Response object into a Python dictionary. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_list` and will not complain if the returned data is a list. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. ryrIs r1_bytes_to_dictr~r|r0cbt}|jtj|S)zParse bytes from a Response object into a PIL Image. Expects the response body to be raw bytes. To deal with b64 encoded images, use `_b64_to_image` instead. )rErur`ra)rFrs r1_bytes_to_imagers+   E 5:bj)) * **r0rfcXt|trtj|n|Sr6)r9r.r$rz)rfs r1_as_dictrs&#-h#>#> L4:h   HLr0 output_linesdetailsc#hK|D],} t||}n#t$rYdSwxYw||V-dS)z*Used in `InferenceClient.text_generation`.N%_format_text_generation_stream_output StopIterationrrlineoutputs r1 _stream_text_generation_responsersk  :4IIFF    EEE   LLL s  ((cvK|23d{V} t||}n#t$rYdSwxYw||WV36dS)z/Used in `AsyncInferenceClient.text_generation`.Nrrs r1&_async_stream_text_generation_responsers #d :4IIFF    EEE   LLLL #lls8 --rc|dsdS|dkrtd|dd}t j|}|d)t|d|dtj |}|s |j j n|S)Nrp data: [DONE][DONE] signal received.z/nerror error_type) r[striprlstriprstripr$rzr\_parse_text_generation_errorrparse_obj_as_instancetokentext)rrpayload json_payloadrs r1rrs ??7 # #t zz||~%%5666kk'""))$//G:g&&L  ,*<+@,BRBRS_B`B`aaa( =l K KF$+ 76<  7r0linesc#fK|D]+} t|}n#t$rYdSwxYw||V,dS)zFUsed in `InferenceClient.chat_completion` if model is served with TGI.N%_format_chat_completion_stream_outputrrrrs r1 _stream_chat_completion_responser5si :4@@FF    EEE   LLL s  ''ctK|23d{V} t|}n#t$rYdSwxYw||WV26dS)z/Used in `AsyncInferenceClient.chat_completion`.Nrrs r1&_async_stream_chat_completion_responserBsd :4@@FF    EEE   LLLL ees7 ,,c|dsdS|dkrtdtj|d}|d)t|d|dtj |S)Nrprrrr) r[rrr$rzrr\rrr)rrs r1rrOs ??7 # #t zz||~%%5666:dkk'2288::;;L  ,*<+@,BRBRS_B`B`aaa & ;L I IIr0clientcrK|23d{V}|WV6dSr6) aiter_linesr)rrfrs r1_async_yield_fromrcs_**,,djjll-,,s6#_UNSUPPORTED_TEXT_GENERATION_KWARGSr#unsupported_kwargscbt|g|dSr6)r setdefaultextend)r#rs r1'_set_unsupported_text_generation_kwargsr}s-'225"==DDEWXXXXXr0c8t|gSr6)rr\)r#s r1'_get_unsupported_text_generation_kwargsrs . 2 25" = ==r0 http_errorc|j| t|ddp|j}|d}|d}n#t$r|wxYw|t ||}|||)z Try to parse text-generation-inference error message and raise HTTPError in any case. Args: error (`HTTPError`): The HTTPError that have been raised. Nresponse_error_payloadrr)rfgetattrr$r\ Exceptionr)rrrr exceptions r1raise_text_generation_errorrs"*&>EEcI\IaIaIcIc G$$[[.. 0 CC Z' s AA A-rrc|dkrt|S|dkrt|S|dkrt|S|dkrt|St |S)N generationincomplete_generation overloaded validation)rrrrr)rrs r1rrsu\!!u%%%,,,(///\!!u%%%\!!u%%%   r0)Pr=rir`r$loggingrX dataclassesrpathlibrtypingrrrrr r r r r rhttpxhuggingface_hub.errorsrrrrrrrutilsrrr_generated.typesrr PIL.Imagerr*UrlTPathTr.rSrTContentTTASKS_EXPECTING_IMAGES getLoggerr'rVr r3rBrErJrmrrrwr-r{r,r~rrboolrrrrrr AsyncClientResponserrr+rrrrr/r0r1rs%LKK !!!!!!vvvvvvvvvvvvvvvvvvvvvvvv IHHHHHHHHHTTTTTTTT   c4i %w :M N*+;<  8 $ $  8    < >?     $ /3  = }-GH HI    8 88 eC33458888,  C=  ()        -.    J J ()JJJJ(E$5TabeTf.GI#T(3-c*B%CHHHY8C=YVZ[^V_YdhYYYY>8C=>T#Y>>>>Nx:  8C= Uh      r0