bi*X d dl Z d dlZd dlZd dlmZmZ d dlZd dlm Z m
Z
ddl m Z ddl
mZ ddlmZmZ ddlmZmZmZmZmZmZ dd lmZ ed
d Z ej e Z G d
de Z G d d e Z ee j! e _! e j! j" .e j! j" # ddd e j! _" dS dS ) N)AnyTypeVar) create_repois_offline_mode )custom_object_save) BatchFeature)is_valid_image
load_image)IMAGE_PROCESSOR_NAMEPROCESSOR_NAMEPushToHubMixin copy_funcloggingsafe_load_json_file) cached_fileImageProcessorTypeImageProcessingMixin)boundc e Zd ZdZdS )r a
Holds the output of the image processor specific `__call__` methods.
This class is derived from a python dictionary and can be used as a dictionary.
Args:
data (`dict`):
Dictionary of lists/arrays/tensors returned by the __call__ method ('pixel_values', etc.).
tensor_type (`Union[None, str, TensorType]`, *optional*):
You can give a tensor_type here to convert the lists of integers in PyTorch/Numpy Tensors at
initialization.
N)__name__
__module__ __qualname____doc__ ]/root/projects/butler/venv/lib/python3.11/site-packages/transformers/image_processing_base.pyr r - s r r c e Zd ZdZdZd Ze d dee de e
j z de e
j z dz d e d
e d e e z dz d e d
efd Z
d!de e
j z de fdZede e
j z d
eee ef ee ef f fd Zedee ef fd Zd
ee ef fdZede e
j z fd Zd
e fdZde e
j z fdZd Zed"d Zd e ee z eee z fd ZdS )#r z
This is an image processor mixin used to provide saving/loading functionality for sequential and image feature
extractors.
Nc
$ | dd | dd | D ]N\ }} t | || # t $ r*}t d| d| d| |d}~ww xY wdS )z'Set elements of `kwargs` as attributes.feature_extractor_typeNprocessor_classz
Can't set z with value z for )popitemssetattrAttributeErrorloggererror)selfkwargskeyvalueerrs r __init__z ImageProcessingMixin.__init__E s
+T222
$d+++ ,,.. JC
c5))))!
M# M M5 M Mt M MNNN
s A
B
#%BB
Fmaincls pretrained_model_name_or_path cache_dirforce_downloadlocal_files_onlytokenrevisionreturnc v ||d< ||d< ||d< ||d< |||d< | j |fi |\ }} | j |fi |S )a
Instantiate a type of [`~image_processing_utils.ImageProcessingMixin`] from an image processor.
Args:
pretrained_model_name_or_path (`str` or `os.PathLike`):
This can be either:
- a string, the *model id* of a pretrained image_processor hosted inside a model repo on
huggingface.co.
- a path to a *directory* containing a image processor file saved using the
[`~image_processing_utils.ImageProcessingMixin.save_pretrained`] method, e.g.,
`./my_model_directory/`.
- a path or url to a saved image processor JSON *file*, e.g.,
`./my_model_directory/preprocessor_config.json`.
cache_dir (`str` or `os.PathLike`, *optional*):
Path to a directory in which a downloaded pretrained model image processor should be cached if the
standard cache should not be used.
force_download (`bool`, *optional*, defaults to `False`):
Whether or not to force to (re-)download the image processor files and override the cached versions if
they exist.
proxies (`dict[str, str]`, *optional*):
A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128',
'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request.
token (`str` or `bool`, *optional*):
The token to use as HTTP bearer authorization for remote files. If `True`, or not specified, will use
the token generated when running `hf auth login` (stored in `~/.huggingface`).
revision (`str`, *optional*, defaults to `"main"`):
The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a
git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any
identifier allowed by git.
To test a pull request you made on the Hub, you can pass `revision="refs/pr/"`.
return_unused_kwargs (`bool`, *optional*, defaults to `False`):
If `False`, then this function returns just the final image processor object. If `True`, then this
functions returns a `Tuple(image_processor, unused_kwargs)` where *unused_kwargs* is a dictionary
consisting of the key/value pairs whose keys are not image processor attributes: i.e., the part of
`kwargs` which has not been used to update `image_processor` and is otherwise ignored.
subfolder (`str`, *optional*, defaults to `""`):
In case the relevant files are located inside a subfolder of the model repo on huggingface.co, you can
specify the folder name here.
kwargs (`dict[str, Any]`, *optional*):
The values in kwargs of any keys which are image processor attributes will be used to override the
loaded values. Behavior concerning key/value pairs whose keys are *not* image processor attributes is
controlled by the `return_unused_kwargs` keyword parameter.
Returns:
A image processor of type [`~image_processing_utils.ImageProcessingMixin`].
Examples:
```python
# We can't instantiate directly the base class *ImageProcessingMixin* so let's show the examples on a
# derived class: *CLIPImageProcessor*
image_processor = CLIPImageProcessor.from_pretrained(
"openai/clip-vit-base-patch32"
) # Download image_processing_config from huggingface.co and cache.
image_processor = CLIPImageProcessor.from_pretrained(
"./test/saved_model/"
) # E.g. image processor (or model) was saved using *save_pretrained('./test/saved_model/')*
image_processor = CLIPImageProcessor.from_pretrained("./test/saved_model/preprocessor_config.json")
image_processor = CLIPImageProcessor.from_pretrained(
"openai/clip-vit-base-patch32", do_normalize=False, foo=False
)
assert image_processor.do_normalize is False
image_processor, unused_kwargs = CLIPImageProcessor.from_pretrained(
"openai/clip-vit-base-patch32", do_normalize=False, foo=False, return_unused_kwargs=True
)
assert image_processor.do_normalize is False
assert unused_kwargs == {"foo": False}
```r1 r2 r3 r5 Nr4 )get_image_processor_dict from_dict) r/ r0 r1 r2 r3 r4 r5 r) image_processor_dicts r from_pretrainedz$ImageProcessingMixin.from_pretrainedT s{ n ({#1 %5!" %z #F7O'Cs'CDa'l'lek'l'l$ f s} 1<>. ) ) h !f>!f!f!fgg g
NT2222 J #ZZ(8$ ? ?N jjN,@,@,M,Mb,QRRG!'CCDCFCCKG # 9 9. I I ' t^D A A A A ')gll>CW&X&X# 5666 M0KMMNNN ' ' - jj))
(
,,,r c
X | dd }| dd }| dd }| dd }| dd }| dd }| d d
} | d t }
| d d } | d
d } d| d}
| | |
d< t r |s t d d}t | }t j | }t j | r t j ||
}t j
| r|}d}d}nn|
} t |t ||||||
|| d }t ||||||||
|| d }n1# t $ r t $ r t d| d| d|
d w xY wd}|t | }d|v r|d }||t | }|t d| d| d|
d |r t d| n t d| d| ||fS )a
From a `pretrained_model_name_or_path`, resolve to a dictionary of parameters, to be used for instantiating a
image processor of type [`~image_processor_utils.ImageProcessingMixin`] using `from_dict`.
Parameters:
pretrained_model_name_or_path (`str` or `os.PathLike`):
The identifier of the pre-trained checkpoint from which we want the dictionary of parameters.
subfolder (`str`, *optional*, defaults to `""`):
In case the relevant files are located inside a subfolder of the model repo on huggingface.co, you can
specify the folder name here.
image_processor_filename (`str`, *optional*, defaults to `"config.json"`):
The name of the file in the model directory to use for the image processor config.
Returns:
`tuple[Dict, Dict]`: The dictionary(ies) that will be used to instantiate the image processor object.
r1 Nr2 Fproxiesr4 r3 r5 subfolder image_processor_filename_from_pipeline
_from_autoimage processor) file_typefrom_auto_classusing_pipelinez+Offline mode: forcing local_files_only=TrueT)
filenamer1 r2 rV r3 r4
user_agentr5 rW %_raise_exceptions_for_missing_entriesz Can't load image processor for 'z'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'z2' is the correct path to a directory containing a z fileimage_processorzloading configuration file z from cache at )r" r r r& rO strrD rE isdirrM rF r r
OSError Exceptionr )r/ r0 r) r1 r2 rV r4 r3 r5 rW rY
from_pipeliner^ ra is_localimage_processor_file resolved_image_processor_fileresolved_processor_filer: processor_dicts r r8 z-ImageProcessingMixin.get_image_processor_dict s ( JJ{D11 $4e<<**Y--
7D))!::&8%@@::j$//JJ{B// #)::.HJ^#_#_
#3T::
**\599#4 YY
$+8J' ( $%5 $ KKE F F F # (+,I(J(J%7==!>??
7==6 7 7 i#%7<<0MOg#h#h
7>>7 8 8 , ,I )&* #HH#; &
*51 + '#1 #%5 ) % ':? + + +' 1<1 1 '#1 #%5 ) % ':? 1 1 1--
O7T O O9VO O 0HO O O
$ " . 01H I IN N22'56G'H$ ( 49M9U#67T#U#U 'K3P K K5RK K ,DK K K
KKU6SUU V V V V KKr.BrrSprr
$V++s 09G* *.Hr: c | }| dd }| fd| D di |}t | D ]'}t || r| | (t d| |r||fS |S )a
Instantiates a type of [`~image_processing_utils.ImageProcessingMixin`] from a Python dictionary of parameters.
Args:
image_processor_dict (`dict[str, Any]`):
Dictionary that will be used to instantiate the image processor object. Such a dictionary can be
retrieved from a pretrained checkpoint by leveraging the
[`~image_processing_utils.ImageProcessingMixin.to_dict`] method.
kwargs (`dict[str, Any]`):
Additional parameters from which to initialize the image processor object.
Returns:
[`~image_processing_utils.ImageProcessingMixin`]: The image processor object instantiated from those
parameters.
return_unused_kwargsFc 8 i | ]\ }}|j j v ||S r ) valid_kwargs__annotations__).0kvr/ s r
z2ImageProcessingMixin.from_dict..q s/ $n$n$ndaSM]MmHmHmQHmHmHmr zImage processor Nr )copyr" updater# listhasattrr& rO )r/ r: r) ro rc r* s ` r r9 z ImageProcessingMixin.from_dict^ s " 4 8 8 : : %zz*@% H H ##$n$n$n$nfllnn$n$n$nooo #55 455 << C,,
3 888999 #"F* *" "r c V t j | j }| j j |d< |S )z
Serializes this instance to a Python dictionary.
Returns:
`dict[str, Any]`: Dictionary of all the attributes that make up this image processor instance.
image_processor_type)rw deepcopy__dict__ __class__r )r( outputs r to_dictz ImageProcessingMixin.to_dict s* t}--)- )@%&
r json_filec t |d 5 }| }ddd n # 1 swxY w Y t j | } | di |S )a
Instantiates a image processor of type [`~image_processing_utils.ImageProcessingMixin`] from the path to a JSON
file of parameters.
Args:
json_file (`str` or `os.PathLike`):
Path to the JSON file containing the parameters.
Returns:
A image processor of type [`~image_processing_utils.ImageProcessingMixin`]: The image_processor object
instantiated from that JSON file.
utf-8encodingNr )openreadjsonloads)r/ r readertextr: s r from_json_filez#ImageProcessingMixin.from_json_file s )g
.
.
. !&;;==D ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! #z$ / / s**)***s 377c | }| D ]6\ }}t |t j r| ||< 7t
j |dd dz S )z
Serializes this instance to a JSON string.
Returns:
`str`: String containing all the attributes that make up this feature_extractor instance in JSON format.
T)indent sort_keys
)r r#
isinstancenpndarraytolistr dumps)r(
dictionaryr* r+ s r to_json_stringz#ImageProcessingMixin.to_json_string sr \\^^
$**,, 1 1JC%,,
1"',,..
3z*Q$???$FFr json_file_pathc t |dd 5 }| | ddd dS # 1 swxY w Y dS )z
Save this instance to a JSON file.
Args:
json_file_path (`str` or `os.PathLike`):
Path to the JSON file in which this image_processor instance's parameters will be saved.
wr r N)r writer )r( r writers r rN z!ImageProcessingMixin.to_json_file s .#
8
8
8 0F LL,,.. / / / 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0s (AA A c H | j j d| S )N )r r r )r( s r __repr__z ImageProcessingMixin.__repr__ s' .)CCD,?,?,A,ACCCr AutoImageProcessorc t |t s|j }ddlmc m} t
|| st | d || _ dS )a{
Register this class with a given auto class. This should only be used for custom image processors as the ones
in the library are already mapped with `AutoImageProcessor `.
Args:
auto_class (`str` or `type`, *optional*, defaults to `"AutoImageProcessor "`):
The auto class to register this new image processor with.
r Nz is not a valid auto class.) r rd r transformers.models.automodelsautorz
ValueErrorrL )r/
auto_class auto_modules r register_for_auto_classz,ImageProcessingMixin.register_for_auto_class sn *c** -#,J666666666{J// I
G G GHH H$r image_url_or_urlsc t |t r fd|D S t |t rt | S t | r|S t dt
| )z
Convert a single or a list of urls into the corresponding `PIL.Image` objects.
If a single url is passed, the return value will be a single object. If a list is passed a list of objects is
returned.
c : g | ]} | S r ) fetch_images)rs xr( s r
z5ImageProcessingMixin.fetch_images.. s' DDDQD%%a((DDDr z=only a single or a list of entries is supported but got type=)r ry rd r r
TypeErrortype)r( r s ` r r z!ImageProcessingMixin.fetch_images s ' . . wDDDD2CDDD D
)3
/
/ w /00 0
-
.
. w$ $ u\`ar\s\s u uvv vr )NFFNr. )F)r ) r r r r rL r- classmethodr r rd rD PathLikeboolr; rT tupledictr r8 r9 r r r rN r r ry r r r r r r = s
K
/3 $!&#' `= `=
$
%`='*R['8`= $t+`= `=
`= TzD
`= `=
`= `= `= [`=D.- .-cBK.? .-d .- .- .- .-` t,,/"+,=t, tCH~tCH~- .t, t, t, [t,l #T#s(^ # # # [ #@
c3h
+sR['8 + + + [+$
G
G
G
G
G 03+< 0 0 0 0D D D % % % [%*wcDIoT#Y.O w w w w w wr r\ r zimage processor file)object object_class object_files)$rw r rD typingr r numpyr huggingface_hubr r dynamic_module_utilsr feature_extraction_utilsr BaseBatchFeature image_utilsr
r utilsr r
r r r r utils.hubr r
get_loggerr r& r r= r formatr r r r s 8 8 8 8 8 8 8 8 4 4 4 4 4 4 F F F F F F 3 3 3 3 3 3 3 3 # " " " " " W 19OPPP
H % %
# bw bw bw bw bw> bw bw bwJ
$-9-A-M#N#N #+7/C/O/W/^/^ /CRh 0_ 0 0$,,, 87r