biXdZddlmZddlmZddlmZmZeje Z dZ dS)z Liger Kernel integration for applying optimized Triton kernels to transformer models. See https://github.com/linkedin/Liger-Kernel for details. )PreTrainedModel)unwrap_peft_model)is_liger_kernel_availableloggingctstdddlm}|pi}t |}t |t r |dd|i|dStddS)al Apply Liger Kernel optimizations to a model instance. Liger Kernel provides optimized Triton kernels for common transformer operations. This function patches the model in-place with those kernels. Args: model: The model to patch. Must be a `PreTrainedModel` or a PEFT wrapper around one. kernel_config: Kernel configuration. zYou have set `use_liger_kernel` to `True` but liger-kernel >= 0.3.0 is not available. Please install it with `pip install liger-kernel`)_apply_liger_kernel_to_instancemodelzRThe model is not an instance of PreTrainedModel. No liger kernels will be applied.N) r ImportErrorliger_kernel.transformersr r isinstancerloggerwarning)r kernel_configr base_models Z/root/projects/butler/venv/lib/python3.11/site-packages/transformers/integrations/liger.pyapply_liger_kernelrs % & &  @   JIIIII!'RM"5))J*o..m''JJjJMJJJJJklllllN) __doc__modeling_utilsr trainer_utilsrutilsrr get_logger__name__rrr rrrs -,,,,,------66666666  H % %mmmmmr