Pg!UddlmZmZddlmZddlmZddlmZddl m Z ddl m Z dd l mZmZe j eZd d d d Zeeefed<GddedZGddeZdgZy))MappingSequence)Optional) BatchFeature) ImageInput)Unpack)logging)Gemma3ProcessorGemma3ProcessorKwargszNo Dangerous Content: The image shall not contain content that facilitates or encourages activities that could cause real-world harm (e.g., building firearms and explosive devices, promotion of terrorism, instructions for suicide).zNo Sexually Explicit content: The image shall not contain content that depicts explicit or graphic sexual acts (e.g., pornography, erotic nudity, depictions of rape or sexual assault).zNo Violence/Gore content: The image shall not contain content that depicts shocking, sensational, or gratuitous violence (e.g., excessive blood and gore, gratuitous violence against animals, extreme injury or moment of death).) dangeroussexualviolenceDEFAULT_SHIELDGEMMA2_POLICIEScPeZdZUeeeed<eeeefed<ddiddidZy) ShieldGemma2ProcessorKwargspoliciescustom_policiespaddingTdo_pan_and_scanF) text_kwargs images_kwargsN) __name__ __module__ __qualname__rrstr__annotations__r _defaults/var/www/html/suriana-translation/venv/lib/python3.12/site-packages/transformers/models/shieldgemma2/processing_shieldgemma2.pyrr1sDx}%%gc3h/00 t  u Ir!rF)totalcfeZdZ d fd Z d dedeedeffd ZdZ dZ e dZ xZ S) ShieldGemma2Processorc Vt|||||fi|| t|_y||_y)aA processor for the ShieldGemma 2 model. Args: image_processor: The image processor to use, typically a `Gemma3ImageProcessorFast` instance. tokenizer: The tokenizer to use, typically a `GemmaTokenizerFast` instance. chat_template: The chat template to use with this processor. Typically, this is unset as the processor configuration on Hugging Face Hub includes this value already. image_seq_length: The number of soft tokens per image. Typically, this is unset as the processor configuration on Hugging Face Hub includes this value already. policy_definitions: A mapping from policy name to its description in text used as the default policies to classify images against. The policy descriptions are included in the text of the prompts generated by this processor. Typically, this is unset as the processor configuration on Hugging Face Hub includes the base policies ShieldGemma was trained on. N)super__init__rpolicy_definitions)selfimage_processor tokenizer chat_templateimage_seq_lengthr)kwargs __class__s r"r(zShieldGemma2Processor.__init__?s5" )]DT_X^_  %&CD #&8D #r!imagesr/returnc ~~~|s tdt|ts|g}|js td|j di}|j ddurt jdd|d<|j di}d |vr*|jd d|d <|jd d |d <i|j|j d i}|j d x} t|j} g} g} |D]:} | D]3} | jdddid|| dgdg| j| g5<|j| d}t|<d| |d|S)aGenerates a batch of inputs from the provided images. ShieldGemma was trained to classify image content for policy compliance using a specific prompt construction. This processor generates a batch of such prompts from the provided images by: 1. Creating a list of conversations, one for each `` pair; 2. Converting these conversations to text using `self.apply_chat_template()`; and 3. Encoding the conversations and images using the same techniques as `Gemma3Processor`. Args: images: A single image or a list of images to include in the batch. text: Not supported. videos: Not supported. audio: Not supported. kwargs: An optional dictionary of keyword arguments to configre the processor. Possible values include: * `custom_policies`: Additional policy definitions that augment the `self.policy_definitions` passed into the constructor. Note that `custom_policies` that share a key with `self.policy_definitions` will override the policy description * `policies`: (Optional) a list of keys in the joint `self.policy_definitions | custom_policies` dictionary of specific interest for the provided images. If empty or None, prompts will be generated for every key in the joint dictionary. Returns: A `BatchFeature` continaing `input_ids`, `pixel_values`, etc. where each Tensor is of shape `(len(images) * len(policies), )`, and the order within the batch will be img1_policy1, ... img1_policyN, ... imgM_policyN. z&ShieldGemma 2 needs images to classifyz:ShieldGemma 2 requires the use of a specific chat templaterrTz+ShieldGemma2 does not support pan and scan.Frr padding_sideleftrrusertypeimagetext)r7r9)rolecontent)tokenize)r1r9r ) ValueError isinstancerr- setdefaultgetlogger warning_oncepopr)listkeysappendapply_chat_templater'__call__)r*r1r9videosaudior/rrr)rmessagesexpanded_imagesimgpolicyr0s r"rHzShieldGemma2Processor.__call__VsJ &%EF FFH-XF!!YZ Z))/2>   . /4 7    M N/4M+ ,'' r: K '%+ZZ 4%@K "*0**^V*LK '1 %%1 jj*B/1   :. .H 7.3356H .C" .%+!' 1)/9KF9S T(  &&u- . .''5'AwLTLVLLr!c:|jj|i|S)z This method forwards all its arguments to GemmaTokenizerFast's [`~PreTrainedTokenizer.batch_decode`]. Please refer to the docstring of this method for more information. )r, batch_decoder*argsr/s r"rPz"ShieldGemma2Processor.batch_decodes +t~~**D;F;;r!c:|jj|i|S)z This method forwards all its arguments to GemmaTokenizerFast's [`~PreTrainedTokenizer.decode`]. Please refer to the docstring of this method for more information. )r,decoderQs r"rTzShieldGemma2Processor.decodes %t~~$$d5f55r!c|jjdgz}|jj}ttj ||zS)Ntoken_type_ids)r,model_input_namesr+rDdictfromkeys)r*tokenizer_input_namesimage_processor_input_namess r"rWz'ShieldGemma2Processor.model_input_namessH $ @ @DTCU U&*&:&:&L&L#DMM"7:U"UVWWr!)NN)NNNN)rrrr(rr rrrHrPrTpropertyrW __classcell__)r0s@r"r%r%>sigk92"  VMVM 45 VM VMp<6XXr!r%N)collections.abcrrtypingrfeature_extraction_utilsr image_utilsrprocessing_utilsr utilsr gemma3.processing_gemma3r r get_loggerrrArrrrr%__all__r r!r"rhs .-4%&M   H % 1  :  /4wsCx0* "7u BXOBXJ # #r!