pyvene.models.mllama.modelings_intervenable_mllama#

Each modeling file in this library is a mapping between abstract naming of intervention anchor points and actual model module defined in the huggingface library.

We also want to let the intervention library know how to config the dimensions of intervention based on model config defined in the huggingface library.

Author: Alexa Tartaglini

Module Attributes

`mllama_type_to_dimension_mapping`	mllama model with LM head
`mllama_lm_type_to_dimension_mapping`	llama model with classifier head

Functions

create_mllama([name, cache_dir, dtype, config])

Creates a LLaMA Causal LM model, config, and tokenizer from the given name and revision