pyvene.models.whisper.modelings_intervenable_whisper.whisper_type_to_dimension_mapping

whisper_type_to_dimension_mapping = {'attention_input': ('d_model',), 'attention_output': ('d_model',), 'attention_value_output': ('d_model',), 'block_input': ('d_model',), 'block_output': ('d_model',), 'head_attention_value_output': ('d_model/encoder_attention_heads',), 'head_key_output': ('d_model/encoder_attention_heads',), 'head_query_output': ('d_model/encoder_attention_heads',), 'head_value_output': ('d_model/encoder_attention_heads',), 'key_output': ('d_model',), 'mlp_activation': ('encoder_ffn_dim',), 'mlp_input': ('d_model',), 'mlp_output': ('d_model',), 'n_head': ('encoder_attention_heads',), 'query_output': ('d_model',), 'value_output': ('d_model',)}

whisper model with LM head