pyvene.models.constants.split_heads

Contents

pyvene.models.constants.split_heads#

split_heads(tensor, num_heads, attn_head_size)[source]#

Splits hidden_size dim into attn_head_size and num_heads.