pyvene.models.constants

Functions

split_and_select(x, num_slice, selct_index)
split_half(x, selct_index)
split_head_and_permute(x, num_head)
split_heads(tensor, num_heads, attn_head_size)	Splits hidden_size dim into attn_head_size and num_heads.
split_three(x, selct_index)