Reposted by Manos Koukoumidis
BOS = Beginning of sequence/sentence
Also whoever decided to make Phi have 10 KV heads instead of a multiple of 4 or 8, why do you hate multiple GPUs 😭
Also whoever decided to make Phi have 10 KV heads instead of a multiple of 4 or 8, why do you hate multiple GPUs 😭
March 12, 2025 at 9:44 PM
BOS = Beginning of sequence/sentence
Also whoever decided to make Phi have 10 KV heads instead of a multiple of 4 or 8, why do you hate multiple GPUs 😭
Also whoever decided to make Phi have 10 KV heads instead of a multiple of 4 or 8, why do you hate multiple GPUs 😭