youngkingdom/vllm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,863 Commits 157 Branches 93 Tags
2aed2c9fa7f9f751b994c6563893dcb048e0ae7b
Commit Graph

1 Commits

Author SHA1 Message Date
Lingfan Yu
33170081f1 [Neuron][Kernel] Vectorize KV cache load in FlashPagedAttention to maximize DMA bandwidth (#13245) 
Signed-off-by: Lingfan Yu <lingfany@amazon.com>
 2025-02-20 17:45:45 -08:00