youngkingdom/vllm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,968 Commits 157 Branches 93 Tags
8a74c68bd1ae48cb71e4c3bf9d7ff9a2ef8f9dae
Commit Graph

1 Commits

Author SHA1 Message Date
Varun Sundar Rabindranath
b5241e41d9 [ Kernel ] FP8 Dynamic-Per-Token Quant Kernel (#6511) 
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
 2024-07-18 01:38:35 +00:00