3 Commits

Author	SHA1	Message	Date
Michael Goin	978aed5300	[Kernel][Attention] Separate Attention.kv_scale into k_scale and v_scale (#6081)	2024-07-16 15:31:32 -07:00
Cyrus Leung	0e9164b40a	[mypy] Enable type checking for test directory (#5017)	2024-06-15 04:45:31 +00:00
Eric Xihui Lin	8e192ff967	[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799) ... Co-authored-by: beagleski <yunanzhang@microsoft.com> Co-authored-by: bapatra <bapatra@microsoft.com> Co-authored-by: Barun Patra <codedecde@users.noreply.github.com> Co-authored-by: Michael Goin <michael@neuralmagic.com>	2024-05-24 22:00:52 -07:00