3 Commits

Author	SHA1	Message	Date
jacobthebanana	8cbba4622c	Possible fix for conflict between Automated Prefix Caching (#2762) and multi-LoRA support (#1804) (#3263)	2024-03-07 23:03:22 +00:00
Nick Hill	8999ec3c16	Store eos_token_id in Sequence for easy access (#3166)	2024-03-05 15:35:43 -08:00
Sage Moore	ce4f5a29fb	Add Automatic Prefix Caching (#2762) ... Co-authored-by: ElizaWszola <eliza@neuralmagic.com> Co-authored-by: Michael Goin <michael@neuralmagic.com>	2024-03-02 00:50:01 -08:00