[Bugfix][Model] Attempt to fix eagle in V0. (#18978)

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
2025-06-02 11:15:53 -04:00
parent 20133cfee2
commit ca2f6b9c30
1 changed files with 2 additions and 1 deletions
--- a/vllm/config.py
+++ b/vllm/config.py
@ -2595,7 +2595,8 @@ class SpeculativeConfig:
                    else:
                        eagle_config = EAGLEConfig(
                            self.draft_model_config.hf_config,
-                            method=self.method)
+                            method=self.method,
+                            model_type="eagle")
                        self.draft_model_config.hf_config = eagle_config

                if (self.num_speculative_tokens is not None