Commit Graph

203 Commits

Author SHA1 Message Date
69c8d6d8a6 Single and dual clip loader nodes support SD3.
You can use the CLIPLoader to use the t5xxl only or the DualCLIPLoader to
use CLIP-L and CLIP-G only for sd3.
2024-06-11 23:27:39 -04:00
0e49211a11 Load the SD3 T5xxl model in the same dtype stored in the checkpoint. 2024-06-11 17:03:26 -04:00
5889b7ca0a Support multiple text encoder configurations on SD3. 2024-06-11 13:14:43 -04:00
8c4a9befa7 SD3 Support. 2024-06-10 14:06:23 -04:00
0920e0e5fe Remove some unused imports. 2024-05-27 19:08:27 -04:00
e1489ad257 Fix issue with lowvram mode breaking model saving. 2024-05-11 21:55:20 -04:00
93e876a3be Remove warnings that confuse people. 2024-05-09 05:29:42 -04:00
c61eadf69a Make the load checkpoint with config function call the regular one.
I was going to completely remove this function because it is unmaintainable
but I think this is the best compromise.

The clip skip and v_prediction parts of the configs should still work but
not the fp16 vs fp32.
2024-05-06 20:04:39 -04:00
8dc19e40d1 Don't init a VAE model when there are no VAE weights. 2024-04-24 09:20:31 -04:00
c59fe9f254 Support VAE without quant_conv. 2024-04-18 21:05:33 -04:00
30abc324c2 Support properly saving CosXL checkpoints. 2024-04-08 00:36:22 -04:00
0ed72befe1 Change log levels.
Logging level now defaults to info. --verbose sets it to debug.
2024-03-11 13:54:56 -04:00
65397ce601 Replace prints with logging and add --verbose argument. 2024-03-10 12:14:23 -04:00
ca7c310a0e Support loading old CLIP models saved with CLIPSave. 2024-02-25 08:29:12 -05:00
c2cb8e889b Always return unprojected pooled output for gligen. 2024-02-25 07:33:13 -05:00
1cb3f6a83b Move text projection into the CLIP model code.
Fix issue with not loading the SSD1B clip correctly.
2024-02-25 01:41:08 -05:00
d91f45ef28 Some cleanups to how the text encoders are loaded. 2024-02-19 10:46:30 -05:00
3b2e579926 Support loading the Stable Cascade effnet and previewer as a VAE.
The effnet can be used to encode images for img2img with Stage C.
2024-02-19 04:10:01 -05:00
97d03ae04a StableCascade CLIP model support. 2024-02-16 13:29:04 -05:00
f83109f09b Stable Cascade Stage C. 2024-02-16 10:55:08 -05:00
5e06baf112 Stable Cascade Stage A. 2024-02-16 06:30:39 -05:00
38b7ac6e26 Don't init the CLIP model when the checkpoint has no CLIP weights. 2024-02-13 00:01:08 -05:00
da7a8df0d2 Put VAE key name in model config. 2024-01-30 02:24:38 -05:00
4871a36458 Cleanup some unused imports. 2024-01-21 21:51:22 -05:00
d76a04b6ea Add unfinished ImageOnlyCheckpointSave node to save a SVD checkpoint.
This node is unfinished, SVD checkpoints saved with this node will
work with ComfyUI but not with anything else.
2024-01-17 19:46:21 -05:00
a7874d1a8b Add support for the stable diffusion x4 upscaling model.
This is an old model.

Load the checkpoint like a regular one and use the new
SD_4XUpscale_Conditioning node.
2024-01-03 03:37:56 -05:00
5eddfdd80c Refactor VAE code.
Replace constants with downscale_ratio and latent_channels.
2024-01-02 13:24:34 -05:00
824e4935f5 Add dtype parameter to VAE object. 2023-12-12 12:03:29 -05:00
ba07cb748e Use faster manual cast for fp8 in unet. 2023-12-11 18:24:44 -05:00
9ac0b487ac Make --gpu-only put intermediate values in GPU memory instead of cpu. 2023-12-08 02:35:45 -05:00
983ebc5792 Use smart model management for VAE to decrease latency. 2023-11-28 04:58:51 -05:00
c45d1b9b67 Add a function to load a unet from a state dict. 2023-11-27 17:41:29 -05:00
871cc20e13 Support SVD img2vid model. 2023-11-23 19:41:33 -05:00
410bf07771 Make VAE memory estimation take dtype into account. 2023-11-22 18:17:19 -05:00
6a491ebe27 Allow model config to preprocess the vae state dict on load. 2023-11-21 16:29:18 -05:00
cd4fc77d5f Add taesd and taesdxl to VAELoader node.
They will show up if both the taesd_encoder and taesd_decoder or taesdxl
model files are present in the models/vae_approx directory.
2023-11-21 12:54:19 -05:00
0cf4e86939 Add some command line arguments to store text encoder weights in fp8.
Pytorch supports two variants of fp8:
--fp8_e4m3fn-text-enc (the one that seems to give better results)
--fp8_e5m2-text-enc
2023-11-17 02:56:59 -05:00
0a6fd49a3e Print leftover keys when using the UNETLoader. 2023-11-07 22:15:55 -05:00
2455aaed8a Allow model or clip to be None in load_lora_for_models. 2023-11-01 20:27:20 -04:00
2a134bfab9 Fix checkpoint loader with config. 2023-10-27 22:13:55 -04:00
6ec3f12c6e Support SSD1B model and make it easier to support asymmetric unets. 2023-10-27 14:45:15 -04:00
430a8334c5 Fix some potential issues. 2023-10-18 19:48:36 -04:00
d44a2de49f Make VAE code closer to sgm. 2023-10-17 15:18:51 -04:00
9a55dadb4c Refactor code so model can be a dtype other than fp32 or fp16. 2023-10-13 14:41:17 -04:00
72188dffc3 load_checkpoint_guess_config can now optionally output the model. 2023-10-06 13:48:18 -04:00
9bfec2bdbf Fix quality loss due to low precision 2023-10-04 15:40:59 +02:00
71713888c4 Print missing VAE keys. 2023-09-28 00:54:57 -04:00
7d401ed1d0 Add ldm format support to UNETLoader. 2023-09-11 16:36:50 -04:00
7931ff0fd9 Support SDXL inpaint models. 2023-09-01 15:22:52 -04:00
fe4c07400c Fix "Load Checkpoint with config" node. 2023-08-29 23:58:32 -04:00