Kohaku-Blueleaf eb2f78b4e0

[Training Node] algo support, grad acc, optional grad ckpt (#9015) ...

* Add factorization utils for lokr

* Add lokr train impl

* Add loha train impl

* Add adapter map for algo selection

* Add optional grad ckpt and algo selection

* Update __init__.py

* correct key name for loha

* Use custom fwd/bwd func and better init for loha

* Support gradient accumulation

* Fix bugs of loha

* use more stable init

* Add OFT training

* linting

2025-07-23 20:57:27 -04:00

..

cldm

Replace print with logging (#6138)

2024-12-20 16:24:55 -05:00

comfy_types

LoRA Trainer: LoRA training node in weight adapter scheme (#8446)

2025-06-13 19:25:59 -04:00

extra_samplers

Uni pc sampler now works with audio and video models.

2025-01-18 05:27:58 -05:00

image_encoders

Fix for dino lowvram. (#7748)

2025-04-23 04:12:52 -04:00

k_diffusion

Separate denoised and noise estimation in Euler CFG++ (#9008)

2025-07-23 19:47:05 -04:00

ldm

LTXV VAE decoder: switch default padding mode (#8930)

2025-07-16 13:54:38 -04:00

sd1_tokenizer

Silence clip tokenizer warning. (#8934)

2025-07-16 14:42:07 -04:00

t2i_adapter

Controlnet refactor.

2024-06-27 18:43:11 -04:00

taesd

Improvements to the TAESD3 implementation.

2024-06-16 02:04:24 -04:00

text_encoders

Remove windows line endings. (#8866)

2025-07-11 02:37:51 -04:00

weight_adapter

[Training Node] algo support, grad acc, optional grad ckpt (#9015)

2025-07-23 20:57:27 -04:00

checkpoint_pickle.py

Remove pytorch_lightning dependency.

2023-06-13 10:11:33 -04:00

cli_args.py

Add default device argument. (#9023)

2025-07-23 14:20:49 -04:00

clip_config_bigg.json

Fix potential issue with non clip text embeddings.

2024-07-30 14:41:13 -04:00

clip_model.py

Support llava clip vision model.

2025-03-06 00:24:43 -05:00

clip_vision_config_g.json

Add support for clip g vision model to CLIPVisionLoader.

2023-08-18 11:13:29 -04:00

clip_vision_config_h.json

Add support for unCLIP SD2.x models.

2023-04-01 23:19:15 -04:00

clip_vision_config_vitl_336_llava.json

Support llava clip vision model.

2025-03-06 00:24:43 -05:00

clip_vision_config_vitl_336.json

support clip-vit-large-patch14-336 (#4042)

2024-07-17 13:12:50 -04:00

clip_vision_config_vitl.json

Add support for unCLIP SD2.x models.

2023-04-01 23:19:15 -04:00

clip_vision_siglip_384.json

Support new flux model variants.

2024-11-21 08:38:23 -05:00

clip_vision_siglip_512.json

Support 512 siglip model.

2025-04-05 07:01:01 -04:00

clip_vision.py

throw away alpha channel in clip vision preprocessor (#7769)

2025-04-23 21:28:36 -04:00

conds.py

Make it easier to pass lists of tensors to models. (#8358)

2025-05-31 20:00:20 -04:00

controlnet.py

Alternate fix for #8435 (#8442)

2025-06-06 09:43:27 -04:00

diffusers_convert.py

Remove useless code.

2025-01-24 06:15:54 -05:00

diffusers_load.py

load_unet -> load_diffusion_model with a model_options argument.

2024-08-12 23:20:57 -04:00

float.py

Clamp output when rounding weight to prevent Nan.

2024-10-19 19:07:10 -04:00

gligen.py

Remove some useless code. (#8812)

2025-07-06 07:07:39 -04:00

hooks.py

Hooks Part 2 - TransformerOptionsHook and AdditionalModelsHook (#6377)

2025-01-11 12:20:23 -05:00

latent_formats.py

Initial ACE-Step model implementation. (#7972)

2025-05-07 08:33:34 -04:00

lora_convert.py

Support the wan fun reward loras.

2025-04-07 05:01:47 -04:00

lora.py

Support HiDream SimpleTuner loras. (#8318)

2025-05-28 18:47:15 -04:00

model_base.py

Fix memory estimation bug with kontext. (#8709)

2025-06-27 17:21:12 -04:00

model_detection.py

Omnigen2 model implementation. (#8669)

2025-06-25 19:35:57 -04:00

model_management.py

Enable pytorch attention by default for gfx1201 on torch 2.8 (#9029)

2025-07-23 19:21:29 -04:00

model_patcher.py

Initial code for new SLG node (#8759)

2025-07-02 20:13:43 -04:00

model_sampling.py

Basic initial support for cosmos predict2 text to image 2B and 14B models. (#8517)

2025-06-13 07:05:23 -04:00

ops.py

Fallback to regular op when fp8 op throws exception. (#8761)

2025-07-02 00:57:13 -04:00

options.py

Only parse command line args when main.py is called.

2023-09-13 11:38:20 -04:00

patcher_extension.py

Add prepare_sampling wrapper allowing custom nodes to more accurately report noise_shape (#7500)

2025-04-09 09:43:35 -04:00

rmsnorm.py

Fix issue with old pytorch RMSNorm. (#8095)

2025-05-13 07:54:28 -04:00

sample.py

Auto reshape 2d to 3d latent for single image generation on video model.

2024-12-29 02:26:49 -05:00

sampler_helpers.py

Memory estimation code can now take into account conds. (#8307)

2025-05-27 15:09:05 -04:00

samplers.py

Add SA-Solver sampler (#8834)

2025-07-08 16:17:06 -04:00

sd1_clip_config.json

Fix potential issue with non clip text embeddings.

2024-07-30 14:41:13 -04:00

sd1_clip.py

Omnigen2 model implementation. (#8669)

2025-06-25 19:35:57 -04:00

sd.py

Add model detection error hint for lora. (#8880)

2025-07-12 03:49:26 -04:00

sdxl_clip.py

Add a T5TokenizerOptions node to set options for the T5 tokenizer. (#7803)

2025-04-25 19:36:00 -04:00

supported_models_base.py

Mixed precision diffusion models with scaled fp8.

2024-10-21 18:12:51 -04:00

supported_models.py

Fix wrong reference bug (#8910)

2025-07-14 20:45:55 -04:00

utils.py

Add attempt to work around the safetensors mmap issue. (#8928)

2025-07-16 03:42:17 -04:00