Kohaku-Blueleaf eb2f78b4e0

[Training Node] algo support, grad acc, optional grad ckpt (#9015) ...

* Add factorization utils for lokr

* Add lokr train impl

* Add loha train impl

* Add adapter map for algo selection

* Add optional grad ckpt and algo selection

* Update __init__.py

* correct key name for loha

* Use custom fwd/bwd func and better init for loha

* Support gradient accumulation

* Fix bugs of loha

* use more stable init

* Add OFT training

* linting

2025-07-23 20:57:27 -04:00

..

chainner_models

Replace print with logging (#6138)

2024-12-20 16:24:55 -05:00

nodes_ace.py

Experimental lyrics strength for ACE. (#7984)

2025-05-07 19:22:07 -04:00

nodes_advanced_samplers.py

Lint unused import (#5973)

2024-12-09 15:24:39 -05:00

nodes_align_your_steps.py

remove minimum step count for AYS (#6137)

2024-12-21 10:05:09 -05:00

nodes_apg.py

fix negative momentum (#8100)

2025-05-13 10:50:32 -07:00

nodes_attention_multiply.py

Add some nodes to multiply the attention in UNet and Clip models.

2024-04-28 13:03:43 -04:00

nodes_audio.py

This is not needed. (#8991)

2025-07-21 16:48:25 -04:00

nodes_camera_trajectory.py

Fix typo in last PR. (#8144)

2025-05-15 19:02:19 -04:00

nodes_canny.py

Remove some unused imports.

2024-05-27 19:08:27 -04:00

nodes_cfg.py

Forgot this (#8957)

2025-07-18 05:43:02 -04:00

nodes_clip_sdxl.py

Enforce all pyflake lint rules (#6033)

2024-12-12 19:29:37 -05:00

nodes_compositing.py

Lint unused import (#5973)

2024-12-09 15:24:39 -05:00

nodes_cond.py

Add missing category for T5TokenizerOption (#8177)

2025-05-18 02:59:06 -04:00

nodes_controlnet.py

Make the inpaint controlnet node work with non inpaint ones.

2024-09-14 09:17:13 -04:00

nodes_cosmos.py

Support Cosmos predict2 image to video models. (#8535)

2025-06-14 21:37:07 -04:00

nodes_custom_sampler.py

Add SamplingPercentToSigma node (#8963)

2025-07-19 23:09:11 -04:00

nodes_differential_diffusion.py

Fix differential diffusion node for batches.

2024-03-04 00:43:09 -05:00

nodes_edit_model.py

Omnigen2 model implementation. (#8669)

2025-06-25 19:35:57 -04:00

nodes_flux.py

Support Flux Kontext Dev model. (#8679)

2025-06-26 11:28:41 -04:00

nodes_freelunch.py

Move PAG to model_patches/unet section.

2024-07-18 17:22:51 -04:00

nodes_fresca.py

Fix fresca's input and output (#8871)

2025-07-11 12:52:58 -04:00

nodes_gits.py

Fix and enforce no trailing whitespace.

2024-12-31 03:16:37 -05:00

nodes_hidream.py

CLIPTextEncodeHiDream. (#7703)

2025-04-21 02:41:51 -04:00

nodes_hooks.py

Hooks Part 2 - TransformerOptionsHook and AdditionalModelsHook (#6377)

2025-01-11 12:20:23 -05:00

nodes_hunyuan3d.py

Make "surface net" the default in the VoxelToMesh node.

2025-04-09 09:42:08 -04:00

nodes_hunyuan.py

Hunyuan Custom initial untested implementation. (#8101)

2025-05-13 15:53:47 -04:00

nodes_hypernetwork.py

add simple error check to model loading (#4950)

2024-09-17 03:57:17 -04:00

nodes_hypertile.py

Lint all unused variables (#5989)

2024-12-12 17:59:16 -05:00

nodes_images.py

Add ImageRotate and ImageFlip nodes. (#8789)

2025-07-03 19:16:30 -04:00

nodes_ip2p.py

Add InstructPixToPixConditioning node.

2024-04-04 15:06:17 -04:00

nodes_latent.py

Refactor and fixes for video latents.

2025-01-22 06:37:46 -05:00

nodes_load_3d.py

support upload 3d model to custom subfolder (#8597)

2025-07-01 20:43:48 -04:00

nodes_lora_extract.py

Add tooltips to LoraSave node.

2024-10-18 06:01:09 -04:00

nodes_lotus.py

Native LotusD Implementation (#7125)

2025-03-21 14:04:15 -04:00

nodes_lt.py

nodes_lt: fixes to latent conditioning at index > 0 (#8769)

2025-07-02 15:34:51 -04:00

nodes_lumina2.py

support system prompt and cfg renorm in Lumina2 (#6795)

2025-02-16 18:15:43 -05:00

nodes_mahiro.py

Add MaHiRo (improved/alternate CFG) (#5975)

2024-12-11 16:51:51 -05:00

nodes_mask.py

Fix MaskComposite error when destination has 2 dimensions (#8915)

2025-07-15 21:08:27 -04:00

nodes_mochi.py

Move mochi latent node to: latent/video.

2024-11-08 08:33:44 -05:00

nodes_model_advanced.py

Add cosmos_rflow option to ModelSamplingContinuousEDM node. (#8523)

2025-06-13 17:47:52 -04:00

nodes_model_downscale.py

Lint unused import (#5973)

2024-12-09 15:24:39 -05:00

nodes_model_merging_model_specific.py

Cosmos predict2 model merging nodes. (#8647)

2025-06-24 05:17:16 -04:00

nodes_model_merging.py

Make clipsave work with more TE models. (#7908)

2025-05-02 05:15:32 -04:00

nodes_morphology.py

Nodes to convert images to YUV and back.

2025-03-21 06:32:44 -04:00

nodes_optimalsteps.py

Cleanup chroma PR.

2025-04-30 20:57:30 -04:00

nodes_pag.py

Lower SAG scale step for finer control (#4158)

2024-08-02 10:29:03 -04:00

nodes_perpneg.py

PerpNeg Guider optimizations. (#8753)

2025-07-01 03:09:07 -04:00

nodes_photomaker.py

(fix): added "model_type" to photomaker node (#6047)

2024-12-15 00:18:02 -05:00

nodes_pixart.py

Remove windows line endings. (#8902)

2025-07-14 13:10:20 -04:00

nodes_post_processing.py

Lint instance methods (#7903)

2025-05-01 19:32:04 -04:00

nodes_preview_any.py

upstream Preview Any from rgthree-comfy (#7815)

2025-05-02 13:15:54 -04:00

nodes_primitive.py

More API Nodes (#7956)

2025-05-06 04:23:00 -04:00

nodes_rebatch.py

Remove some trailing white space.

2024-12-27 18:02:30 -05:00

nodes_sag.py

proper fix for sag.

2024-11-10 00:10:45 -05:00

nodes_sd3.py

ModelPatcher Overhaul and Hook Support (#5583)

2024-12-02 14:51:02 -05:00

nodes_sdupscale.py

Remove some unused imports.

2024-05-27 19:08:27 -04:00

nodes_slg.py

Initial code for new SLG node (#8759)

2025-07-02 20:13:43 -04:00

nodes_stable3d.py

SV3D support.

2024-03-18 16:54:13 -04:00

nodes_stable_cascade.py

Move some nodes out of _for_testing.

2024-09-25 08:41:22 -04:00

nodes_string.py

Add node for regex replace(sub) operation (#8340)

2025-05-30 15:08:59 -04:00

nodes_tcfg.py

Add TCFG node (#8730)

2025-07-01 02:33:07 -04:00

nodes_tomesd.py

Remove some trailing white space.

2024-12-27 18:02:30 -05:00

nodes_torch_compile.py

Make torch.compile LoRA/key-compatible (#8213)

2025-05-21 04:56:56 -04:00

nodes_train.py

[Training Node] algo support, grad acc, optional grad ckpt (#9015)

2025-07-23 20:57:27 -04:00

nodes_upscale_model.py

Lint unused import (#5973)

2024-12-09 15:24:39 -05:00

nodes_video_model.py

Temporal area composition.

2025-03-03 06:50:31 -05:00

nodes_video.py

Add support for VIDEO as a built-in type (#7844)

2025-04-29 05:58:00 -04:00

nodes_wan.py

Not really tested WAN Phantom Support. (#8321)

2025-05-28 23:46:15 -04:00

nodes_webcam.py

Fix WebcamCapture IS_CHANGED signature (#8413)

2025-06-09 13:05:54 -04:00