5 Commits

Author	SHA1	Message	Date
Kohaku-Blueleaf	eb2f78b4e0	[Training Node] algo support, grad acc, optional grad ckpt (#9015) ... * Add factorization utils for lokr * Add lokr train impl * Add loha train impl * Add adapter map for algo selection * Add optional grad ckpt and algo selection * Update __init__.py * correct key name for loha * Use custom fwd/bwd func and better init for loha * Support gradient accumulation * Fix bugs of loha * use more stable init * Add OFT training * linting	2025-07-23 20:57:27 -04:00
Kohaku-Blueleaf	1205afc708	Better training loop implementation (#8820)	2025-07-09 11:41:22 -04:00
Kohaku-Blueleaf	181a9bf26d	Support Multi Image-Caption dataset in lora training node (#8819) ... * initial impl of multi img/text dataset * Update nodes_train.py * Support Kohya-ss structure	2025-07-08 20:18:04 -04:00
comfyanonymous	ae75a084df	SaveLora now saves in the same filename format as all the other nodes. (#8538)	2025-06-15 03:44:59 -04:00
Kohaku-Blueleaf	520eb77b72	LoRA Trainer: LoRA training node in weight adapter scheme (#8446)	2025-06-13 19:25:59 -04:00