mirrors/ComfyUI
1
0
Fork 0
mirror of https://github.com/comfyanonymous/ComfyUI.git synced 2025-09-14 05:25:23 +00:00
Code Issues Packages Projects Releases Wiki Activity

Make --gpu-only put intermediate values in GPU memory instead of cpu.

Browse Source
This commit is contained in:
comfyanonymous
2023-12-08 02:35:45 -05:00
parent cdff081023
commit 9ac0b487ac
9 changed files with 36 additions and 29 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
comfy/clip_vision.py
View File

@@ -54,10 +54,10 @@ class ClipVisionModel():
t = outputs[k]
if t is not None:
if k == 'hidden_states':
outputs["penultimate_hidden_states"] = t[-2].cpu()
outputs["penultimate_hidden_states"] = t[-2].to(comfy.model_management.intermediate_device())
outputs["hidden_states"] = None
else:
outputs[k] = t.cpu()
outputs[k] = t.to(comfy.model_management.intermediate_device())
return outputs