Description
This node chunks the feedforward activations inside the LTXV model to reduce peak VRAM usage. EXPERIMENTAL AND MAY CHANGE THE MODEL OUTPUT!! Use with caution and verify results against the unmodified model. Splitting activations into smaller pieces allows processing larger resolutions or sequences without exceeding memory limits, but can alter numerical precision (especially in attention or normalization paths) and thus affect final output quality.
Inputs
| Input | Type | Required | Default | Range | Tooltip |
|---|---|---|---|---|---|
model | MODEL | Yes | – | – | The LTXV model to modify. |
chunks | INT | Yes | 2 | [1, 100], step 1 | Number of chunks to split the feedforward activations into to reduce peak VRAM usage. Higher values reduce peak memory further but may increase runtime and alter outputs. A value of 1 disables chunking entirely. |
dim_threshold | INT | Yes | 4096 | [0, 16384], step 256 | Dimension threshold above which to apply chunking. Only layers with hidden size greater than or equal to this threshold will be chunked. Set to 0 to chunk every layer (maximum memory saving, greatest risk of output change). |
Outputs
| Output | Type | Description |
|---|---|---|
model | MODEL | The modified LTXV model with chunked feedforward activations applied according to the given parameters. |
Usage Notes
- This node is intended for advanced users who need to fit very large LTXV model variants or high-resolution generation workflows into limited VRAM.
- Because chunking changes the order of operations inside the feedforward block, the numerical results are not bit‑identical to the unpatched model. Always test outputs on representative prompts before relying on the chunked version for production.
dim_thresholdallows you to restrict chunking to the largest (most memory‑hungry) layers. For typical LTXV models, settingdim_thresholdto4096chunks only the largest layers, balancing memory savings and output fidelity.- Increasing
chunksbeyond8–16usually gives diminishing memory returns and can increase overhead;2–8is a practical range for most use cases. - If you experience unexpected artifacts or out‑of‑memory errors, try lowering
chunksor raisingdim_threshold.
Comments
Sign in with GitHub to join the discussion.