Skip to content
BranchesTags

Repository files navigation

██╗  ██╗ ██████╗ ███████╗██╗  ██╗██╗    ███╗   ██╗ ██████╗ ██████╗ ███████╗███████╗
██║ ██╔╝██╔═══██╗██╔════╝██║  ██║██║    ████╗  ██║██╔═══██╗██╔══██╗██╔════╝██╔════╝
█████╔╝ ██║   ██║███████╗███████║██║    ██╔██╗ ██║██║   ██║██║  ██║█████╗  ███████╗
██╔═██╗ ██║   ██║╚════██║██╔══██║██║    ██║╚██╗██║██║   ██║██║  ██║██╔══╝  ╚════██║
██║  ██╗╚██████╔╝███████║██║  ██║██║    ██║ ╚████║╚██████╔╝██████╔╝███████╗███████║
╚═╝  ╚═╝ ╚═════╝ ╚══════╝╚═╝  ╚═╝╚═╝    ╚═╝  ╚═══╝ ╚═════╝ ╚═════╝ ╚══════╝╚══════╝

░░█ ComfyUI custom nodes - Flux Motion V2V | Effects | Generators | Spatial Conditioning | SIDKIT OLED █░░

ComfyUI-Koshi-Nodes

21 focused nodes for ComfyUI: Motion (Deforum-style animation, audio-driven schedules), Effects (unified effects + standalone bloom/glitch/chromatic), Generators (procedural patterns, raymarched 3D), Space / Conditioning (AKUSPACE prompt and CLIP encoding), SIDKIT (OLED/embedded display export), and Utility (metadata capture).

Consolidated from 40 nodes down to 18 — same functionality, cleaner interface, fewer clicks — plus two AKUSPACE spatial-audio conditioning nodes.

ComfyNodes.mp4

Glitch Candies shaders, OLED emulation and binary export.

Installation

One-liner (existing ComfyUI):

cd ComfyUI/custom_nodes && git clone https://github.com/koshimazaki/ComfyUI-Koshi-Nodes.git Koshi-Nodes && pip install -r Koshi-Nodes/requirements.txt

Or step by step:

cd ComfyUI/custom_nodes
git clone https://github.com/koshimazaki/ComfyUI-Koshi-Nodes.git Koshi-Nodes
cd Koshi-Nodes && pip install -r requirements.txt

Quick Setup (RunPod)

Full setup with ComfyUI + FLUX Q4 GGUF + Koshi Nodes (~6GB VRAM):

curl -sL https://raw.githubusercontent.com/koshimazaki/ComfyUI-Koshi-Nodes/main/setup_comfyui_flux.sh | bash -s -- --runpod --gguf

Includes: ComfyUI, Koshi Nodes, ComfyUI-Manager, VideoHelperSuite, ComfyUI-GGUF, FLUX Dev Q4

For FLUX.2 Klein, the setup uses Klein's diffusers-format VAE because the Klein repo does not ship a native ae.safetensors. If you also run native BFL SDK scripts, add --flux2-native-ae to download the shared FLUX.2-dev family AE, or set AE_MODEL_PATH yourself.

Node Naming

Nodes are prefixed by category for easy identification:

Prefix Category Nodes
░▀░ Effects Koshi Effects (unified), Bloom, Chromatic, Glitch, Dither, Dithering Filter
▄▀▄ Motion Schedule, Motion Engine, Feedback, Audio → Motion
▄█▄ Generators Glitch Candies, Shape Morph, Noise Displace, Raymarcher
░▒░ SIDKIT/Export SIDKIT Binary, Greyscale, SIDKIT OLED, Sprite Sheet
◊ Utility Metadata
◉ Space / Conditioning AKUSPACE Prompt, AKUSPACE Text Encode

All 21 Nodes

Effects (6 nodes)

Post-processing effects based on alien.js and custom shaders.

Node Description
░▀░ Koshi Effects Unified — 7 effects: dither, bloom, glitch, hologram, video glitch, scanlines, chromatic. Stack to combine.
░▀░ KN Bloom Unreal-style bloom (GPU/CPU fallback)
░▀░ KN Chromatic RGB channel separation
░▀░ KN Glitch Shader-based glitch distortion
░▀░ KN Dither Bayer, floyd-steinberg, atkinson, halftone
░▀░ KN Dithering Filter GPU-accelerated dithering filter

Motion (4 nodes)

Deforum-inspired animation engine for FLUX models.

Pipeline:

▄▀▄ Schedule ─────────┐
                      ├→ ▄▀▄ Motion Engine → KSampler
▄▀▄ Audio → Motion ───┘            ↓
                           ▄▀▄ Feedback (loop)
Node Description
▄▀▄ KN Schedule Parse keyframe strings (0:(1.0), 30:(0.5)) with interpolation and easing
▄▀▄ KN Motion Engine Apply motion transforms to latents (zoom, angle, translation)
▄▀▄ KN Feedback Frame-to-frame coherence: color match, sharpen, noise, auto-correct
▄▀▄ KN Audio → Motion Map audio/video features (BFL dashboard JSON, Fill-Nodes JSON, AUDIO input, or MP4) onto a motion schedule: bass → zoom, highs → rotation, mids → drift. See nodes/audio/README.md

Generators (4 nodes)

Procedural patterns, fractals, and raymarched 3D shapes.

Node Description
▄█▄ Glitch Candies 27 patterns: waves, plasma, voronoi, fractals, raymarched 3D
▄█▄ Shape Morph Blend/morph between two images with easing
▄█▄ Noise Displace FBM noise displacement with animation
▄█▄ Raymarcher Raymarched 3D shapes with dithering (requires ModernGL)

Patterns:

  • 2D: waves, circles, plasma, voronoi, checkerboard, swirl, ripple
  • Fractals: mandelbrot, julia, sierpinski
  • Glitch: fbm_noise, cell_noise, distorted_grid, height_map, glitch_cubes
  • Raymarched 3D: rm_cube, rm_sphere, rm_torus, rm_octahedron, rm_gyroid, rm_menger, rm_cylinder, rm_cone, rm_capsule, rm_pyramid

All patterns support loop_frames for seamless animation loops.

3D Camera Controls: Raymarched shapes have rotation_x, rotation_y, and camera_distance inputs for orbital control.

SIDKIT / Export (4 nodes)

Nodes for SIDKIT synthesizer OLED displays (SSD1306, SSD1363) and export.

Node Description
░▒░ KN SIDKIT Binary Threshold (simple, adaptive, otsu, dither) + hex/XBM/C header export
░▒░ KN Greyscale Greyscale with bit depth quantization (1/2/4/8-bit)
░▒░ KN SIDKIT OLED OLED display viewer with WebGL preview and screen presets
░▒░ KN Sprite Sheet Combine frames into sprite sheet grid

OLED Presets: SSD1306 128x64, SSD1306 128x32, SSD1363 256x128, custom

Bit Depths: 1-bit (2), 2-bit (4), 4-bit (16), 8-bit (256)

Utility (1 node)

Node Description
◊ Koshi Metadata Unified metadata node — capture workflow settings, display, and save as JSON/text. Extracts seed, steps, cfg, model, LoRAs, prompts.

Space / Conditioning (2 nodes)

AKUSPACE provides a shared WebGL spatial controller for an experimental LTX audio LoRA. The LoRA checkpoint is external and is not bundled with this node pack. See the AKUSPACE guide and interactive project page.

Node Description
◉ AKUSPACE Prompt Modular Prompt → Prompt treatment node, compatible with camera and other string controls.
◉ AKUSPACE Text Encode CLIP + editable Text → Conditioning convenience node; the AKUSPACE suffix is appended on Run.

The WebGL controller is a ~980KB prebuilt bundle (Vue + Three.js) that loads on demand the first time an AKUSPACE node appears, so graphs without these nodes pay nothing at startup.

Project Structure

ComfyUI-Koshi-Nodes/
├── nodes/
│   ├── effects/        # Koshi Effects (unified), bloom, glitch, chromatic aberration, raymarcher
│   ├── export/         # SIDKIT OLED, sprite sheet
│   ├── flux_motion/    # Schedule, motion engine, feedback
│   │   └── core/       # Interpolation, easing, transforms
│   ├── generators/     # Glitch Candies, shape morph, noise displace, raymarcher
│   ├── utility/        # Metadata (unified capture/display/save)
│   ├── utils/          # Shared utilities (tensor ops, metadata)
│   ├── audio/          # AKUSPACE conditioning + Audio → Motion schedule bridge
│   └── image/          # SIDKIT Edition
│       ├── binary/     # Threshold + hex export
│       ├── dither/     # Bayer, Floyd-Steinberg, Atkinson, Halftone
│       └── greyscale/  # Quantization, algorithms
├── shaders/            # GLSL shaders (bloom, chromatic aberration)
├── workflows/          # Example workflow JSONs
└── js/                 # Live preview, orbital controls, Nodes 2.0 theme

Live Preview & WebGL

Most nodes include inline live preview directly in the node UI - no Preview Image node needed.

  • Toggle preview on/off per node
  • Batch preview (first 4 frames, "+N more" indicator)
  • Collapsible preview widget (▼/▶)

WebGL Shaders (9 built-in): passthrough, bayer dither, floyd-steinberg, halftone, glitch, bloom, threshold, greyscale, OLED emulation.

OLED Emulation Shader: Exact SIDKIT Bayer matrices (2x2/4x4/8x8), 1/2/4/8-bit depth, 6 color modes (grayscale, green, blue, amber, white, yellow), pixel gap/grid effect, bloom glow.

3D Orbital Controls (Generators with rm_* patterns):

  • Drag to rotate (updates rotation_x/rotation_y, clamped ±90°)
  • Scroll to zoom (camera_distance, range 1-10)
  • Reset View button to restore defaults

Example Workflows

In workflows/:

  • koshi_v2v_ultimate.json - Full V2V with motion + temporal + color match
  • koshi_v2v_complete.json - Complete V2V pipeline
  • koshi_v2v_motion.json - Motion-focused V2V
  • koshi_v2v_temporal.json - Temporal coherence V2V
  • koshi_v2v_pure.json - Minimal V2V setup
  • koshi_oled_sprite_pipeline.json - Image → dither → OLED preview → export
  • koshi_sprite_sheet.json - Video → sprite sheet for game dev

Quick Pipelines

Motion Animation:

▄▀▄ Schedule → ▄▀▄ Motion Engine → KSampler
                                      ↓
                              ▄▀▄ Feedback (loop)

Audio-driven motion:

LoadAudio → ▄▀▄ Audio → Motion → ▄▀▄ Motion Engine (frame_index per frame) → KSampler

Stacked Effects:

Image → ░▀░ Koshi Effects (hologram) → ░▀░ Koshi Effects (chromatic) → ░▀░ KN Bloom

SIDKIT OLED Export:

Image → ░▒░ KN Greyscale → ░▀░ KN Dither → ░▒░ KN SIDKIT OLED → ░▒░ KN Sprite Sheet

Generator → Effect → Export:

▄█▄ Glitch Candies → ░▀░ Koshi Effects (scanlines) → ░▒░ KN Sprite Sheet

AKUSPACE modular prompt:

Base Prompt → ◉ AKUSPACE Prompt → CLIP Text Encode → Conditioning

Optional text inspection follows the standard camera-control pattern:

◉ AKUSPACE Prompt → Preview as Text

AKUSPACE integrated encode:

LoRA-patched CLIP + Text → ◉ AKUSPACE Text Encode → Conditioning

Dependencies

Required: torch, numpy, pillow

Optional:

  • moderngl - GPU effects
  • scipy - Better dithering/edge detection
  • opencv-python - Color matching in Feedback node (LAB space)

Credits

License

Apache License 2.0 — see LICENSE and NOTICE. Third-party components and their licenses are listed in THIRD_PARTY_NOTICES.md.

About

ComfyUI Node pack with shaders, Deforum inspired Flux .2 Motion nodes and binary OLED export

Resources

Readme
Apache-2.0 license
Activity

Stars

2 stars

Watchers

0 watching

Forks

0 forks
Report repository

Releases

Packages

Contributors

Languages