MÊIRKS

2024 · R&D

AI WORKFLOW 2024 - Echoes of a Living Structure

  • AI
  • Image Genration
  • Video Generation
  • Procedural
  • Coding

Hypothesis

Generative video diffusion models suffer from topological hallucination and temporal drift during organic transformations. A deterministic geometric scaffold—generated via VEX procedural growth in Houdini and fed as raw viewport motion data—can strictly anchor latent frame-to-frame coherence without requiring heavy render passes or traditional photorealistic shading.

Pipeline

  1. 01

    Topology Extraction

  2. 02

    Procedural Colonization

  3. 03

    Motion Guidance Scaffolding

  4. 04

    Latent Resurfacing & Synthesis

01 / 05

Protocol

  1. Latent seed generation via ComfyUI (SDXL) → neural surface reconstruction via Tripo AI to extract base 3D manifold topology.
  2. Houdini SOP/VEX implementation: differential point distribution and iterative neighbor searching across surface primitives to simulate timed mycelial growth.
  3. Unshaded viewport flipbook rasterization to capture clean silhouette, edge delta, and volumetric progression.
  4. Keyframe texturing via latent diffusion (DALL·E) aligned with the initial geometry.
  5. Conditional synthesis in Kling: injection of the procedural flipbook as structural motion guidance combined with the textured reference keyframe.

Findings

The neural diffusion model treats high-contrast viewport motion as spatial guidance vectors, maintaining mesh volume consistency across extended frame ranges. Flat-shaded wireframe/clay flipbooks yield higher edge fidelity than shaded previs: diffuse shadows cause the latent model to misinterpret geometry boundaries as surface textures. Growth timing calibrated in VEX translates with less than 5% temporal drift in the final latent interpolation.

Pipeline

  1. 01

    Topology Extraction

    Text-to-image synthesis in ComfyUI establishes volumetric silhouette; mesh extraction via Tripo AI converts 2D latent fields into a continuous, watertight 3D geometry.

  2. 02

    Procedural Colonization

    Custom VEX solver in Houdini calculates fungal expansion across polygon normals, using distance metrics and noise vectors to control propagation rate and branching density.

  3. 03

    Motion Guidance Scaffolding

    Viewport flipbook export isolating pure structural progression. Flat shading ensures clean luminance deltas, preventing false depth cues from corrupting the neural conditioning.

  4. 04

    Latent Resurfacing & Synthesis

    Multimodal synthesis in Kling combining the procedural motion scaffold with high-resolution textured keyframes, achieving fine organic detail anchored to deterministic motion.

All research