DPTCloud
Back to articles
Technology Insight

Self-Hosting a Background AI Short-Form Video Generator: Connecting ComfyUI API with n8n Queue Mode

June 5, 2026

Introduction to Automated Short-Form Video Production

In the digital marketing landscape, short-form video content has shifted from an emerging trend to a core business necessity. Platforms like TikTok, YouTube Shorts, and Instagram Reels drive unparalleled engagement, forcing brands to produce high-quality visual content at a relentless pace. However, relying on manual editing or expensive, restrictive third-party cloud SAAS platforms can quickly become bottlenecks for scaling operations.

For organizations seeking maximum customization, absolute data privacy, and minimal operational overhead, self-hosting an AI video generation pipeline is the definitive solution. By combining the nodal power of ComfyUI with the enterprise-grade orchestration of n8n in Queue Mode, you can establish a fully automated, asynchronous system that processes video generation tasks silently in the background. This comprehensive guide walks through the architecture, setup, and optimization of this powerful setup.

The Architecture: Why ComfyUI API and n8n Queue Mode?

Before diving into the implementation details, it is crucial to understand why this specific technology stack represents a gold standard for self-hosted media automation.

ComfyUI: Beyond the Graphical User Interface

While many creators interact with ComfyUI via its web-based node interface, its true power lies in its backend design. Every workflow created in ComfyUI can be exported as a clean, structured JSON file that can be executed directly via the ComfyUI API. This decoupling allows us to treat ComfyUI not just as a manual tool, but as a headless rendering engine capable of executing complex Stable Diffusion, Flux, or AnimateDiff pipelines programmatically.

n8n Queue Mode: Scaling Through Asynchronous Processing

AI video generation is computationally heavy and time-consuming. A single 15-second video can take several minutes to render, depending on your hardware hardware capabilities. If a standard workflow engine attempts to handle dozens of concurrent requests synchronously, it will inevitably crash, drop connections, or exhaust system memory.

This is where n8n Queue Mode becomes indispensable. By leveraging Redis as a message broker, n8n separates the main workflow execution engine from worker instances. When a new video generation request is triggered (via a webhook, a database update, or an airtable modification), it enters a highly resilient queue. Workers pick up these tasks sequentially or concurrently based on available hardware, ensuring that your system remains 100% stable, even under heavy production loads.

Prerequisites and Environment Setup

To successfully deploy this infrastructure, your environment must meet specific hardware and software prerequisites:

  • Hardware: A dedicated server or workstation equipped with a modern NVIDIA GPU (minimum 16GB VRAM recommended for high-resolution video generation workflows, such as SDXL or specialized video models).
  • Operating System: Linux (Ubuntu 22.04 LTS or newer preferred) for stable Docker performance and efficient GPU resource allocation via NVIDIA Container Toolkit.
  • Software Core: Docker and Docker Compose installed on the host machine.

Step-by-Step Implementation Guide

Step 1: Preparing and Exporting the ComfyUI API Workflow

The first phase requires building and exporting your video production workflow within ComfyUI.

  1. Open your ComfyUI web interface and construct your short-form video generation workflow (e.g., text-to-video, image-to-video upscaling, or dynamic script-to-scene conversion).
  2. Enable Developer Mode within the ComfyUI settings menu. This action unlocks the advanced export features.
  3. Click on the "Save (API Format)" button. This will download a structured JSON file representing your exact node network.
Note: The standard "Save" button exports a file meant for human loading via the GUI, containing visual coordinates. The "API Format" export strictly isolates the processing nodes, their variables, and connections, which is required for programmatic payload ingestion.

Step 2: Deploying n8n in Queue Mode with Docker Compose

Next, we must configure our automation infrastructure. Below is an optimized, production-ready docker-compose.yml snippet illustrating how to set up n8n with Redis and a dedicated worker instance to handle background queues.

version: '3.8'

services:
  redis:
    image: redis:6-alpine
    restart: always
    volumes:
      - redis_data:/data

  n8n-main:
    image: n8nio/n8n:latest
    restart: always
    environment:
      - N8N_ENCRYPTION_KEY=your_secure_key
      - EXECUTIONS_MODE=queue
      - QUEUE_BULL_REDIS_HOST=redis
    ports:
      - "5678:5678"
    volumes:
      - n8n_data:/home/node/.n8n

  n8n-worker:
    image: n8nio/n8n:latest
    restart: always
    environment:
      - N8N_ENCRYPTION_KEY=your_secure_key
      - EXECUTIONS_MODE=queue
      - QUEUE_BULL_REDIS_HOST=redis
    depends_on:
      - redis
      - n8n-main
    volumes:
      - n8n_data:/home/node/.n8n

volumes:
  redis_data:
  n8n_data:

Step 3: Constructing the n8n Automation Workflow

With the environment running, you can now construct your automation pipeline within the n8n interface. The workflow follows a highly structured architecture designed to handle long-running background processes efficiently:

  • Trigger Node: Utilize a Webhook, an RSS feed reader, or a scheduled cron node to capture incoming content ideas, scripts, or baseline assets.
  • Data Transformation Node (Code Node): Parse the incoming text or data. Dynamically inject variables (such as new prompts, aspect ratios, or seed values) directly into the corresponding keys of the exported ComfyUI API JSON structure.
  • ComfyUI API Request Node: Send an HTTP POST request containing the modified JSON payload to the ComfyUI endpoint: http://:8188/prompt. This registers the job on the GPU server.
  • Asynchronous Polling Loop: Because video generation takes time, your workflow should not block resources waiting for a response. Implement an internal n8n loop that queries http://:8188/history/ every 30 seconds to check if the rendering execution is marked as completed.
  • Asset Retrieval and Distribution: Once the status returns as successful, download the compiled video binary directly from ComfyUI's output folder via API, and automatically route it to your target cloud storage (e.g., AWS S3, MinIO) or queue it for direct social media publishing via API.

Optimizing for Production and Scalability

Running an automated AI video engine in production requires deliberate resource management strategy to ensure longevity and consistent output quality.

GPU Memory Management: ComfyUI aggressively caches models in VRAM to speed up consecutive generations. When automating multiple different styles or switching between models frequently, ensure your n8n workflow monitors or manages VRAM load, or utilize ComfyUI command-line arguments like --smart-memory-management during startup to prevent system freezes.

Concurrency Controls: Within your n8n worker configurations, strictly define the maximum number of concurrent executions allowed per worker. If you have a single GPU, set your task concurrency to 1 to ensure that jobs are processed linearly, preventing out-of-memory (OOM) errors that crash the graphics subsystem.

Conclusion

By shifting video generation from manual interaction to a self-hosted, background-automated ecosystem, businesses can unlock true scalability in content production. Linking the granular power of ComfyUI's API with the robust, non-blocking queue orchestration of n8n allows for an efficient, resilient pipeline that works 24/7. This solution eliminates costly platform subscription fees, safeguards proprietary business data, and frees up creative marketing teams to focus on strategy rather than repetitive execution rendering loops.