Back to articles
AI & Cloud

Replacing Proxmox with Incus: Lightweight Container & VM Management with Kernel Boost

Guide to replacing Proxmox with Incus for lightweight container and VM management on NVMe Cloud VPS. Focus on RAM budgeting, swap setup, timeout tuning, and OOM error resolution for...

DPTCloud Engineering7 min read
Replacing Proxmox with Incus: Lightweight Container & VM Management with Kernel Boost

As demand for self-hosted large language models (LLMs) on Cloud VPS increases, choosing an efficient virtualization and container management platform is critical. While Proxmox VE is popular, it can become heavy when running AI workloads. This guide shows how to replace Proxmox with Incus – a lightweight container and VM management solution optimized for performance and low resource usage, especially suitable for NVMe Cloud VPS at DPTCloud.

Incus Overview and Benefits vs Proxmox

Incus is a container and VM management platform built on LXC/LXD, developed by Canonical. Compared to Proxmox, Incus offers several performance and efficiency advantages:

  • Lighter footprint: Incus does not include a heavy web UI like Proxmox, reducing CPU and RAM usage.
  • Higher performance: Using LXC/LXD with Linux kernel 6.15+, Incus leverages new features like cgroups v2, eBPF, and socket buffers to optimize I/O and CPU performance.
  • Better scalability: Modular design enables easy integration with AI technologies like Ollama and LiteLLM.

Optimizing RAM and Swap for Self-Hosted LLMs on NVMe VPS

Managing RAM is crucial when running models like ibm-granite-4.1-8b-llmon-preview or Qwen3.5-9B. Here are key optimization steps:

1. Determine RAM Requirements

Check the model's specifications. For example, an 8B model needs at least 16GB RAM for stable operation. A 3B model requires 8GB.

2. Configure Swap (swapfile)

On NVMe VPS with limited RAM, swap is essential to prevent OOM errors. Create a swapfile using:

sudo fallocate -l 8G /swapfile
sudo chmod 600 /swapfile
sudo mkswap /swapfile
sudo swapon /swapfile
sudo echo '/swapfile none swap sw 0 0' >> /etc/fstab

3. Tune cgroups v2 for Ollama and LiteLLM

Prevent non-essential processes from consuming RAM. Configure cgroups v2:

sudo mkdir -p /sys/fs/cgroup/ollama
sudo echo 'memory.max=8G' > /sys/fs/cgroup/ollama/memory.max
sudo echo 'cpu.max=100000 100000' > /sys/fs/cgroup/ollama/cpu.max

Fixing OOM Errors and Tuning Timeouts

OOM (Out of Memory) errors commonly occur when LLMs exceed RAM limits. Here’s how to resolve them:

1. Check OOM Logs

Run this command to view OOM errors:

sudo dmesg | grep -i oom

2. Increase Swap and Adjust OOM Killer

Modify OOM killer parameters to prevent killing critical processes:

sudo echo 'vm.oom_dump_tasks = 1' >> /etc/sysctl.conf
sudo echo 'vm.oom_kill_allocating_task = 1' >> /etc/sysctl.conf
sudo sysctl -p

3. Optimize LiteLLM Timeouts

In the LiteLLM configuration file, adjust timeouts to prevent system hangs:

liteLLM.timeout = 30
liteLLM.max_retries = 3

Kernel Optimization for AI Performance

To maximize the performance of NVMe Cloud VPS at DPTCloud, kernel tuning is essential:

  • Enable TCP BBRv3: Increases data transfer speed for AI APIs.
  • Adjust socket buffer sizes: Increases buffer size to handle high loads.
  • Recommend using kernel 6.15+ to leverage eBPF and XDP for low-latency networking.
NOTE: DPTCloud VPS are pre-optimized with kernel 6.15+, so only configuration parameters need to be applied.

Learn more about High-RAM Cloud VPS for Self-Hosted LLMs & API Gateways and Model Context Protocol (MCP) 2026: Securely Connecting AI Agents to Backends on VPS.

DPTCloud Tier III Infrastructure

High-RAM Cloud VPS Plans Optimized for AI, Databases & Cache

Enterprise RAID 10 NVMe SSDs, CMC & FPT District 9 uplinks with Anycast Anti-DDoS and 99.99% SLA.

View 22 VPS Plans
ECO · vn-02Recommended

VPS-4E

297.000 ₫ / mo

10% VAT included

  • CPU: 4 vCPU
  • RAM: 8 GB
  • SSD: 50 GB NVMe
ECO · vn-02

VPS-5E

614.900 ₫ / mo

10% VAT included

  • CPU: 8 vCPU
  • RAM: 16 GB
  • SSD: 100 GB NVMe
ADVANCED · vn-03Recommended

VPS-4T

548.900 ₫ / mo

10% VAT included

  • CPU: 4 vCPU
  • RAM: 8 GB
  • SSD: 50 GB NVMe

Related Articles

View all
ZaloZalo SupportDiscord0384 753 478