// publications

Neural Cellular Automata · Computer Vision · Computer Graphics · Artificial Life

selected works

Neural Particle Automata: Learning Self-Organizing Particle Dynamics
Neural Particle Automata: Learning Self-Organizing Particle Dynamics
Ehsan Pajouheshgar*, Hyunsoo Kim*, Sabine Süsstrunk, Wenzel Jakob, Jinah Park
SIGGRAPH, 2026

We introduce Neural Particle Automata, a Lagrangian generalization of Neural Cellular Automata where each cell is a particle with a continuous position and internal state, using differentiable SPH operators and memory-efficient CUDA kernels to scale learned self-organizing particle dynamics.

Neural Cellular Automata: From Cells to Pixels
Neural Cellular Automata: From Cells to Pixels
Ehsan Pajouheshgar, Yitao Xu, Ali Abbasi, Alexander Mordvintsev, Wenzel Jakob, Sabine Süsstrunk
SIGGRAPH, 2026

We pair a coarse-grid Neural Cellular Automata model with a lightweight implicit decoder that maps cell states and local coordinates to appearance, enabling self-organizing NCA outputs to render at arbitrary resolution in real time while preserving regeneration, robustness, and spontaneous dynamics across 2D, 3D, and mesh domains.

Mesh Neural Cellular Automata
Mesh Neural Cellular Automata
Ehsan Pajouheshgar*, Yitao Xu*, Alexander Mordvintsev, Eyvind Niklasson, Tong Zhang, Sabine Süsstrunk
ACM TOG / SIGGRAPH, 2024

MeshNCA extends Neural Cellular Automata from regular grids to triangle meshes, enabling local self-organization and real-time dynamic texture synthesis directly on 3D surfaces without UV unwrapping or global communication.

NoiseNCA: Noisy Seed Improves Spatio-Temporal Continuity of Neural Cellular Automata
★ Best Student Paper Award
NoiseNCA: Noisy Seed Improves Spatio-Temporal Continuity of Neural Cellular Automata
Ehsan Pajouheshgar, Yitao Xu, Sabine Süsstrunk
ALife, 2024

We analyze NCA texture models in the continuous space-time limit, show that standard training overfits discretization near the seed, and use uniform-noise initialization to learn dynamics that stay consistent across resolutions, are robust to stochastic updates and additive noise, and behave like PDEs.

DyNCA: Real-time Dynamic Texture Synthesis Using Neural Cellular Automata
DyNCA: Real-time Dynamic Texture Synthesis Using Neural Cellular Automata
Ehsan Pajouheshgar*, Yitao Xu*, Tong Zhang, Sabine Süsstrunk
CVPR, 2023

DyNCA enables real-time and controllable dynamic texture synthesis, producing arbitrarily long and arbitrary-size video textures while improving synthesis speed and quality by orders of magnitude over prior optimization-based methods.

all publications

2026
Neural Particle Automata: Learning Self-Organizing Particle Dynamics
SIGGRAPH ⬡ demo

Ehsan Pajouheshgar*, Hyunsoo Kim*, Sabine Süsstrunk, Wenzel Jakob, Jinah Park

We introduce Neural Particle Automata, a Lagrangian generalization of Neural Cellular Automata where each cell is a particle with a continuous position and internal state, using differentiable SPH operators and memory-efficient CUDA kernels to scale learned self-organizing particle dynamics.

2026
Neural Cellular Automata: From Cells to Pixels
SIGGRAPH ⬡ demo

Ehsan Pajouheshgar, Yitao Xu, Ali Abbasi, Alexander Mordvintsev, Wenzel Jakob, Sabine Süsstrunk

We pair a coarse-grid Neural Cellular Automata model with a lightweight implicit decoder that maps cell states and local coordinates to appearance, enabling self-organizing NCA outputs to render at arbitrary resolution in real time while preserving regeneration, robustness, and spontaneous dynamics across 2D, 3D, and mesh domains.

2025
Exploring the Landscape of Non-Equilibrium Memories with Neural Cellular Automata
Physical Review Letters ⬡ demo

Ehsan Pajouheshgar, A. Bhardwaj, N. Selub, E. Lake

We study binary 2D cellular automata that robustly store one-bit memories under noise, and use a modified Neural Cellular Automata framework to discover many new memory-preserving rules beyond Toom's rule.

2025
The Mokume Dataset and Inverse Modeling of Solid Wood Textures
ACM TOG / SIGGRAPH

M. Larsson, H. Yamaguchi, Ehsan Pajouheshgar, I-C. Shen, K. Tojo, C-M. Chang, et al.

We present Mokume, a solid-wood dataset of 190 cube samples with high-resolution photos, ring annotations, and CT scans, and introduce a three-stage inverse pipeline that reconstructs globally consistent 3D growth fields and volumetric color textures from exterior photographs using procedural and NCA-based synthesis.

2025
Volumetric Temporal Texture Synthesis for Smoke Stylization using Neural Cellular Automata
BMVC · ★ Best Poster Award

D. Wang, Ehsan Pajouheshgar, Y. Xu, T. Zhang, S. Süsstrunk

We present VNCA, an efficient volumetric style-transfer model that synthesizes multi-view-consistent stylization features for target smoke in real time while preserving temporally coherent transitions across frames.

2025
Canonical Latent Representations in Conditional Diffusion Models
Preprint

Y. Xu, T. Zhang, Ehsan Pajouheshgar, S. Süsstrunk

We identify Canonical Latent Representations in conditional diffusion models and use them in CaDistill to transfer core class semantics through compact representative latent samples, enabling strong robustness and generalization with only a small fraction of the original training data.

2024
Mesh Neural Cellular Automata
ACM TOG / SIGGRAPH ⬡ demo

Ehsan Pajouheshgar*, Yitao Xu*, Alexander Mordvintsev, Eyvind Niklasson, Tong Zhang, Sabine Süsstrunk

MeshNCA extends Neural Cellular Automata from regular grids to triangle meshes, enabling local self-organization and real-time dynamic texture synthesis directly on 3D surfaces without UV unwrapping or global communication.

2024
NoiseNCA: Noisy Seed Improves Spatio-Temporal Continuity of Neural Cellular Automata
ALife · ★ Best Student Paper Award ⬡ demo

Ehsan Pajouheshgar, Yitao Xu, Sabine Süsstrunk

We analyze NCA texture models in the continuous space-time limit, show that standard training overfits discretization near the seed, and use uniform-noise initialization to learn dynamics that stay consistent across resolutions, are robust to stochastic updates and additive noise, and behave like PDEs.

2024
Emergent Dynamics in Neural Cellular Automata
ALife

Y. Xu, Ehsan Pajouheshgar, S. Süsstrunk

We analyze the relationship between NCA architecture and emergent motion in the dynamics by varying cell-state dimensionality and MLP width, showing that their disparity and proportionality strongly correlate with motion strength and provide a practical design rule for dynamic NCAs.

2023
DyNCA: Real-time Dynamic Texture Synthesis Using Neural Cellular Automata
CVPR ⬡ demo

Ehsan Pajouheshgar*, Yitao Xu*, Tong Zhang, Sabine Süsstrunk

DyNCA enables real-time and controllable dynamic texture synthesis, producing arbitrarily long and arbitrary-size video textures while improving synthesis speed and quality by orders of magnitude over prior optimization-based methods.

2022
CLIPasso: Semantically-Aware Object Sketching
ACM TOG / SIGGRAPH · ★ Best Paper Award ⬡ demo

Yael Vinker, Ehsan Pajouheshgar, Jessica Y. Bo, Roman Christian Bachmann, Amit Haim Bermano, Daniel Cohen-Or, Amir Zamir, Ariel Shamir

CLIPasso abstracts any object into a sketch by jointly optimizing the position and shape of Bézier strokes, using a CLIP-based perceptual loss to preserve semantic identity across arbitrary levels of abstraction.

2022
Optimizing Latent Space Directions For GAN-based Local Image Editing
ICASSP

Ehsan Pajouheshgar, Tong Zhang, Sabine Süsstrunk

We propose LELSD, a method that learns semantically meaningful directions in GAN latent space for localized image editing, enabling precise attribute changes in specific spatial regions without affecting the rest of the image.

2020
ChOracle: A Unified Statistical Framework for Churn Prediction
IEEE TKDE

A. Khodadadi, A. Hosseini, Ehsan Pajouheshgar, F. Mansouri, H.R. Rabiee

ChOracle models churn through user return-time prediction by combining temporal point processes, recurrent neural networks, and latent loyalty variables, and uses an efficient variational backpropagation-through-time training method that generalizes across diverse real-world datasets.

2018
Back to Square One: Probabilistic Trajectory Forecasting Without Bells and Whistles
NeurIPS Workshop

Ehsan Pajouheshgar, Christoph H. Lampert

We propose an auto-regressive spatio-temporal CNN that outputs explicit probability distributions over future trajectories from visual input, and show that this simple probabilistic baseline matches or outperforms more complex methods on MNISTseq and Stanford Drone benchmarks.