1. Segmentation with shape and shading
2. Segmentation of multi-modal images
3. Joint Non-rigid Motion Estimation and Segmentation
Consider the following task: segment a non-rigidly moving object and estimate its motion field in a combined model. Let us assume that the object being compact, occludes the background but not itself as well as (for simplicity) still background. We model the task by a Markov Random Field where each pixel of the (reference) image is labelled by a combined segmentation/displacement label and assume a pixel-wise conditional independent p.d. of images given the hidden labelling. [more (pdf)]
A hand moving in front of a plant: Two consecutive frames, segmentation in the first frame and deformed mesh in the second frame.