Assignment 4
Topic: Motion Segmentation
Due on or before:
11 November, 2006 (Saturday)
Maximum Marks: 8
Here is a video [please click on the above image to play/save/download
the video] of two people loitering about aimlessly in a parking
lot in front of the A. V. Williams Building, University of
Maryland, College Park. (You may perhaps recognise the 6-footer
in a greyish-blue shirt and dark trousers)
Are you sick of him? Shoot him (with a camera)... Eliminate
him from the picture...
But wait... this may not be too easy, since the two
people pass in front of each other, during their random walk.
Removing the vehicle is easier!
Can you remove the vehicle from the frames in the video?
Use the idea of motion segmentation, from the paper below. To segment
out the dominant motion, you may use the Sequential Labelling algorithm,
as done in class. Please generate two videos - one in which you
have marked the moving pixels with a particular colour e.g.,
white or red, and the final one, in which you have `removed' the moving
car.
How does one handle MPEG videos?
Please feel free to use any video player to play MPEG video, and
any decoder/encoder of your choice, on an operating system of
your choice.
You can download free MPEG software from the MPEG website at
http://www.mpeg.org/
This contains links to many resources - free, and otherwise.
Of particular importance to you may be the UC Berkeley
MPEG player
mpeg_play,
and the MPEG Software Simulation Group's MPEG encoder and
decoder
mpeg2encode, and
mpeg2decode,
all of which are downloadable through the links - including the
source code!
Internal Links [IIT Bombay]
It would be instructive to see a demo of the ideas in the paper
M. Irani, B. Rousso, S. Peleg.
Computing Occluding and Transparent Motions.
International Journal of Computer Vision, 12(1),
5 - 16, 1994.
These images have been taken from the School
of Computer Science and Engineering Homepage, The Hebrew University, Jerusalem.
(http://www.cs.huji.ac.il/labs/vision/research/project.html)
The Lady Vanishes
The first image shows Dr. Michal Irani (then at the Hebrew University,
Jerusalem) being segmented out of the frames. Note that there are other
moving objects in the scene. The camera itself is moving. The second is
more dramatic! The words `The Lady Vanishes' proved to be quite prophetic
... no, not in the sense of the Alfred Hitchcock movie of the same name,
but ... she first went to Sarnoff, and then to the Weizmann Institute.
You may check out the above web page for some very impressive demos, inclusing
one on mosaics.
Venues and Group Assignments to
TAs:
The TAs will mail you the timings to you
Sumantra Dutta Roy
Department of Electrical Engineering, IIT Bombay, Powai,
Mumbai - 400 076, INDIA. sumantra@ee.iitb.ac.in