you need to convert the video to grayscale.
ffmpeg -i VTS_05_1.VOB -pix_fmt gray -vcodec rawvideo -f rawvideo - | ffmpeg -y
-pix_fmt gray -s 720x576 -f rawvideo -i - -pix_fmt yuv420p -vcodec rawvideo -f
rawvideo - | x264 -o out.avi - 720x576
here it will help
For more details
http://ffmpeg.org/libavfilter.html#color[
^]
read from above link.
Hope this helps.