The problem is that the video is output in overlay mode, which means it isnt processed by the graphics card as the other windows, rather layed on top.
There is a program in linux that can capture overlayed content but I can't for the life of me remember what it's called - perhaps someone else knows.
In the meantime Ogle can make screenshots of DVD.