You don't *have* to install them, but if you want to run any GL apps then they will sure speed things up. And of course if your XF86Config is already configured for the nVidia drivers and you upgrade your kernel you will need to either reinstall the drivers for the new kernel or modify your XF86Config to use the stock X11 drivers.
