fixing another assert q>0.0 issue caused by variance < 0, this fix allso changes the inter/intra decission very slightly -> all regression checksums need to be updated

Originally committed as revision 1122 to svn://svn.ffmpeg.org/ffmpeg/trunk