It's not supposed to be set outside of lavc. Set r_frame_rate and
avg_frame_rate instead.