The check is no more required since recent changes in the
avfilter_unref_buffer(), the check is done in the function.
Simplify.