Make easier to handle the polling function before we implement
full threading support.

(cherry picked from libav commit ca960161)
Signed-off-by: James Almer <jamrial@gmail.com>