This fixes a race condition that was already documented in the source
code, and is also reported by tsan in fate-fic-avi.