With apple tools, the linker fails with errors like these, if the
offset is negative:

ld: in section __TEXT,__text reloc 8: symbol index out of range for architecture arm64

This is cherry-picked from libav commit
c44a8a3e.
Signed-off-by: Ronald S. Bultje <rsbultje@gmail.com>