It was broken in 3b3ea346
"Remove all uses of deprecated AVOptions API", where any
presence of a payload_type AVOption caused its value to
be returned, even if it wasn't set (and thus had the default
-1 value).

This caused the RTP muxer to be broken.
Signed-off-by: Martin Storsjö <martin@martin.st>