Select has limitations on the fd values it could accept and silently
breaks when it is reached.
(cherry picked from commit a8475bbd)