Also fix calculation of new position when switching buffers.
This fixes "overread" error messages when seeking.