Trust glibc to optimize for the binary search, removing a oss-fuzz detected crash with our bad pointer maths.