the canonical way to do this is using ldap paging, with ldapsearch  you could try using the -E pr=xxxx parameter, where xxxx could be 1000 for instance. That way you know you are always under the limit imposed by the server.