Note that generation of MD5 is rather slow. Maybe there are quicker algorithms to generate proper hash values to compare, e.g., `murmur hash 3'. - Werner
Sir, I found xxhash by google to be a faster hashing algorithm, which is even faster (almost twice) than murmur hash 3. Native language of the algorithm is in C.
Running the 32 bit version, xxh32sum will be adequate to avoid collisions.