Some of hdri maps are really poor quallity, taking for instance 3 exposures 2EV apart doesn't guarantee that you will achieve sharp shadows in your renderings. In situations like this you can add direct light matching hdri's sun position or just simply paint on hdri map with Photoshop. Please watch video tutorial to get more informations about process.