hi what about lengthening the hair rig by a couple of inches, when casting in to silt the hair will usually get dragged into the silt with the lead. Sounds like the fish are finding the bait but maybe the lead is plugging into the silt with only a couple of inches of the hair rig exposed, this is why your getting the takes but a very light hook hold. Also try a different lead arrangement, still use an inline lead, but fish it so it comes off on the take like ali hamidi from korda fishes the zig rig. ill try and do an illustration for you if need be, anyway hope this helps