No, set it flush with the top or face of the bolt. The top of the bolt is pretty much sitting right against the cover when it's installed so the little retaining screw can't back out any more. Making it tight can put too much pressure on the spring-loaded check ball and it may not release when it's supposed to.