I have started cleanup of my front brake caliper using brake cleaner and a toothbrush. The pistons were stuck and had a little band of rust around them when I got them out. I bought new pistons. I still have some surface rust from the outer seal out to the lip of the caliper. I don't think that is going to come off unless I use something slightly abrasive. Will that be OK ? or is that taboo. I was thinking about very fine emery, or maybe crocus. I have no experience with disk brakes, so advice is appreciated.