I doubt that would be a problem.
Tire side walls are designed to curve. When on the right size rim the curve is about the middle of the spec. A harrower rim puts it in toward the minimum spec. This causes the curve to be steeper. This tend to make the tire rounder in cross section. It can also cause excessive tread wear on the center of the tread.
Going to wide has the opposite effect. Shallower curve and a flatter cross section, excess wear to the outside of the tread.
Now will this be very noticeable on this application, maybe, maybe not. You will probably notice the slower steering response much more.
leo