I don't think you quite understand what's going on with the camshaft. When the camshaft is assembled, inner bearings must be seated all the way to the stops on the camshaft, outer bearings must be seated all the way against the inner bearings, and the distance from the edge of the outer bearing to the outer edge of the bearing journal (seat) in the head must be equal on both sides--don't trust your eyeballs, use the depth probe of a caliper to measure.
When the fasteners are torqued down, the head cover will hold the bearings and thus the camshaft in position, and side play will not be detectable unless the bearings are well and truly shot.