41MM Showa and KYB fork tubes are heavier walled than 35, 36, and 38MM tubes of the same manufacture. I can send you a link to Purdue University's library, where you can view the MMPDS-01. This is the bible by which joint and member strength is calculated for aircraft structure. There is an entire section on column strength (tubes, round, box, hex, whatever shape, and formulas for calculating relative strength. If you have the aptitude, you can calculate the percentage of increase in rigidity of a given member with an increasing diameter, and wall thickness.
Build your bike the way you want. The original post asked for any thoughts. I have thoughts. If you have ever had a machine that you built eat itself up, and then found out later that somone saw a potential issue and did not share thoughts or concerns, it makes you mad. It wastes time and effort, and it can kill people, especially in my line of work. I will make sure not to comment on YOUR projects, but the original post belongs to another user. Sorry if I think to much for you.
Also, the fork brace actually makes the tubes perform in tandem, preventing tortional twist, which is a good thing, so no, I would not say remove the brace.