So this is likely due to the back spacing of the wheel and how far it sticks out based on its shape and width. TRD PRO wheels, FJ cruiser wheels and other after market wheels are designed for a more "aggressive stance" and are wider for stability off roading
Briefly, I believe that the FJ cruiser wheel is about 1/2 inch wider and will sit 15 mm (another half inch) farther from the wheel hub. As a result the wheel sticks about an inch from stock. You're likely okay when driving straight ahead, but when you turn, I imagine that is where you're having trouble.
Its one of the draw backs to wheel spacers that people dont understand. they lift and space and then dont understand the geometry. Take a look at it with the wheel turned the whole way in each direction, and see what adjustments/ cutting you need.
This thread will give you more info
Trying to underdstand backspacing and offset