Update: it ended up being my brake booster was my hard brakes issue. Replaced with a Toyota unit and all is fine again.
At first, I switched out the booster hose with a toyota one, no change. Switching out the check valve with a toyota one, no change.
My short term fuel trims pegged into the 19s everytime I stepped on my brakes while the rig was moving above 5mph. Let go the brakes and stft went back to normal +/- 2. During all of this rig ran fine. No jump in rpm like you get with a vacuum leak, no rough running.
The bad booster did set a P0171 code, even after I erased it.