I went down the path of building without paying attention to weight, on a Jeep Rubicon. Steel bumpers, sliders, skid plates, tire carrier, misc interior stuff. It definitely had an effect on performance.
Went with aluminum bumpers, synthetic line winch, no rear tire carrier, stock skid...