That tells me that the issue is in your rear brakes or rear suspension. Since the rear drums were replaced and it got better I would check your rear suspension bushings and your rear axle seals. To check you rear axle seals chock your front tires, raise the rear axle and put on jackstands, remove the rear wheel speed sensors, rotate the tire by hand while watching the tone ring through the wheel speed sensor holes. If the tone rings are wet then you need to replace your rear axle seals, retainers, and wheel bearings. When a rear axle seal leaks you will get gear oil in the rear drum which can cause a brake vibration (slip/grab feeling) and/or diminished braking depending on how much gear oil is leaking past.