The recommended service interval provided by Toyota Canada indicates coolant replacement at 64,000 km and replacement of automatic transmission fluid at 96,000 km for a 2004 T4R V6.
Time wise, that would be about every 4 years for the coolant and every 6 years for the tranny fluid (based on driving about 16.000 kms per year).