I always freeze, it makes the coating/filling process much easier because they are completely solid, and much easier to move around. I've broken more refrigerated cakes than I care to think about. I find that by the time I fill, the outside has thawed just enough that crumb coating is not a problem. And if I work quickly enough, I don't even need to crumb coat because the freezing makes it less likely to release crumbs.
Plus a lot of people (including me) feel like the freezing process makes the cake moister for some reason. I cannot explain it, I just know that it is. If it's wrapped well, they just seem to stay moist longer.
eta: if you have a significant dome on the cake, I often chill in the fridge, then trim before freezing. It's can be done frozen with a good serrated knife, but it's easier to make an error, because you're pushing the knife pretty hard.
Fairy tales do not tell children the dragons exist. Children already know that dragons exist. Fairy tales tell children the dragons can be killed. - G. K. Chesterton