I am curious about this too. I use mine outside a lot. I was going to attempt to toss it in the washer....but I'll lurk and see if anyone else has a better idea.
My cheap one from Target, I just throw in the washer and hang dry (it sort of melts in the dryer). My nice Manduka, I scrub with vinegar, rinse with water and hang dry.