DS' was still kinda gross at 5 wks. I don't remember it oozing, per se, but it definitely still had some crust.
Our pedi said if it wasnt red around the belly button or sensitive to the touch then it was fine. He also have us the ok to clean with alcohol, which he didn't recommend prior to that.