I'd call the doctor after a week or so (so if you're still feeling it in a few days). I think I tend to overreact. This cycle I had some sharp pains/cramps around CD15 (didn't O until CD21) and I thought about making an appointment, but they went away on their own after a few days.
Does your gyn's office use MyChart? It's a system where you can log in and see test results and send a message to the nurse or doctor (for a quick question, I'm sure they don't want it used in lieu of coming in for treatment). I was reluctant to sign up, but it's made it super easy to send my doctor a message with a quick question and get a speedy response without going in for an appointment for what turned out to be nothing.