I wear Tyr goggles and don't really have much of a problem with the goggle marks. I **think** mine are hydrolites. Mine are more like a casual/training style than a smaller racing style, and that's probably where the difference comes in. Mine have pretty good sized rubbers on them.
I have the same problem. I wear Speedo Vanquishers. I limit myself to swimming before work on Fridays, which are casual at my office. For some reason I feel less weird about goggle marks with jeans than heels.
I think this may vary depending on how sensitive your skin is? I have pretty sensitive skin, especially around my eyes, and my marks stay for almost 2 hours, despite buying expensive goggles. I work from home so I don't have to go into an office, but I run errands after my swim on Saturday and know I look awful. I just tell myself that I got a great workout in and if someone wants to look at me funny because of my goggle eyes than so be it.