for my OE cycles and didn't have any problems, but I also don't have your history.
For my DE cycles, I am seeing a different RE and he is dead set against using it. He says that they have not seen any increased pregnancy rates from using it. Interesting how these REs have such differing viewpoints. I wanted to use it since I had no s/e and figured it couldn't hurt, but he wouldn't let me.
Hopefully, it won't cause any problems for you, and if so, your RE will let you stop right away.