I'm sorry you're on this roller coaster. I've been there.
You can read my story below but if you want to fast forward the answer is YES, I am one who found success naturally with Dr. Check at age 39.2 on a cycle where my FSH was 12.1 and I barely had an antral follicle count. I'd done mucinex, timed intercourse, trigger shot and P4 support.
You absoultely have hope to conceive on your own.
Eariler last summer there was a woman on this board (screen name Shipin) who is 32 (or 34?), and went to see Dr. Check in the middle of a screwed up medicated cycle, he got her off the meds right away, monitoried her, had her do timed intercourse and she ended up PG.
The fact that you have conceived naturally (albeit medicated) is a VERY good sign. Unless you have other compounding factors like male factor or tubal issues, stuff like that, you don't necessarily have to do IVF. But it also matters how much longer you can hold out without finding success.