I would think your second FSH number may be more accurate since you had recently come off the birth control pills. Your AMH level is in the low normal range but not really low range. And your antral follicle count is low for your age. But the big thing is you are only 31 so I would think you've got good eggs just not tons of them for your age. Since you can't stand the chlomid it would make sense to me to at least try one IUI with injectible stims. I don't think it woud be a waste of money. And it would give the RE a test run to see how you woud respond to the meds in case you then go on to IVF.
You could also try for a few months naturally and see how it goes. Just use OPK's and make sure to frequently BD before ovulation. Wishing you luck!