My first IVF cycle started just like that. I believe on CD 9 my E2 was 55 and I had one or two small follicles. I was devasted but they kept me going to see if I would progress. Well, I did and ended up triggering on CD 17 with an E2 of 1405 and they retrieved 8 eggs, which for me is good. But that was a long and miserable two weeks..thinking every day I would be cancelled.
My RE said the other day she doesn't care how slowly I progressed and that she was happy with my response. We would have been happier if it was a BFP but maybe next time