If you drill anwr then you need to set aside NWR land somewhere else. As for not having a big impact, you should know how delicate tundra is. Critters per square mile does not mean much. Any loss to habitat is significant especially when the habitat is specifically set aside as refuge.
And you should also know that there is a lot of protest over ANWR from within the state, although not much comes from politicians, but then again which one does not have their hands in oil money?