Crystal,
I'm still not sure exactly what he was doing. But here is a few things to keep in mind in the future.
It it hurts stop. If he changes what he is doing or lightens up and it stops hurting - OK. But if he does it again and it starts to hurt again it is a sign that this is not something he should be doing. He has to stop and do something else or you have to stop the sex.
What the doctor might do is a couple of things. If there is a sign of infection he may give you an antibiotic. He may want you to douche with a medication - but I doubt this or insert a pessary (like aspirin to put inside your vagina). He may need to cauterize the inside of your vagina (burn it with a laser). If there is an actual rip - he might need to stitch it.
I'm not sure where your husbands finger was exactly- I'm not sure what he was touching was your cervix - it might have been your g-spot. The white bits you are describing sound as if he was actually acraping the wall of your vagina off, specifically your gspot - but not your cervix.
Men whose fingers are inside a woman need to be exceptionally clean, the nails need to be short/preferably filed, and there needs to be no hangnails. Dirt under a fingernail that scrapes the inside of the vagina can cause an infection.
Small cut or scrapes inside the vagina are not that unusual - but they usually heal overnight.
Please make an appointment very soon. (Even if the bleeding stops.) And please let me know what the doctor says.
Susan