Why is it painful for me?

You could have a condition called vaginimus (only way to cure this is dilator therapy) which is extreme contractions of the vaginal muscles; it is also associated with the fear of pain from penetration/sex. It could also be an abnormal hymen, severely tilted uterus, etc. In any case, I would definitely recommend seeing a gynecologist on the issue