Go to GP as it can be infection or anything.
This happened to me the other day and it was a tiny cut on the side of my nipple which was opening up every time baby fed. It was sooo sore but barely noticeable! For me it went after a few days. X
What is making it sore? Is LO biting?