I had the same issue when my little boy was a newborn, the midwives advised me to lean back when I feed and that worked☺️it did settle down after around the 6-8 week mark I think x
It should settle eventually, you can try leaning back or pinching slightly behind your areola at the start of the feed to slow the let down. I did also sometimes hand express or use a haakaa just to get the letdown and then feed just so baby wasn’t being jetted with milk.
What position are you feeding in? Have you tried lying back to feed from this side as this means the milk has to work against gravity.