Am I overreacting?

I have a 5 month old son and he’s my first baby. Me and my husband are in our early 20’s and my husband dad used to be verbally abusive when my husband was a little boy (shouting/ screaming and putting my husband down) and hitting, kicking and punching my husband when he was just a kid due to getting in an argument with my husbands mum and her leaving. At the moment he is ok when he’s in a good mood but he still puts my husband down and doesn’t even show any remorse or apologise. He visits us at home with our son fortnightly and when he’s upset he will not talk to my husband at all or say silly comments to my son (things like you won’t want your parents around soon). He helps us a lot with our house and any jobs we need done but I don’t feel like that excuses his behaviour. He always criticises my husbands singing and apparently his did this when my husband was a little boy and would mock his singing (make dying cat noises) and tell him he should stop as it’s not his thing. My husband works in mental health and gets triggered when he sees parents acting the same way and so he’s doing therapy now. I feel uncomfortable him coming over fortnightly and he doesn’t want to come with my husbands mother either. I don’t mind him coming but a lot less and in moderation. Should I speak up? Also I’ll mention before we had our baby he never visited us and we would see them mainly on holidays like Christmas or Easter