what should i do

Don’t tell him how you feel is my advice. Support him. They have been together 3 years, and obviously something is working for him. They just had a baby and the baby needs both parents in a family relationship. Give this thing a chance and be happy for your brother, otherwise you could strain your relationship with him and he really doesn’t need that right now, he needs encouragement.