Game Chat Problem Between Xbox one and PS4

[Schmitzyy]

So I have a Xbox one, my buddy has a PS4. I bought a Nitrado server and that part of the game works awesome, the problem I have is that when I talk my buddy can hear me just fine, but I cannot hear him at all. Both of our settings in the game are the same, he is not muted, both of our icons come up in the bottom right that says we are both talking, I just cannot hear my buddy. Wondering if anyone else has this problem. Thanks.