My friend cannot join my server in online multiplayer xbox one

[MA80Sean]

No matter what we try my friend can never join my online server, ive looked at my NAT settings and theyre unrestricted and open , we have tried and tried but he keeps getting a message “cannot connect to server” when trying to join , yet i can connect and join into his game without issues. Has anyone a solution or something we may be doing wrong.