The connection was closed by the remote end, or an error occurred while receiving data: '64(The specified network name is no longer available.)'

Getting this error while configuring service broker on my network.

I have already checked below things.

1) Port 4022 is enabled on the firewall of both server.
2) Telnet to the port 4022 is working fine.
3) Able to connect cross database server throw SSMS.
4) GRANT CONNECT ON  ENDPOINT  and GRANT SEND ON  SERVICE already given.

Does anyone know why is this happening?