There are a few things I can think of:
- The servers in Azure, are their operating system firewalls blocking the ports you need; like ICMP or the ports you need in order to monitor resources?
- Depending on how you connect to your virtual network in Azure, if you have any NSGs in Azure the servers are behind, you may need to adjust their rules accordingly to allow the needed ports to your on-prem network.