Connectivity Issue from Azure Virtual machine to Azure SQL Database

We have a scenario where we are not able to connect to Azure SQL from Azure virtual machine. I have 2 Azure SQL PAAS Databases where one of them is part of same virtual network to that of Azure Virtual machine and the other in different virtual network. We enabled Public network and even added the exception of allowing all the azure services to communicate but still we were not able to connect.