Adding the secondary interface of VM as backend pool to the Azure LB

I have created a Multi NIC VM on Azure using powershell, I want to configure one of the non primary interface as backend pool to the Azure external load balancer. In Azure portal there is only provision to select the VM name as backend pool and the primary interface of that VM receives the traffic. Is there a way to select the particular interface of the VM as the backend for Azure LB? 

Thanks,

Ram