Can't delete DNS-zone or resource group due to non-ASCII characters

Hi

I've created a DNS-zone (I know it's in preview) but I can't make any records or even delete it.

Azure gives me the following error (I've replaced sensitive information with brackets):

"Failed to delete DNS zone [domain omitted - no non-ASCII character]. Error: The request with parameters subscription: [omitted] resourceGroup: [omitted - a non-ASCII character] Zone: [omitted - no non-ASCII character] is not valid because it contains non-ASCII characters."

Can I force a delete through PowerShell?

Thank you for your reply.