I wonder how well this IDE works if you use AWS or GCP instead of Azure.
PM on the project here - All clouds and on-prem/local/docker work great! We test those, so if you have issues, please report in the repo we'll fix them.
I assume you run cloud-sql-proxy as usual (for proper TLS and passwordless IAM authentication), and then it's just another postgresql port for you. Any tool like psql can connect to it.