Thank you for your question Yury. I know more about Amazon AWS mostly out of my own experience, but have been learning Google Compute Platform (GCP) and am a fan of TPUs and learning more and more about them. If you standardize on Docker, or K8s, then most all of the platforms will run those natively and so you can mix and match.
I think I'll just lie down here for a second. And ponder this tiny ad:
SKIP - a book about connecting industrious people with elderly land owners