It's the natural consequence of playing with Docker to go mad at one point and try to dockerize everything.
I landed on using jwilder/nginx-proxy to put a reverse proxy in front of multiple services running in Docker containers on the same VPS.
Though a bit too magic for my taste but a good kind of magic!
AD. In the end, I decided against this.