OVH and Hetzner are good choices.
They are robust commodity hosts that provide suitable quality hardware at excellent prices.
They can offer these prices because of a high degree of automation.
They give you KVM connections as well as SSH and provide hard and soft reboots, automatic reinstallations, etc.
However, and here could be the issue. They rent hardware and pre-packaged solutions, they will not be helping you with configuration, etc; that's your issue.
If you need help providing services from your upstream provider, then that's where the pricier competitors come in.