If you should run into the same situation, that you'd like to delete a view programmatically, for example on module uninstall, here you go:
<?php
\Drupal::service('config.factory')->getEditable('views.view.' . $view_name)->delete();
?>
Then I'd be very happy about a delicious coffee! Or a helpful book from my wish list.