You cannot completely delete a windows service, as long as the services panel is open. The service stays undead and prevents any reinstallation until the services panel is closed.

Thanks Microsoft.
Separation of GUI and business logic does not apply here, because it's kernel logic, right?

But at least you're consistents, there is a similar issue with not installing USB drivers if the new hardware dialog is open.