Well in my case it’s more ESPHome as all features regarding Voice Assist are still quite new and quite regularly some updates are breaking 
I found at least a version of code that works with current version of ESPHome and also fine with HA 
Well in my case it’s more ESPHome as all features regarding Voice Assist are still quite new and quite regularly some updates are breaking I found at least a version of code that works with current version of ESPHome and also fine with HA