I agree.
Being able to disable like you to with wear detection makes sense.
My previous headphones didn’t have any buttons - not even a power button.
So tapping controls were the only option.
I did occasionally get a tap in error which could be frustrating.