They’re only supposed to activate when called by a specific phrase like “okay Google”, but there are plenty of false positives, and every time that happens, an audio recording gets sent to Google.

And you can even do Google takeout and see all the recordings they took of you. Many of which you’ll notice doesn’t have you asking or doing anything remotely related to a voice search.