macawfish 13 hours ago

The phone is listening. Services like Shazam and Alphonso are constantly fingerprinting audio from the mics and sending these fingerprints up for "matching".

What are they matching against? Against key "content".

To check if the fingerprints from your phone mic match the "content" they have to do some kind of nearest neighbor search. What if the fingerprints aren't super close but they're somewhat close? To "content" related to certain products? Should we send the ad?

What if employees at Alphonso and Shazam _know_ that the fingerprints from your phone aren't quite close enough to have been generated from key monetizable samples of the "content", but also know that they are close enough to be effective? At targeting potential buyers?

Who decides how close is close enough? What's the ethical threshold here? And what's the most profitable threshold?

2
perching_aix 11 hours ago

> The phone is listening. Services like Shazam and Alphonso are constantly fingerprinting audio from the mics and sending these fingerprints up for "matching".

Could you please provide a source for this?

Just on the outset this sounds pretty wild if true. In the settings I do not see any permissions associated with Shazam, and only when I open it do I see the usual microphone indicator light up.

I will say though, it is weird that it doesn't have associated permissions listed, because clearly it can access the mic at least when it's open.

Edit: nevermind, found it, was just super hidden. But yeah, says it can only access it when the app is "in use". Now can it auto launch? Apparently also yes, after boot. Otherwise idk. It's further interesting I cannot tweak any of these permissions.

Edit #2: now it says that notifications are enabled for it, but then i check, and they aren't. i exercise the toggle, now it doesn't say that anymore, and the mic permissions are no longer hidden? Samsung please...

No amount of years in tech will rid me of tech pains it seems.

macawfish 3 hours ago

Pixel phones have a built in background audio fingerprinting service called "Now Playing" which can operate constantly.

Shazam has an "auto shazam" feature you can enable for constant background listening, since 2016 at least!

But look into Alphonso. That's like Shazam but explicitly for covert "content recognition" listening in microphone enabled apps. And it's old.

People who say it's too expensive or impractical to do bulk listening for ad-tech just aren't paying attention.

dist-epoch 11 hours ago

Shazam only records when you open it.