• 0 Posts
  • 15 Comments
Joined 9 months ago
cake
Cake day: June 7th, 2024

help-circle

  • Nothingburger. For the vast majority of users the audio was already getting sent to the cloud for realtime processing. Nothing here changes that.

    For a few devices, some amount of processing was getting done on-device. Now, with the fancy LLMs, it has to revert to sending it all to the cloud.

    Just turn on the feature to delete the recording after each processing. Best you can get if you want to keep using these devices and not run an NVidia processing cluster in your kitchen.



  • So… if you own an inexpensive Alexa device, it just doesn’t have the horsepower to process your requests on-device. Your basic $35 device is just a microphone and a wifi streamer (ok, it also handles buttons and fun LED light effects). The Alexa device SDK can run on a $5 ESP-32. That’s how little it needs to work on-site.

    Everything you say is getting sent to the cloud where it is NLP processed, parsed, then turned into command intents and matched against the devices and services you’ve installed. It does a match against the phrase ‘slots’ and returns results which are then turned into voice and played back on the speaker.

    With the new LLM-based Alexa+ services, it’s all on the cloud. Very little of the processing can happen on-device. If you want to use the service, don’t be surprised the voice commands end up on the cloud. In most cases, it already was.

    If you don’t like it, look into Home Assistant. But last I checked, to keep everything local and not too laggy, you’ll need a super beefy (expensive) local home server. Otherwise, it’s shipping your audio bits out to the cloud as well. There’s no free lunch.





  • My wife and I used to tag-team. Only one person got to lose it at a time. As soon as one person got that distant, exasperated look, Parent 2 jumped in and Parent 1 could go cool down, watch a show, have a drink, or take a bath. If solo, we’d use distraction and humor. If too much, you stick them in a playpen with toys and let them self-sooth.

    If it’s any consolation, they won’t remember diddly-squat of anything that happened before ages 5-6.




  • My first tech job out of college, I was told to go talk to “Dave,” the guru old-timey programmer and learn the lay of the land. He turned out to be this crotchety old guy, with low tolerance for idiots, but a soft spot for someone who actually paid attention.

    A few months in, I was told to go fix a feature in the company’s main product which was sold to power utilities. This was a MASSIVE code base, with a mix of C, C++, assembler, and a bit of Fortran thrown in. I spent a week poring through all the code trying to figure things out. Then I hit a mystery workflow that didn’t make sense.

    I walk over to Dave’s office and ask a specific question. Now, mind you, he had worked on this years ago, and had long moved on to new products. He leans back in his chair, stares at the ceiling, then without looking at the screen once tells me to go look at such and such file for such and such variable, and a list of functions that were related. I go back to my desk and damn if it wasn’t EXACTLY as he described.

    Now, I’m probably as old as he was then. I don’t remember what I wrote an hour ago. No matter what I build, I’ll always be in awe of Dave and what he could keep in his head.




  • Most IoT devices that died did so because the vendor went out of business and had to shut off the servers. Most lived in hope that a last minute investment would keep them afloat. In a few other cases, it was the middleware software provider (like Google IoT) that shut down and bricked a device.

    This legislation might apply to a big company that decides to discontinue a product line and could then send notices out, but most startups won’t know (or admit defeat) till the last possible moment. By then it’s too late.