• 1 Post
  • 269 Comments
Joined 3 years ago
cake
Cake day: June 12th, 2023

help-circle



  • A CUDA core is just a vector processor like every GPUs since the late 90s has been made of, but with a different name so it sounds special. It doesn’t just run CUDA, it runs everything else a GPU has traditionally been for, too, and that was stuff people were doing before CUDA was introduced. There are lots of tasks that require the same sequence of operations to be applied to groups of 32 numbers.

    An NPU is a much more specialised piece of hardware, and it’s only really neural network training and inference that it can help with. There aren’t many tasks that require one operation to be applied over and over to groups of hundreds of numbers. Most people aren’t finding that they’re spending lots of time waiting for neural network inference or draining their batteries doing neural network inference, so making it go faster and use less power isn’t a good use of their money compared to making their computer better at the things they do actually do.


  • AnyOldName3@lemmy.worldtoMemes@sopuli.xyz**!**
    link
    fedilink
    arrow-up
    13
    ·
    10 months ago

    Someone doesn’t understand the Windows design language. Anxiety would be a yellow warning triangle. That’s a red error circle, so something really has gone wrong and you’re right to be panicking about it, and better remember what it is before the consequences become too dire.





  • For a start, having a garbage collector doesn’t mean its use is mandatory, but even in a language where the garbage collector is mandatory, keeping an array alive as long as any references to it exist doesn’t stop you doing things like getting muddled about its length and reading/writing past the end. Mandatory garbage collection only prevents temporal memory bugs like use-after-free, not spatial memory safety bugs like buffer overruns, which need to be prevented by other mechanisms like bounds checks.



  • You can’t make an LLM only reference the data it’s summarising. Everything an LLM outputs is a collage of text and patterns from its original training data, and it’s choosing whatever piece of that data seems most likely given the existing text in its context window. If there’s not a huge corpus of training data, it won’t have a model of English and won’t know how to summarise text, and even restricting the training data to medical notes will stop mean it’s potentially going to hallucinate something from someone else’s medical notes that’s commonly associated with things in the current patient’s notes, or it’s going to potentially leave out something from the current patient’s notes that’s very rare or totally absent from its training data.


  • You don’t necessarily want to just ask for volunteers as that’s a great way to summon exactly the kind of people you don’t want to put in charge of online communities. The best way is usually to notice people who are already part of the community and consistently make positive contributions, then ask for their help. If none of those people want to, though, you’re stuck.






  • The Olympics have allowed trans women to compete against cis women since the 90s, and yet there’s never been a trans medalist. If there was a genuine advantage to being trans in sport, at least one country in the past three decades would have loaded their team with trans women and cleaned house. However, taking enough hormones to make a masculine body into a feminine one after it’s already grown means you’ve got way less testosterone than a cis woman, so that counters out any initial advantage. Claiming otherwise is misinformation. Spreading misinformation to the detriment of trans people is transphobic.