• 16 Posts
  • 224 Comments
Joined 2 years ago
cake
Cake day: August 4th, 2023

help-circle





  • I don’t think so. Think about the training process. All the nodes in those neural networks were trained on sets of data together. While certain sets of nodes may be more heavily responsible for the word, “pineapple”, for example, those subsets cannot function outside the context of the whole network.

    Now, what if you had an LLM that hallucinates, and you trained a second neural network whose only job was to fact-check the output of the first neural network? Those are 2 neural networks trained on separate data, for separate purposes that work in tandem to provide accurate responses.


  • You jest, but only parts of the brain are responsible for decoding auditory signals. It doesn’t require weighted input from the whole brain to process these signals. In theory, one could surgically remove Brocha’s and Werniche’s areas, and they would function completely independent of the rest of the brain.

    My understanding is that you cannot identify a region of chatgpt that identifies plant leaves and separate it from the rest of the neural network without destroying its function. In this sense, the entire set of billions of weights is required for each function that chatgpt does.

    The brain has many separate components that function independent of each other, each of which is a fully functional neural network, all working in tandem.











  • Once upon a time, many moons ago as a resident, I was called at 2 AM by the organ donation team to call the time of death of a beautiful 21-year-old girl who had gone into a diabetic coma and never woke up. There was 20 people in the room weeping, Amazing Grace was playing; I was sweating bullets. So I stood there until her pulse stopped and called it, even though she still had PEA on the monitor. I was so nervous, I followed her into the OR to make sure she didn’t wake up when they cut her.