A more down to earth explanation on where the information is stored, if not in the neuron, would be other neurons that the neuron is connected to (and neurons they are connected to, etc.). In fact it seems fairly likely that information in the brain is just stored in the strength of synaptic connections. Just like in the computer memory case, really. Even though a complete data structure might is not stored in a single bit, all data inside it is eventually stored in bits and not in some magical realm "outside of physicality of the computer".