If you ask the question what artificial neural networks are really doing you should start with the concept that an electrical switch is one-to-one when on and zero out when off. When on 1 volt in 1 volt out, 2 volts in 2 volts out etc. Then you can view ReLU as a switch with the switching predicate x>0? to turn the switch on and off. See "AI462 blog."
2 years ago | 0
Alexander Amini
Thank you TEDx for the invitation to deliver a TEDx talk on the cutting edge of AI!
2 years ago | [YT] | 40