I use a combination of various types of unsupervised spiking neural nets. My nets only learn small elementary patterns that can be instantly combined to form any complex object.
The most important ingredient in intelligence is timing. It is essential to everything from perception to reasoning, planning and goal-oriented…
You can use ADAM as the optimizer. In fact, you could probably get better results by using it.
Not sure about RMSProp though. Haven’t looked into it that much.
Thanks Muzahid. Most of the concepts highlighted in this post did have their papers cited in this post. However I also chose to cite those blogs since my understanding of those papers wouldn’t have been made possible without them distilling the information (that came from the same papers) in a manner which I can understand it better.