Part 2: How to get through — This is Part 2 in the series. You can find Part 1 here and Part 3 here. Doing research After having chosen a research topic and reviewed the literature, you are hopefully excited now to do your own research! Assuming that you have brainstormed some ideas to start with (either alone or…

Part 1: How to get in — This is Part 1 in the series. You can find Part 2 here and Part 3 here. At the time of this writing, I have recently finished my PhD in machine learning at ETH Zürich. In retrospect, I have the subjective feeling that I’ve learned a thing or two over…

How to Find Your Winning Ticket — Note: The original research report on which this post is based can be found here Introduction If you’re one of those people with a large number of GPU compute nodes in your basement, or if you work for Google, training neural networks in a short time for challenging tasks is probably…

About the strengths and weaknesses of different models of the mind — I recently attended a reading by Siri Hustvedt, where she was talking about her latest book “The Delusions of Certainty”. Siri seems to be a very smart lady with many interesting ideas, for instance regarding the role of the Placebo effect in our health care system. However, she made one…

Can machines develop their own language? — Despite the title, this post is not about doing natural language processing using deep models. This topic has been discussed in depth by many smart people (e.g. Sebastian Ruder) and is rather application-oriented. …