Learning from data and Three learning principles

The learning problem and the principles before building a model.

This blog is mainly based on the book and lecture notes by Professor Yaser S. Abu-Mostafa from Caltech on Learning from data , you could benefit a lot from the lecture and videos.


“In God we trust, and others bring data”.

If you show a picture to a three-year-old and ask if there is a tree in it, you will likely get the correct answer. But if you ask a thirty-year-old what the definition of a tree is, you will likely get an inconclusive answer.

We didn’t learn what a tree is by studying the mathematical definition of a tree. We learned it  by looking at trees. In other words, we learn from ‘Data’.

Continue reading “Learning from data and Three learning principles”