This blog is mainly based on the book and lecture notes by Professor Yaser S. Abu-Mostafa from Caltech on Learning from data , you could benefit a lot from the lecture and videos.
“In God we trust, and others bring data”.
If you show a picture to a three-year-old and ask if there is a tree in it, you will likely get the correct answer. But if you ask a thirty-year-old what the definition of a tree is, you will likely get an inconclusive answer.
We didn’t learn what a tree is by studying the mathematical definition of a tree. We learned it by looking at trees. In other words, we learn from ‘Data’.