Building ConvNets on MNIST dataset by TensorFlow with the new WIN10 GPU Monitor

A few days ago, I updated my  Windows 10 to version 1709 and found out that Microsoft added the GPU monitor in the Task Manager which I thought is awesome for ML developers and researchers.

Here is a screen capture of the official MNIST codes running Tensorflow-GPU on my Desktop.  It is clear to see that the GTX 960 uses about 3.5GB memory out of 4.0GB to train the ConvNets, which is much faster than the CPU computing.

Capture

You can find more models from the TensorFlow Models. This repository contains a number of different models implemented in TensorFlow.

 

What do I think about PyTorch and TensorFlow?

As we all know, the TensorFlow is very powerful and mature deep learning library with strong visualization capabilities and several options to use for high-level model development. PyTorch is still young framework which is getting momentum fast.

I strongly suggest CS and IT researchers/engineers learn both of them.

Tensorflow will be a good option if you are developing models for production or on mobile platforms, maybe in the future for large-scale distributed model training. Because it has good community support and comprehensive documentation, it is easier to find answers and get helps online.

Well, PyTorch is a good fit if you are doing research or your production are not very demanding.

Personly, I think Pytorch has better development and debugging experience.

Continue reading “What do I think about PyTorch and TensorFlow?”

TensorFlow Neural Network Playground in Matlab

The amazing website http://playground.tensorflow.org  can help you open a Neural Network on your Web Browser. The GUI is mind blowing, and you could download all the codes to study or to build your own project.

Now,   The Good News!  Amro and Ray Phan have created the MATLAB version of the NN playground, it looks just like the GUI of the Tensorflow version. However, it is not tensorflow-based, it is built on the Neural Networks Toolbox of Matlab (>R2009b). The authors said they are inspired by the [TensorFlow Neural Networks Playground] interface readily available online, so they created a MATLAB implementation of the same Neural Network interface for using Artificial Neural Networks for regression and classification of highly nonlinear data. Continue reading “TensorFlow Neural Network Playground in Matlab”

Talking Machine: An Insightfull Podcast

Strongly recommend this podcast, the hosts and guests share deep understanding about topics from Machine Learning and Artificial Intelligence, which I believe is very helpful to clarify some basic concepts and eliminate misleading ideas.

The latest episode is talking about the basics about the dropout in Deep Learning and various opinions on Inferencing among different research groups. It raises a very interesting question, does  Inference equal prediction? 🙂

Here are some episodes:

Hope you enjoy it like I do.

Continue reading “Talking Machine: An Insightfull Podcast”

Machine Learning on Google Cloud Platform

Google Cloud Platform is a cloud computing service by Google that offers hosting on the same supporting infrastructure that Google uses internally for end-user products like Google Search and YouTube.[1] Cloud Platform provides developer products to build a range of programs from simple websites to complex applications.[2][3]

Google Cloud Platform is a part of a suite of enterprise services from Google Cloud and provides a set of modular cloud-based services with a host of development tools. For example, hosting and computing, cloud storage, data storage, translations APIs and prediction APIs.[2]

—–Wiki

Just like Amazon and Microsoft, Google started its own cloud computing platform and the first 12 months for new users are free but with limited credits. You probably get used to running your machine learning algorithms on your local machine, but  I believe you know the clouding computing is the future! It is much cheaper and convenient to use.

When I am reviewing the CS231n: Convolutional Neural Networks for Visual Recognition  2017, I find they extended the new lab notes for the assignment as follows.

The students now can work on the assignment in one of two ways: locally on their own machine, or on a virtual machine on Google Cloud.

That is so cool,  right! If you are new to machine learning or just want to try different tools. This assignment is definitely a good practice.  Do it by yourself and you will make progress!

Cheers!

Continue reading “Machine Learning on Google Cloud Platform”

Another Android Phone? but it is designed by Andy Rubin

The Essential Phone brought to us by the person who created Android is finally ready for the spotlight. It’s an incredibly audacious and ambitious project, with an outlandish screen and the beginnings of a modular ecosystem.

Capture

Continue reading “Another Android Phone? but it is designed by Andy Rubin”

A five-day festival of Go and artificial intelligence in the game’s birthplace, China.

I just finished watching the second match between Ke Jie and AlphaGo,  there was a moment that Ke was approaching victory, but unluckily the machine is not human, it did not make mistakes.

Anyway, really love the Game~ Cheers!

Read: Exploring the mysteries of Go with AlphaGo and China’s top players

AlphaGo

Continue reading “A five-day festival of Go and artificial intelligence in the game’s birthplace, China.”