"An Implementation of Deep Belief Networks Using Restricted Boltzmann M" by James Christopher Sims

Date of Award

2016

Degree Type

Thesis

Degree Name

Master of Science in Computer Science

Department

Computer Science and Statistics

First Advisor

Lutz Hamel

Abstract

In a work that ultimately heralded a resurgence of deep learning as a viable and successful machine learning model, Dr. Geoffrey Hinton described a fast learning algorithm for Deep Belief Networks. This study explores that result and the underlying models and assumptions that power it.

The result of the study is the completion of a Clojure library (deebn) implementing Deep Belief Networks, Deep Neural Networks, and Restricted Boltzmann Machines. deebn is capable of generating a predictive or classification model based on varying input parameters and dataset, and is available to a wide audience of Clojure users via Clojars, the community repository for Clojure libraries. These capabilities were not present in a native Clojure library at the outset of this study.

deebn performs quite well on the reference MNIST dataset with no dataset modification or hyperparamter tuning, giving a best performance in early tests of a 2.00% error rate.

Share

COinS
 
 

To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.