First submission to the arXiv

and I'm preparing v02 w/ ma co-workers using shareLaTex.

Horn: A System for Parallel Training and Regularizing of Large-Scale Neural Networks

Edward J. Yoon

(Submitted on 2 Aug 2016)

I introduce a new distributed system for effective training and regularizing of Large-Scale Neural Networks on distributed computing architectures. The experiments demonstrate the effectiveness of flexible model partitioning and parallelization strategies based on neuron-centric computation model, with an implementation of the collective and parallel dropout neural networks training. Experiments are performed on MNIST handwritten digits classification including results.

Subjects:	Distributed, Parallel, and Cluster Computing (cs.DC); Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)
Report number:	EP-909420F9A6E94B3691E5EE413DAD353E
Cite as:	arXiv:1608.00781 [cs.DC]
	(or arXiv:1608.00781v1 [cs.DC] for this version)