Deep neural networks have demonstrated state-of-the-art modeling accuracy on a wide range of real-life problems, with some cases surpassing human performance. Despite the promise of deep neural networks as an enabling technology for a large number of industries and fields, there are two particular key challenges in the design of deep neural networks in real-world, operational scenarios. First, the design of deep neural networks is a very time consuming process for a machine learning expert, and often results in complex, non-optimal deep neural networks.