The recent advances in machine learning based on deep neural networks, coupled with the availability of phenomenal storage capacity, are transforming the industrial landscape. However, these novel machine learning approaches are known to be data hungry, as they need to tune a huge number of parameters in order to perform well. As more and more AI based applications are being deployed to learn from personal data, privacy concerns are rising, and more specifically on sensible domains like medicine, finance or mobile related data.