Deep learning is a powerful tool for building visual classifiers. Many deep learning tools like Google's Tensor Flow [1,2], dlib [3,4] or Torch/pyTorch  are open source and available for free. However, to work properly, these tools either require previous trained kownledge, called models, or must be trained using, in many cases difficult to obtain, labeled data. Models for common use cases, e.g., classification of persons or cars in images, and the training data on which these models are based on are freely available for most of these tools [6,7]. However, there are no models available for classifying more specific objects like industrial robots. Creating models for classifying such objects is expensive due to the huge amount of required labeled training data. In addition to using real-world training data, synthetic generation of training data has been investigated . Even if models based on synthetic data can be less accurate compared to models based on real-world training data , they are very promising in terms of efficient automatic training data generation. Utilizing 3D scanning technologies, objects can be digitized and used for labeled training data generation. Additionally, synthetically generated training data has much less privacy issues. In combination with available training data for common use cases, these synthetic data can be used to train models which can classifiy common objects as well as special objects.
This project aims to investigate and evaluate methods for:
This project has a cooperative supervision with PKE Electronics. Students will get 500€ for their work (if working and finished within 6 months).
The result of this project should be a prototypical pipeline for semi-automatic training data generation. The goal of this pipeline is to minimize the amount of required user interaction while simultaneously maximizing the classification accuracy.
This pipeline should include the following items:
The focus of this work is on the acquisition and optimization of 3D data as well as the generation of renderings for training. The deep learning part is done in cooperation with PKE Electronics.
The focus of this project is to create and evaluate a pipeline prototype rather than implementing algorithms from scratch.
 https://www.tensorflow.org/  M. Abadi et al., "TensorFlow: A system for large-scale machine learning", in 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), 2016, pp. 265-283.  http://dlib.net/  Davis E. King, "Dlib-ml: A machine learning toolkit", Journal of Machine Learning Research, 10:1755-1758, 2009.  https://github.com/pytorch/pytorch  http://image-net.org/index  https://github.com/tensorflow/models  A. Rozantsev, "Vision-based detection of aircrafts and UAVs", p. 116, 2017.  S. Hinterstoisser et.al., "On Pre-Trained Image Features and Synthetic Images for Deep Learning", arXiv:1710.10710v2.  https://github.com/junyanz/CycleGAN