In the construction industry monitoring activities is important in order to evaluate the level of productivity or detect flaws in processes. Thanks to the advancement of methods based on artificial-intelligence such as computer vision, some activities concerning progress monitoring, quality control, and material flow tracking can be automated. In this project, computer vision methods are going to be employed in order to detect dump trucks during earthmoving work and identify the type of excavated material that are in it. This study will benefit construction industry by offering an improved procedure that will help track which types of material are going out of a construction site early enough in order to improve the supply chain management.