The digitalization of railroad infrastructure is aimed at the improvement of maintenance and construction activities. Currently, inspections are done manually, with a domain expert classifying objects. This is a challenging task, considering the Netherlands has more than 3,400 km of railways that need to be inspected and maintained.