Description

Event cameras differ from conventional frame cameras: Rather than capturing images at a fixed rate, they asynchronously measure pixelwise brightness changes, and stream an event sequence that includes time, location and sign of the brightness changes. Event cameras provide attractive properties like high temporal resolution and latency (both in the order of ms), very high dynamic range (120 dB) and low power consumptions because no routine operation needs to be recorded. Hence, event cameras have been successfully used for instance for object tracking, pose estimation, or image deblurring. Due to the described advantages of event cameras compared to these sensors, this paper for the first time, investigates the potential of event cameras in laser welding. One of the key questions of event cameras is how to extract meaningful information from the event data for in-process monitoring. Therefore, we present different promising ways to process the unconventional asynchronous output of event cameras for process monitoring, including time-series representations such as event rates, as well as image representations such as projections on the xy-plane of the event camera view field or projections along the scanner path.


Our laser welding experiments show clear differences for different production scenarios in those event representations. Additionally, we propose a machine learning pipeline for the automatic detection of production errors with event camera.

Contributing Authors

  • Patricia M. Dold
    Robert Bosch GmbH | Karlsruhe Institute of Technology (KIT)
  • Praveen Nadkarni
    Robert Bosch GmbH | University of Siegen
  • Meiko Boley
    Robert Bosch GmbH
  • Valentin Schorb
    Robert Bosch GmbH | Karlsruhe Institute of Technology (KIT)
  • Lili Wu
    University of Siegen
  • Fabian Steinberg
    University of Siegen
  • Peter Burggräf
    University of Siegen
  • Ralf Mikut
    Karlsruhe Institute of Technology (KIT)
Patricia M. Dold
Robert Bosch GmbH | Karlsruhe Institute of Technology (KIT)
Track: Artificial Intelligence in Laser Processing
Session: Process Monitoring I
Day of Week: Monday
Date/Time:
Location: Silver Lake

Keywords

  • Event Camera
  • Event-Based Vision
  • Process Monitoring