The German Research Foundation (DFG) funds the research unit “Learning to Sense” for a second phase of four years. Through the joint development of innovative sensors and corresponding AI software, the research unit is conducting pioneering scientific work with great success. During the new funding period, the groups of the eight PIs (seven ZESS members Prof Bhaskar Choubey, Prof Haring Bolívar, Prof Ivo Ihrke, Prof Andreas Kolb, Prof Jun.-Prof. Jovita Lukasik, spokesperson Prof Michael Möller, and Prof Kristof Van Laerhoven, plus Prof Margret Keuper of the University of Mannheim) collaborate closely to develop sensor systems that can dynamically adapt to different situations with the help of AI, thereby delivering even better results.

L2S’ core research topic can be illustrated using the example of a camera: A conventional image sensor captures images using fixed technical settings. Artificial intelligence then analyses them and recognises, for example, people or objects. “Learning to Sense” develops the sensor and AI are to be developed together from the very beginning. “Instead of optimizing the sensor independently of its later application, the entire system learns what information is actually needed for the respective task. Put simply: Not only should the AI learn what it needs to recognise in an image – the camera should also learn how best to ‘look’ at it for that purpose,” explains research group spokesperson Prof. Möller.

During the first funding period, the research group was already able to demonstrate this principle in various applications. In doing so, sensor characteristics were optimized in conjunction with the AI system – for example, the arrangement of a sensor’s pixels for object recognition. In the second funding period, which has now been approved, the team aims to take it a step further: the sensor systems are to learn to adapt dynamically to different situations while in use.

You can learn more about the research unit at its website https://www.zess.uni-siegen.de/research/research-projects/dfg-research-unit-learning-to-sense/

Jan Söhlke
Jan Söhlke

Dr. Jan Söhlke is the head of communication and staff photographer at ZESS, as well as the Scientific Coordinator for the DFG Research Unit 'Learning to Sense' (FOR 5336).

Following his doctoral studies at LMU Munich, he moved into science communication and the visual documentation of research environments. His work focuses on photographing complex scientific setups and high-tech infrastructure - translating engineering and academic projects into clear visual assets. In addition, he works as a freelance photographer for industrial and research-driven organizations. You can find his portfolio at https://jansoehlke.com/.

Articles: 140