Neuro Computing Systems

Research Lab at KTH Stockholm, Sweden

Embedded Event Cameras


Today, computer cameras and computer vision algorithms on massively parallel hardware (such as GPUs) provide the main sensor source for surveillance of environments. Over the last years, a radically different, neurobiologically inspired type of vision sensor has emerged: event-based vision cameras. Those sensors do not operate on video frame images, but instead they mimic the perception of light as the biological eye does. They asynchronously report changes of illumination at individual pixels as “events” (or as “neuronal spikes”). These sensors overcome limitations of traditional cameras:
  1. they offer minimal-latency
  2. they adjust computing resources to the scene complexity
  3. they show no motion blur
  4. they require only low-bandwidth data transfers
  5. they provide ≥100dB perceivable illumination range.
Overall, such sensors are extremely well suited for low-power continuous monitoring, especially when combined with novel neuromorphic algorithms. In this research, we explore such a combination of novel sensing hardware, novel processors, and novel algorithms.
The unique combination of novel algorithms and low-power sensors and computing hardware creates new embedded vision systems that consume significantly less power compared to standard computer vision technology, e.g. for continuous surveillance. 

Publications


Neuromorphic computing hardware and neural architectures for robotics


Yulia Sandamirskaya, Mohsen Kaboli, J. Conradt, T. Celikel

Sci. Robotics, 2022


Event-Based Near-Eye Gaze Tracking Beyond 10,000 Hz


Anastasios Nikolas Angelopoulos, Julien N. P. Martel, Amit Kohli, J. Conradt, Gordon Wetzstein

IEEE Transactions on Visualization and Computer Graphics, 2020


A Miniaturised Neuromorphic Tactile Sensor integrated with an Anthropomorphic Robot Hand


Benjamin Ward-Cherrier, J. Conradt, M. Catalano, M. Bianchi, N. Lepora

IEEE/RJS International Conference on Intelligent RObots and Systems, 2020


Event-Based Vision: A Survey


Guillermo Gallego, T. Delbrück, G. Orchard, C. Bartolozzi, B. Taba, A. Censi, Stefan Leutenegger, A. Davison, J. Conradt, Kostas Daniilidis, D. Scaramuzza

IEEE Transactions on Pattern Analysis and Machine Intelligence, 2019


Low-Latency Line Tracking Using Event-Based Dynamic Vision Sensors


Lukas Everding, J. Conradt

Front. Neurorobot., 2018


A mobility device for the blind with improved vertical resolution using dynamic vision sensors


Lukas Everding, Lennart Walger, V. Ghaderi, J. Conradt

International Conference on e-Health Networking, Applications and Services, 2016


On-board real-time optic-flow for miniature event-based vision sensors


J. Conradt

IEEE International Conference on Robotics and Biomimetics, 2015