Event-Aided Time-to-Collision Estimation
for Autonomous Driving

1 Neuromorphic Automation and Intelligence Lab (NAIL), Hunan University
2 School of Engineering, Westlake University
3 Aerial Robotics Group, HKUST
European Conference on Computer Vision (ECCV), 2024

* Equal Contribution  Corresponding author: eeyzhou@hnu.edu.cn

Real-world Experiments.

Abstract

Predicting a potential collision with leading vehicles is an essential functionality of any autonomous/assisted driving system. One bottleneck of existing vision-based solutions is that their updating rate is limited to the frame rate of standard cameras used. In this paper, we present a novel method that estimates the time to collision using a neuromorphic event-based camera, a biologically inspired visual sensor that can sense at exactly the same rate as scene dynamics. The core of the proposed algorithm consists of a two-step approach for efficient and accurate geometric model fitting on event data in a coarse-to-fine manner. The first step is a robust linear solver based on a novel geometric measurement that overcomes the partial observability of event-based normal flow. The second step further refines the resulting model via a spatio-temporal registration process formulated as a nonlinear optimization problem. Experiments on both synthetic and real data demonstrate the effectiveness of the proposed method, outperforming other alternative methods in terms of efficiency and accuracy.

Video

Datasets Overview

sys

Illustration of our datasets and devices for data collection. (a) A selected snapshot of the synthetic dataset, on each side of which the intensity information and the events (with a naive accumulation) are illustrated, respectively. (b) The configuration of the small-scale test platform. (c) The multi-sensor suite mounted on a car.

The details of three datasets we collected and their corresponding data collection hardware.

Dataset Links

Carla Synthetic Data Sequences

Left Sequence GIF

Suburban Const. Vel

Urban Const. Vel

Suburban Accelerate

Small-scale Data Sequences

Left Sequence GIF

Slider 500

Slider 750

Slider 1000

Forward Collision Warning Data (FCWD) Sequences

Left Sequence GIF

Sequence 1

Sequence 2

Sequence 3

If you have any questions about using the data, please contact Jinghang Li (jhanglee@hnu.edu.cn)

BibTeX


    @misc{li2024eventaidedtimetocollisionestimationautonomous,
      title         = {Event-Aided Time-to-Collision Estimation for Autonomous Driving},
      author        = {Jinghang Li and Bangyan Liao and Xiuyuan LU and Peidong Liu and Shaojie Shen and Yi Zhou},
      year          = 2024,
      eprint        = {2407.07324},
      archiveprefix = {arXiv},
      primaryclass  = {cs.CV}
    }