CED: Color Event Camera Dataset

PDF  Video  Dataset (ros)  Dataset (txt/png)  BibTex

Abstract. Event cameras are novel, bio-inspired visual sensors, whose pixels output asynchronous and independent timestamped spikes at local intensity changes, called ‘events’. Event cameras offer advantages over conventional frame-based cameras in terms of latency, high dynamic range (HDR) and temporal resolution. Until recently, event cameras have been limited to outputting events in the intensity channel, however, recent advances have resulted in the development of color event cameras, such as the Color-DAVIS346. In this work, we present and release the first Color Event Camera Dataset (CED), containing 50 minutes of footage with both color frames and events. CED features a wide variety of indoor and outdoor scenes, which we hope will help drive forward event-based vision research. We also present an extension of the event camera simulator ESIM that enables simulation of color events. Finally, we present an evaluation of three state-of-the-art image reconstruction methods that can be used to convert the Color-DAVIS346 into a continuous-time, HDR, color video camera to visualise the event stream, and for use in downstream vision applications.

Note: Color events can be extracted using their (x, y) coordinates by following the Bayer filter pattern where R = [0, 0], G = [0, 1] and [1, 0], B = [1, 1].

DOI: 10.1109/CVPRW.2019.00215

CVF Open Access

Reference:

• C. Scheerlinck*, H. Rebecq*, T. Stoffregen, N. Barnes, R. Mahony, D. Scaramuzza, “CED: Color Event Camera Dataset”, Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2019.

* Equal contribution.