AICP: Augmented Informative Cooperative Perception

Pengyuan Zhou, Pranvera Kortoçi, Yui-Pan Yau, Benjamin John Finley, Xiujun Wang, Tristan Braud, Lik-Hang Lee, Sasu Tarkoma, Jussi Kangasharju, Pan Hui

Research output: Contribution to journalArticleScientificpeer-review


Connected vehicles, whether equipped with advanced driver-assistance systems or fully autonomous, require human driver supervision and are currently constrained to visual information in their line-of-sight. A cooperative perception system among vehicles increases their situational awareness by extending their perception range. Existing solutions focus on improving perspective transformation and fast information collection. However, such solutions fail to filter out large amounts of less relevant data and thus impose significant network and computation load. Moreover, presenting all this less relevant data can overwhelm the driver and thus actually hinder them. To address such issues, we present Augmented Informative Cooperative Perception (AICP), the first fast-filtering system which optimizes the informativeness of shared data at vehicles to improve the fused presentation. To this end, an informativeness maximization problem is presented for vehicles to select a subset of data to display to their drivers. Specifically, we propose (i) a dedicated system design with custom data structure and lightweight routing protocol for convenient data encapsulation, fast interpretation and transmission, and (ii) a comprehensive problem formulation and efficient fitness-based sorting algorithm to select the most valuable data to display at the application layer. We implement a proof-of-concept prototype of AICP with a bandwidth-hungry, latency-constrained real-life augmented reality application. The prototype adds only 12.6 milliseconds of latency to a current informativeness-unaware system. Next, we test the networking performance of AICP at scale and show that AICP effectively filters out less relevant packets and decreases the channel busy time.
Original languageEnglish
JournalIEEE Transactions on Intelligent Transportation Systems
Issue number11
Number of pages14
Publication statusPublished - Nov 2022
MoE publication typeA1 Journal article-refereed

Fields of Science

  • 113 Computer and information sciences
  • Vehicles
  • Sensors
  • Sorting
  • Prototypes
  • Computer science
  • Autonomous vehicles
  • System analysis and design
  • Cooperative perception
  • informativeness
  • augmented reality
  • sorting

Cite this