Intelligent RGB-Depth-Radio Sensor Fusion for Radio Propagation Channel Prediction or for Localization and Sensing Applications

Theme:

Communication, Sensing

Application:

5G/6G

Contact Person:

Yang Miao

External collabolator:

NIST, USA

Intorduction:

Summary: 
Integrated sensing and communication (ISAC) is a key feature for 6G and future Wi-Fi systems. In ISAC systems, highly accurate sensing on surrounding environment is as important as high speed communications, providing added values for modern cellular/Wi-Fi infrastructure and enabling emerging services like autonomous driving, industry 5.0, and remote health monitoring. Depending on the integration level, ISAC systems could be designed in the form of collaborative co-existing radar and radio communication systems, or in the form of co-design by sharing as much as possible the radio hardware and waveforms.

Description:

Method:
ISAC systems aim for simultaneous communication and radar sensing. Bistatic communication propagation channels are often modeled by geometry-based stochastic channels, while mono-static or bistatic radar sensing requires deterministic target properties along with possible random clutters. In this context, for 6G devices with ISAC functionalities, the identification of sensing target with environment awareness is essential for modeling the radio signals/channels and testing the radio systems. To this end, it is required to have temporal-spatial synchronized RGB-Depth data measured along with the radio signals/channels.

Research objectives:
In this assignment, the student will further explore the approaches to exploit the RGB-Depth-Radio measurement and data for a certain purpose. The purpose could be as follows: 1) for radio propagation channel prediction, e.g., with known RGB-D-Radio data in one scene, how to predict the radio channel in another scene by given only the RGB-D data; 2) for people counting or localization or sensing or imaging (pose recognition): with certain training dataset of RGB-D-Radio, can we sense the environment or identify the target from only radio data?

Requirements:

Fundamental knowledge on radio systems and signals, antennas and radio propagation, signal processing, logical thinking and problem solving.

Additional Info