Award Abstract # 1763964
NeTS: Medium: Collaborative: Reliable Underwater Acoustic Video Transmission Towards Human-Robot Dynamic Interaction

NSF Org: CNS
Division Of Computer and Network Systems
Recipient: RUTGERS, THE STATE UNIVERSITY
Initial Amendment Date: July 16, 2018
Latest Amendment Date: October 15, 2020
Award Number: 1763964
Award Instrument: Continuing Grant
Program Manager: Murat Torlak
mtorlak@nsf.gov
 (703)292-0000
CNS
 Division Of Computer and Network Systems
CSE
 Direct For Computer & Info Scie & Enginr
Start Date: September 1, 2018
End Date: August 31, 2022 (Estimated)
Total Intended Award Amount: $499,999.00
Total Awarded Amount to Date: $523,999.00
Funds Obligated to Date: FY 2018 = $178,868.00
FY 2019 = $181,739.00

FY 2020 = $163,392.00
History of Investigator:
  • Dario Pompili (Principal Investigator)
    pompili@rutgers.edu
  • Francisco Diez-Garias (Co-Principal Investigator)
Recipient Sponsored Research Office: Rutgers University New Brunswick
3 RUTGERS PLZ
NEW BRUNSWICK
NJ  US  08901-8559
(848)932-0150
Sponsor Congressional District: 12
Primary Place of Performance: Rutgers University New Brunswick
33 Knightsbridge Road
Piscataway
NJ  US  08854-3925
Primary Place of Performance
Congressional District:
06
Unique Entity Identifier (UEI): M1LVPE5GLSD9
Parent UEI:
NSF Program(s): Special Projects - CNS,
Networking Technology and Syst
Primary Program Source: 01001819DB NSF RESEARCH & RELATED ACTIVIT
01001920DB NSF RESEARCH & RELATED ACTIVIT

01002021DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7363, 7924, 9102, 9251
Program Element Code(s): 171400, 736300
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

In the past decade underwater communications have enabled a wide range of applications; there are, however, novel underwater monitoring applications and systems based on human-robot dynamic interaction that require real-time multimedia acquisition and classification. Remotely Operated Vehicles (ROVs) are key instruments to support such interactive applications as they can capture multimedia data from places where humans cannot easily/safely go; however, underwater vehicles are often tethered to the supporting ship by a fiber cable or have to rise periodically to the surface to communicate with a remote station via Radio Frequency (RF) waves, which constrains the mission. Wireless acoustic communication is the typical physical-layer technology for underwater communication; however, video transmissions via acoustic waves are hard to accomplish as the acoustic waves suffer from attenuation, limited bandwidth, Doppler spreading, high propagation delay, high bit error rate, and time-varying channel. For these reasons, state-of-the-art acoustic communication solutions are still mostly focusing on enabling delay-tolerant, low-bandwidth/low-data-rate scalar data transmission or at best low-quality/low-resolution multimedia streaming in the order of few tens of Kbps. Hence, the objectives of this research program are: (1) To design novel communication solutions for robust, reliable, and high-data rate underwater multimedia streaming on the order of hundreds of Kilobits per second (Kbps); (2) To investigate the problem of integrating communication methods available in multiple environments on an innovative software-defined testbed architecture integrating Microelectromechanical (MEMS)-based Acoustic Vector Sensors (AVSs) that will enable processing-intensive physical-layer functionalities as software-defined, but executed in hardware that can be reconfigured in real time by the user based on the Quality of Experience (QoE).

By exploiting multiple-antenna arrays and AVSs, in Task 1 a novel physical-layer solution will be proposed to boost the data rate for underwater acoustic transmission so as to transfer high-resolution video underwater. By following a novel probabilistic approach, an efficient Medium Access Control (MAC) layer solution will be designed to share reliably the space among the steered vehicles by using AVSs so as to reduce the acoustic interference. The quality of multimedia delivery will be improved by applying a robust closed-loop hybrid Automatic Repeat Request (ARQ) coding technique based on the estimated angles of arrivals using AVSs. In Task 2, the SEANet G2 acoustic networking platform will be modified to investigate the design and fabrication of a new class of miniaturized and integrated AVS arrays based on the Aluminum Nitride (AlN) piezoelectric MEMS technology. Finally, in Task 3, scenarios will be defined to validate the ideas proposed in Task 1 using the Naviator, AVSs, and SEANet testbed; Task 2 will be evaluated by integrating SEANet to a buoy and the Naviator along with AVSs to build a testbed for conducting video transmission experiments. Tasks 1 and 2 will be also integrated by comparing the pros and cons of MEMs AVSs with Commercial Off-The-Shelf (COTS) AVSs and by evaluating the semi-autonomous human-in-the-loop features to enhance user QoE.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

E. Demirors, D. Unal "High-Data Rate Carrierless Impulsive Communications For Underwater Acoustic Networks" Underwater Acoustics Conference and Exhibition , 2019 Citation Details
Qi, Zhuoran and Petroccia, Roberto and Pompili, Dario "ASVTuw: Adaptive Scalable Video Transmission in Underwater Acoustic Multicast Networks" WUWNet'22: The 16th International Conference on Underwater Networks & Systems , 2022 https://doi.org/10.1145/3567600.3568137 Citation Details
Qi, Zhuoran and Pompili, Dario "UW-CTSM: Circular Time Shift Modulation for Underwater Acoustic Communications" 2022 17th Wireless On-Demand Network Systems and Services Conference (WONS) , 2022 https://doi.org/10.23919/WONS54113.2022.9764464 Citation Details
Rahmati, Mehdi and Pompili, Dario "UW-SVC: Scalable Video Coding Transmission for In-Network Underwater Imagery Analysis" IEEE International Conference on Mobile Ad-hoc and Smart Systems (MASS) , 2019 https://doi.org/10.1109/MASS.2019.00052 Citation Details
Rahmati, Mehdi and Qi, Zhuoran and Pompili, Dario "Underwater Adaptive Video Transmissions using MIMO-based Software-Defined Acoustic Modems" IEEE Transactions on Multimedia , 2021 https://doi.org/10.1109/TMM.2021.3127454 Citation Details
Anjum, Khizar and Qi, Zhuoran and Pompili, Dario "Deep Joint Source-Channel Coding for Underwater Image Transmission" International Conference on Underwater Networks & Systems (WUWNet) , 2022 https://doi.org/10.1145/3567600.3568138 Citation Details
Qi, Zhuoran and Pompili, Dario "Spatial Modulation-based Orthogonal Signal Division Multiplexing for Underwater ACOMMS" 2022 Sixth Underwater Communications and Networking Conference (UComms) , 2022 https://doi.org/10.1109/UComms56954.2022.9905682 Citation Details
Rahmati, Mehdi and Petroccia, Roberto and Pompili, Dario "In-Network Collaboration for CDMA-Based Reliable Underwater Acoustic Communications" IEEE Journal of Oceanic Engineering , v.44 , 2019 https://doi.org/10.1109/JOE.2019.2910940 Citation Details
Herrera, Bernard and Pop, Flavius and Cassella, Cristian and Rinaldi, Matteo "PMUT-Enabled Underwater Acoustic Source Localization System" IEEE International Ultrasonics Symposium (IUS) , 2019 https://doi.org/10.1109/ULTSYM.2019.8926312 Citation Details
Hsieh, Yung-Ting and Qi, Zhuoran and Pompili, Dario "ML-based Joint Doppler Estimation and Compensation in Underwater Acoustic Communications" 2022 ACM WUWNet The 16th International Conference on Underwater Networks & Systems , 2022 https://doi.org/10.1145/3567600.3568139 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Wireless acoustic communication is the typical physical-layer technology for underwater communication; however, video transmissions via acoustic waves are hard to accomplish as the acoustic waves suffer from attenuation, limited bandwidth, Doppler spreading, high propagation delay, high bit error rate, and time-varying channel. For these reasons, state-of-the-art acoustic communication solutions are still mostly focusing on enabling delay-tolerant, low-bandwidth/low-data-rate scalar data transmission or at best low-quality/low-resolution multimedia streaming in the order of few tens of Kilobits per second (Kbps). Hence, the objectives of this research program were: (1) To design novel communication solutions for robust, reliable, and high-data rate underwater multimedia streaming on the order of hundreds of Kbps; (2) To investigate the problem of integrating communication methods available in multiple environments on an innovative software-defined testbed architecture integrating Microelectromechanical (MEMS)-based Acoustic Vector Sensors (AVSs) to enable processing-intensive physical-layer functionalities as software-defined, but executed in hardware that can be reconfigured in real time by the user based on the Quality of Experience (QoE).

 

By exploiting multiple-antenna arrays and AVSs, in Task 1 a novel physical-layer solution was proposed to boost the data rate for underwater acoustic transmission so as to transfer high-resolution video underwater. By following a novel probabilistic approach, an efficient Medium Access Control (MAC) layer solution was designed to share reliably the space among the steered vehicles by using AVSs so as to reduce the acoustic interference. The quality of multimedia delivery was improved by applying a robust closed-loop hybrid Automatic Repeat Request (ARQ) coding technique based on the estimated angles of arrivals using AVSs. In Task 2, the SEANet G2 acoustic networking platform was modified to investigate the design and fabrication of a new class of miniaturized and integrated AVS arrays based on the Aluminum Nitride (AlN) piezoelectric MEMS technology. Finally, in Task 3, scenarios were defined to validate the ideas proposed in Task 1 using the Naviator, AVSs, and SEANet testbed; Task 2 was evaluated by integrating SEANet to a buoy and the Naviator along with AVSs to build a testbed for conducting video transmission experiments. Tasks 1 and 2 were also integrated by comparing the pros and cons of MEMs AVSs with Commercial Off-The-Shelf (COTS) AVSs and by evaluating the semi-autonomous human-in-the-loop features to enhance user QoE.

 

Specific achievements/outcomes accomplished during this project are summarized below.

 

Deep Learning Framework for Link Adaptation in Underwater Wireless Optical Communications. This framework is based on a novel deep-Recurrent Neural Network (RNN)-based architecture. The dataset generation methodology was also described under this framework.

 

UW-CTSM: Circular Time Shift Modulation for Underwater Acoustic Communications. The key feature of the proposed modulation is the utilization of the high autocorrelation of the Zero-Correlation-Zone (ZCZ) signals.

 

ASVTuw: Adaptive Scalable Video Transmission in Underwater Acoustic Multicast Networks. The advantages of the ASVTuw include selecting Modulation and Coding Schemes (MCSs) adaptively with Equal Error Protection (EEP) or Unequal Error Protection (UEP) by referring to the Channel State Information (CSI) based on ML, decoding the Scalable Video Coding (SVC) video adaptively according to users' video quality requirements, and saving resources by avoiding transmitting redundant SVC enhancement layers.

 

Deep Joint Source-Channel Coding for Underwater Image Transmission. We presented our data-driven scheme for Joint Source-Channel Coding (JSCC) in underwater acoustic channel using CNN-based feature extraction and a novel variable-length encoder and decoder design based on Recurrent NNs (RNNs). The variable-length encoder-decoder design has the potential to adapt to changing underwater channel depending on the feedback received from the receiver.

 

ML-based Joint Doppler Estimation and Compensation in Underwater Acoustic Communications. The proposed solution adopts the concept of the Decision Feedback Equalizer (DFE) model as well as ML-based computation acceleration to save power without sacrificing performance.

 

Spatial Modulation-based Orthogonal Signal Division Multiplexing for Underwater ACOMMS. The simulation results showed that the SM-OSDM achieved a lower BER than Multiple-Input Multiple-Output (MIMO)-OSDM with the same deployment of transducers and hydrophones and a higher spectral efficiency than Single-Input Single-Output (SISO)-OSDM, especially in high Doppler channels..

 

Full-Duplex Underwater Acoustic Communications via Self-Interference Cancellation in Space. The proposed technique utilizes underwater Acoustic Vector Sensors (AVSs) and a Phased Array Transducer (PAT) as well as an adaptive protocol. The protocol helps FD UWA communication establish a reliable communication with spatial SIC on both side of the link. By updating DOA from information acquired with AVS, the BeamFormer (BF) helps PAT adjust the steering angle to aim at the other side of the link, therefore transmitting intensive signals with the main lobe in beamforming.

 

High-resolution Data Acquisition and Joint Source-Channel Coding in Underwater IoT. We proposed a MOSFET-based encoding scheme to realize low-power and low-cost substrate sensors. Further, we proposed a correlation-based Hybrid Automatic Repeat Request (HARQ) to transfer data between digital surface buoys and the fusion center that leverages the correlation in the data to avoid costly packet retransmissions and thereby enable timely reconstruction of the phenomenon. 

 


Last Modified: 12/31/2022
Modified by: Dario Pompili

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page