A multimodal differential privacy framework based on fusion representation learning

Loading...
Thumbnail Image
File version

Version of Record (VoR)

Author(s)
Cai, Chaoxin
Sang, Yingpeng
Tian, Hui
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
2022
Size
File type(s)
Location
Abstract

Differential privacy mechanisms vary in modalities, and there have been many methods implementing differential privacy on unimodal data. Few studies focus on unifying them to protect multimodal data, though privacy protection of multimodal data is of great significance. In our work, we propose a multimodal differential privacy protection framework. Firstly, we use multimodal representation learning to fuse different modalities and map them to the same subspace. Then based on this representation, we use the Local Differential Privacy (LDP) mechanism to protect data. We propose two protection methods for low-dimensional and high-dimensional fusion tensors respectively. The former is based on Binary Encoding, and the latter is based on multi-dimensional Fourier Transform. To the best of our knowledge, we are the first to propose LDP-based methods for the representation learning of multimodal fusion. Experimental results demonstrate the flexibility of our framework where both approaches show efficient performance as well as high data utility.

Journal Title

Connection Science

Conference Title
Book Title
Edition
Volume

34

Issue

1

Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement

© 2022 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial License (http://creativecommons.org/licenses/by-nc/4.0/), which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Item Access Status
Note
Access the data
Related item(s)
Subject

Artificial intelligence

Cognitive neuroscience

Science & Technology

Technology

Computer Science, Artificial Intelligence

Computer Science, Theory & Methods

Computer Science

Persistent link to this record
Citation

Cai, C; Sang, Y; Tian, H, A multimodal differential privacy framework based on fusion representation learning, Connection Science, 2022, 34 (1), pp. 2219-2239

Collections