Asynchronous Federated Unlearning

Ningxin Su, Baochun Li, University of Toronto,
IEEE International Conference on Computer Communications (INFOCOM) 2023
[Paper] [Slides] [Source Code]

Thanks to regulatory policies such as the General Data Protection Regulation (GDPR), it is essential to provide users with the right to erasure regarding their own private data, even if such data has been used to train a neural network model. Such a machine unlearning problem becomes even more challenging in the context of federated learning. where clients collaborate to train a global model with their private data. When a client requests that its data be erased, its effects have already gradually permeated through a large number of clients, as the server aggregates client updates over multiple communication rounds. Thus, erasing data samples from one client requires a large number of clients to engage in a retraining process.

Read more →

How Asynchronous can Federated Learning Be?

Ningxin Su, Baochun Li, University of Toronto,
IEEE International Symposium on Quality of Service (IWQoS) 2022
[Paper] [Slides] [Source Code]

As a practical paradigm designed to involve large numbers of edge devices in distributed training of deep learning models, federated learning has witnessed a significant amount of research attention in the recent years. Yet, most existing mechanisms on federated learning assumed either fully synchronous or asynchronous communication strategies between clients and the federated learning server. Existing designs that were partially asynchronous in their communication were simple heuristics, and were evaluated using the number of communication rounds or updates required for convergence, rather than the wall-clock time in practice.

Read more →