# Continual Learning and Private Unlearning
Source: https://savrn.com/papers/continual-learning-and-private-unlearning
Markdown alternate of the page above; the site index is https://savrn.com/llms.txt

---

## Abstract

As intelligent agents become autonomous over longer periods of time, they may eventually become lifelong counterparts to specific people. If so, it may be common for a user to want the agent to master a task temporarily but later on to forget the task due to privacy concerns. However enabling an agent to forget privately what the user specified without degrading the rest of the learned knowledge is a challenging problem. With the aim of addressing this challenge, this paper formalizes this continual learning and private unlearning (CLPU) problem. The paper further introduces a straightforward but exactly private solution, CLPU-DER++, as the first step towards solving the CLPU problem, along with a set of carefully designed benchmark problems to evaluate the effectiveness of the proposed solution. The code is available at https://github.com/Cranial-XIX/Continual-Learning-Private-Unlearning.

[Full paper on arXiv](https://arxiv.org/abs/2203.12817) · [Code](https://github.com/https://github.com/cranial-xix/continual-learning-private-unlearning)

## Details

arXiv identifier

2203.12817

Published

2022-03-24

Authors

Bo Liu, Qiang Liu, Peter Stone

## Open Models Built on This Paper

Every model in the SAVRN Model Hub whose card cites this paper, most downloaded first, with what it takes to run each one.

| Model | Task | Size | License | Monthly downloads | Cheapest setup at 16-bit |
| --- | --- | --- | --- | --- | --- |
| [Llama-3.2-1B-Instruct-TOFU-forget10-GradDiff-ILU](https://savrn.com/models/llama-3-2-1b-instruct-tofu-forget10-graddiff-ilu) Varun Sampath Kumar | [Text generation](https://savrn.com/models/tasks/text-generation) | 1.2B | llama3.2 | — | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [Llama-3.2-1B-Instruct-TOFU-forget10-GradDiff-SAM](https://savrn.com/models/llama-3-2-1b-instruct-tofu-forget10-graddiff-sam) Varun Sampath Kumar | [Text generation](https://savrn.com/models/tasks/text-generation) | 1.2B | llama3.2 | — | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [Llama-3.2-1B-Instruct-TOFU-forget10-GradDiff](https://savrn.com/models/llama-3-2-1b-instruct-tofu-forget10-graddiff) Varun Sampath Kumar | [Text generation](https://savrn.com/models/tasks/text-generation) | 1.2B | llama3.2 | — | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |

## Explore More

- [All research papers](https://savrn.com/papers)
- [The model directory](https://savrn.com/models)
- [Datasets](https://savrn.com/datasets)

## Source

- arXiv metadata, read 2026-10-15.
- [How the hub is built](https://savrn.com/model-hub/methodology)