AE-2348 : Design Issue: AMP disk usage increases continuously during snapshot imports & exports, as older data is not cleaned up automatically and no manual cleanup option is available

Review Request #1320 — Created Jan. 20, 2026 and submitted Jan. 20, 2026, 3:08 p.m.

Information
Owner:	pmurugaiyan
Repository:	AMP
Branch:	amp_3_7_2
Bugs:	AE-2348
Depends On:
Reviewers
Groups:
People:	apoorva.sn, pradeep, shuinvy

Description

Export

AMP#ls -ltrh /var/backups/es_snapshots/
total 20K
drwxr-xr-x 3 elasticsearch elasticsearch 36 Jan 20 12:16 indices
-rw-r--r-- 1 elasticsearch elasticsearch 217 Jan 20 12:16 meta-86Jx3f2jTjq6_t_iaV34Ig.dat
-rw-r--r-- 1 elasticsearch elasticsearch 278 Jan 20 12:16 snap-86Jx3f2jTjq6_t_iaV34Ig.dat
-rw-r--r-- 1 elasticsearch elasticsearch 270 Jan 20 12:16 index-1
-rw-r--r-- 1 elasticsearch elasticsearch 196 Jan 20 12:16 index-2
-rw-r--r-- 1 elasticsearch elasticsearch 8 Jan 20 12:16 index.latest
AMP#

AMP#ls -la /var/backups/es_snapshots/
total 20
drwxrwxr-x 3 elasticsearch elasticsearch 149 Jan 20 12:29 .
drwxr-xr-x 3 root root 26 Dec 2 16:12 ..
-rw-r--r-- 1 elasticsearch elasticsearch 295 Jan 20 12:19 index-3
-rw-r--r-- 1 elasticsearch elasticsearch 196 Jan 20 12:19 index-4
-rw-r--r-- 1 elasticsearch elasticsearch 8 Jan 20 12:19 index.latest
drwxrwxr-x 3 elasticsearch elasticsearch 36 Jan 20 12:16 indices
-rw-r--r-- 1 elasticsearch elasticsearch 217 Jan 20 12:19 meta-Bl9bRKNzThuniyZBB7jSFw.dat
-rw-r--r-- 1 elasticsearch elasticsearch 278 Jan 20 12:19 snap-Bl9bRKNzThuniyZBB7jSFw.dat
AMP#

Import

AMP#ls -ltrh /var/backups/es_snapshots/
total 20K
drwxrwxr-x 3 elasticsearch elasticsearch 36 Jan 20 12:16 indices
drwxr-xr-x 3 elasticsearch elasticsearch 149 Jan 20 12:19 import_20260120_122127
-rw-r--r-- 1 elasticsearch elasticsearch 217 Jan 20 12:19 meta-Bl9bRKNzThuniyZBB7jSFw.dat
-rw-r--r-- 1 elasticsearch elasticsearch 278 Jan 20 12:19 snap-Bl9bRKNzThuniyZBB7jSFw.dat
-rw-r--r-- 1 elasticsearch elasticsearch 295 Jan 20 12:19 index-3
-rw-r--r-- 1 elasticsearch elasticsearch 196 Jan 20 12:19 index-4
-rw-r--r-- 1 elasticsearch elasticsearch 8 Jan 20 12:19 index.latest

Failed & In-Progress Imports

AMP#ls -ltrh /var/backups/es_snapshots/
total 20K
drwxrwxr-x 3 elasticsearch elasticsearch 36 Jan 20 12:16 indices
drwxr-xr-x 3 elasticsearch elasticsearch 149 Jan 20 12:19 import_20260120_122229
-rw-r--r-- 1 elasticsearch elasticsearch 217 Jan 20 12:19 meta-Bl9bRKNzThuniyZBB7jSFw.dat
-rw-r--r-- 1 elasticsearch elasticsearch 278 Jan 20 12:19 snap-Bl9bRKNzThuniyZBB7jSFw.dat
-rw-r--r-- 1 elasticsearch elasticsearch 295 Jan 20 12:19 index-3
-rw-r--r-- 1 elasticsearch elasticsearch 196 Jan 20 12:19 index-4
-rw-r--r-- 1 elasticsearch elasticsearch 8 Jan 20 12:19 index.latest
drwxr-xr-x 3 elasticsearch elasticsearch 149 Jan 20 12:21 import_20260120_122127
AMP#

After Successful Import (Failed and Current files has been cleaned up)

AMP#curl -s http://localhost:9200/_cat/indices?v

health status index uuid pri rep docs.count docs.deleted store.size pri.store.size
green open acm_new_20260120_122840_syslog-2026.01.20 QH3g_f4VRXGftvqDmx7SzQ 1 0 322 0 50.3kb 50.3kb
green open .kibana_task_manager_1 1_-NwnfZSMeA2u0a2J3c-A 1 0 2 1 17.3kb 17.3kb
green open .apm-agent-configuration yaZsjOjJSzu84tmOzR6p_Q 1 0 0 0 283b 283b
green open acm_syslog-2026.01.20 pucnU_FgT5C9lXUUtmXjNg 1 0 1273 0 241.3kb 241.3kb
green open .kibana_1 bnr5qCzfSoi5Y9wyRMAChw 1 0 72 4 70.1kb 70.1kb
green open acm_new_20260120_121719_syslog-2026.01.20 xvgUmfPzQgKqaQ3N4uF5xA 1 0 117 0 61.5kb 61.5kb
AMP#

Testing Done

The changes has been tested locally.

Ship it!

```
Ship It!
```

You have a pending review.

Review Board 5.0.5

AE-2348 : Design Issue: AMP disk usage increases continuously during snapshot imports & exports, as older data is not cleaned up automatically and no manual cleanup option is available

Status: Closed (submitted)