[GH-ISSUE #3422] [FEATURE] Options for using pigz for faster backups in command_backup.sh #2330

New issue

Open

opened 2026-02-27 03:02:18 +03:00 by kerem · 2 comments

kerem commented

2026-02-27 03:02:18 +03:00

Owner

Originally created by @drphlux on GitHub (Apr 6, 2021).
Original GitHub issue: https://github.com/GameServerManagers/LinuxGSM/issues/3422

Feature request copied from "Discussions"

Hello.
Pigz compresses using threads to make use of multiple processors and cores.

tar --use-compress-program=pigz
tar cf - paths-to-archive | pigz -9 -p 32 > archive.tar.gz

This could possibly benefit more users, speeding up the backup process.
Maybe even enable options for describing how many cores to use? If you still want to use only one cpu core for example.

Here are some examples from my server.

Regular backup using one core with gzip:

vhserver@valheim:~$ ./vhserver backup
[  OK  ] Backing up vhserver: Backup starting
* Previous backup was created less than 1 day ago, total size 813M
[  OK  ] Backing up vhserver: Completed: vhserver-2021-03-04-114952.tar.gz, total size 813M
* Total compression time: 44.19 seconds with 105% CPU usage

Using eight cores with pigz:

vhserver@valheim:~$ ./vhserver backup
[  OK  ] Backing up vhserver: Backup starting
* Previous backup was created less than 1 day ago, total size 813M
[  OK  ] Backing up vhserver: Completed: vhserver-2021-03-04-115622.tar.gz, total size 812M
* Total compression time: 8.86 seconds with 793% CPU usage

Bonus - using all eight cores with zstd (zstdmt):

vhserver@valheim:~$ ./vhserver backup
[  OK  ] Backing up vhserver: Backup starting
* Previous backup was created less than 1 day ago, total size 798M
[  OK  ] Backing up vhserver: Completed: vhserver-2021-03-04-124623.tar.zst, total size 798M
* Total compression time: 2.08 seconds with 406% CPU usage

The actual code:

compression_time=`/usr/bin/time -f "* Total compression time: %e seconds with %P CPU usage" \
                tar -I zstdmt -cf "${backupdir}/${backupname}.tar.zst" \
                -C "${rootdir}" --exclude "${excludedir}" --exclude "${lockdir}/backup.lock" ./. \
                2>&1 > /dev/null`

Originally created by @drphlux on GitHub (Apr 6, 2021). Original GitHub issue: https://github.com/GameServerManagers/LinuxGSM/issues/3422 * Feature request copied from "Discussions" Hello. Pigz compresses using threads to make use of multiple processors and cores. ``` tar --use-compress-program=pigz tar cf - paths-to-archive | pigz -9 -p 32 > archive.tar.gz ``` This could possibly benefit more users, speeding up the backup process. Maybe even enable options for describing how many cores to use? If you still want to use only one cpu core for example. Here are some examples from my server. Regular backup using one core with gzip: ``` vhserver@valheim:~$ ./vhserver backup [ OK ] Backing up vhserver: Backup starting * Previous backup was created less than 1 day ago, total size 813M [ OK ] Backing up vhserver: Completed: vhserver-2021-03-04-114952.tar.gz, total size 813M * Total compression time: 44.19 seconds with 105% CPU usage ``` Using eight cores with pigz: ``` vhserver@valheim:~$ ./vhserver backup [ OK ] Backing up vhserver: Backup starting * Previous backup was created less than 1 day ago, total size 813M [ OK ] Backing up vhserver: Completed: vhserver-2021-03-04-115622.tar.gz, total size 812M * Total compression time: 8.86 seconds with 793% CPU usage ``` Bonus - using all eight cores with zstd (zstdmt): ``` vhserver@valheim:~$ ./vhserver backup [ OK ] Backing up vhserver: Backup starting * Previous backup was created less than 1 day ago, total size 798M [ OK ] Backing up vhserver: Completed: vhserver-2021-03-04-124623.tar.zst, total size 798M * Total compression time: 2.08 seconds with 406% CPU usage ``` The actual code: ``` compression_time=`/usr/bin/time -f "* Total compression time: %e seconds with %P CPU usage" \ tar -I zstdmt -cf "${backupdir}/${backupname}.tar.zst" \ -C "${rootdir}" --exclude "${excludedir}" --exclude "${lockdir}/backup.lock" ./. \ 2>&1 > /dev/null` ```

kerem added the

type: feature

command: backup

game: Valheim

labels

2026-02-27 03:02:18 +03:00

kerem commented

2026-02-27 03:02:18 +03:00

Author

Owner

@whytf commented on GitHub (Dec 16, 2021):

Very useful feature +1

@whytf commented on GitHub (Dec 16, 2021): Very useful feature +1

kerem commented

2026-02-27 03:02:18 +03:00

Author

Owner

@dgibbs64 commented on GitHub (Jun 27, 2025):

Pigz was added a while ago now. however, I have also added zstd. Backup will now use zstd then pigs and gz depending on dependency availability.

@dgibbs64 commented on GitHub (Jun 27, 2025): Pigz was added a while ago now. however, I have also added zstd. Backup will now use zstd then pigs and gz depending on dependency availability.

kerem referenced this issue

2026-02-27 03:55:17 +03:00

[PR #2426] [MERGED] Add mono checking for Unturned #3646