[GH-ISSUE #3010] SteamCMD spams console and log #2146

Closed
opened 2026-02-27 03:01:08 +03:00 by kerem · 3 comments
Owner

Originally created by @DrPsychick on GitHub (Aug 29, 2020).
Original GitHub issue: https://github.com/GameServerManagers/LinuxGSM/issues/3010

User Story

As a developer/devops, I want to build docker images for gameservers so that I can automate image builds.

Basic info

  • Distro: [Ubuntu *]
  • Game: [ARK Server] (probably any steamcmd gameserver is affected)
  • Command: [Validate]
  • LinuxGSM version: [v20.4.1]

Further Information

  • When I run ./arkserver validate in my Travis pipeline, it fails as it exceeds the allowed log size.
  • When I run ./arkserver validate in my docker container, the ./logs/script/arkserver-steamcmd.log grows huge

Failure:

To Reproduce

Steps to reproduce the behaviour:

  1. ./arkserver validate (or docker run -it --rm --name test drpsychick/linuxgsm-ark:broken validate)
  2. in parallel terminal watch: ls -lah ./log/script/ (or docker exec -it test /bin/bash, then ls -lah ./logs/script/)
  3. notice the massive output on the console and how huge the logfile is and how many duplicate lines are inside

Example:

Log is already over half a GB and progress is still at 0%:

[ lgsm@124ac1bba8a2:~$ ls -lah ./log/script/*
-rw-r--r-- 1 lgsm lgsm 631M Aug 29 18:16 ./log/script/arkserver-script.log
-rw-r--r-- 1 lgsm lgsm 573M Aug 29 18:16 ./log/script/arkserver-steamcmd.log
lgsm@124ac1bba8a2:~$ tail ./log/script/*
==> ./log/script/arkserver-script.log <==
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of
==> ./log/script/arkserver-steamcmd.log <==
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...
[  0%] Downloading update (0 of 51248 KB)...

Expected behaviour

  • ./arkserver validate only logs download progress
    • steamcmd only logs when download progresses (i.e. no duplicate lines)
  • As LGSM cannot fix steamcmd, this is a workaround until Valve has fixed the issue in steamcmd
Originally created by @DrPsychick on GitHub (Aug 29, 2020). Original GitHub issue: https://github.com/GameServerManagers/LinuxGSM/issues/3010 ## User Story As a developer/devops, I want to build docker images for gameservers so that I can automate image builds. ## Basic info * **Distro:** [Ubuntu *] * **Game:** [ARK Server] (probably any `steamcmd` gameserver is affected) * **Command:** [Validate] * **LinuxGSM version:** [v20.4.1] ## Further Information * When I run `./arkserver validate` in my Travis pipeline, it fails as it exceeds the allowed log size. * When I run `./arkserver validate` in my docker container, the `./logs/script/arkserver-steamcmd.log` grows huge Failure: * https://travis-ci.com/github/DrPsychick/docker-linuxgsm-ark/builds/181904935 ## To Reproduce Steps to reproduce the behaviour: 1. `./arkserver validate` (or `docker run -it --rm --name test drpsychick/linuxgsm-ark:broken validate`) 2. in parallel terminal watch: `ls -lah ./log/script/` (or `docker exec -it test /bin/bash`, then `ls -lah ./logs/script/`) 3. notice the massive output on the console and how huge the logfile is and how many duplicate lines are inside #### Example: Log is already over half a GB and progress is still at 0%: ``` [ lgsm@124ac1bba8a2:~$ ls -lah ./log/script/* -rw-r--r-- 1 lgsm lgsm 631M Aug 29 18:16 ./log/script/arkserver-script.log -rw-r--r-- 1 lgsm lgsm 573M Aug 29 18:16 ./log/script/arkserver-steamcmd.log lgsm@124ac1bba8a2:~$ tail ./log/script/* ==> ./log/script/arkserver-script.log <== [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of ==> ./log/script/arkserver-steamcmd.log <== [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... [ 0%] Downloading update (0 of 51248 KB)... ``` ## Expected behaviour * `./arkserver validate` only logs download progress * `steamcmd` only logs when download progresses (i.e. no duplicate lines) * As LGSM cannot fix `steamcmd`, this is a workaround until Valve has fixed the issue in `steamcmd`
kerem 2026-02-27 03:01:08 +03:00
Author
Owner

@issue-label-bot[bot] commented on GitHub (Aug 29, 2020):

Issue-Label Bot is automatically applying the label type: feature request to this issue, with a confidence of 0.59. Please mark this comment with 👍 or 👎 to give our bot feedback!

Links: app homepage, dashboard and code for this bot.

<!-- gh-comment-id:683337806 --> @issue-label-bot[bot] commented on GitHub (Aug 29, 2020): Issue-Label Bot is automatically applying the label `type: feature request` to this issue, with a confidence of 0.59. Please mark this comment with :thumbsup: or :thumbsdown: to give our bot feedback! Links: [app homepage](https://github.com/marketplace/issue-label-bot), [dashboard](https://mlbot.net/data/GameServerManagers/LinuxGSM) and [code](https://github.com/hamelsmu/MLapp) for this bot.
Author
Owner

@DrPsychick commented on GitHub (Aug 29, 2020):

Suggested solution (workaround)

Pipe output of steamcmd through uniq to only print and log unique lines. It is still a lot, but works and prevents a huge log file.

See pr #3011

Success: (with a workaround that adds uniq to steamcmd in core_dl.sh)

Example (with the suggested fix):

The validate command is still slow sometimes, but duplicate lines get removed by uniq.

lgsm@c4edb9c3d2d5:~$ ls -lah ./log/script/*
-rw-r--r-- 1 lgsm lgsm 697K Aug 29 20:19 ./log/script/arkserver-script.log
-rw-r--r-- 1 lgsm lgsm  12K Aug 29 20:19 ./log/script/arkserver-steamcmd.log
lgsm@c4edb9c3d2d5:~$ tail ./log/script/*
==> ./log/script/arkserver-script.log <==
[ 24%] Downloading update (12390 of 51248 KB)...
[ 24%] Downloading update (12428 of 51248 KB)...
[ 24%] Downloading update (12433 of 51248 KB)...
[ 24%] Downloading update (12497 of 51248 KB)...
[ 24%] Downloading update (12561 of 51248 KB)...
[ 24%] Downloading update (12605 of 51248 KB)...
[ 24%] Downloading update (12669 of 51248 KB)...
[ 24%] Downloading update (12733 of 51248 KB)...
[ 24%] Downloading update (12778 of 51248 KB)...
[ 2
==> ./log/script/arkserver-steamcmd.log <==
[ 24%] Downloading update (12390 of 51248 KB)...
[ 24%] Downloading update (12428 of 51248 KB)...
[ 24%] Downloading update (12433 of 51248 KB)...
[ 24%] Downloading update (12497 of 51248 KB)...
[ 24%] Downloading update (12561 of 51248 KB)...
[ 24%] Downloading update (12605 of 51248 KB)...
[ 24%] Downloading update (12669 of 51248 KB)...
[ 24%] Downloading update (12733 of 51248 KB)...
[ 24%] Downloading update (12778 of 51248 KB)...
Travis CI enables your team to test and ship your apps with confidence. Easily sync your projects with Travis CI and you'll be testing your code in minutes.
<!-- gh-comment-id:683343167 --> @DrPsychick commented on GitHub (Aug 29, 2020): ### Suggested solution (workaround) Pipe output of `steamcmd` through `uniq` to only print and log unique lines. It is still a lot, but works and prevents a huge log file. See pr #3011 Success: (with a workaround that adds `uniq` to `steamcmd` in `core_dl.sh`) * https://travis-ci.com/github/DrPsychick/docker-linuxgsm-ark/builds/181916870 #### Example (with the suggested fix): The `validate` command is still slow sometimes, but duplicate lines get removed by `uniq`. ``` lgsm@c4edb9c3d2d5:~$ ls -lah ./log/script/* -rw-r--r-- 1 lgsm lgsm 697K Aug 29 20:19 ./log/script/arkserver-script.log -rw-r--r-- 1 lgsm lgsm 12K Aug 29 20:19 ./log/script/arkserver-steamcmd.log lgsm@c4edb9c3d2d5:~$ tail ./log/script/* ==> ./log/script/arkserver-script.log <== [ 24%] Downloading update (12390 of 51248 KB)... [ 24%] Downloading update (12428 of 51248 KB)... [ 24%] Downloading update (12433 of 51248 KB)... [ 24%] Downloading update (12497 of 51248 KB)... [ 24%] Downloading update (12561 of 51248 KB)... [ 24%] Downloading update (12605 of 51248 KB)... [ 24%] Downloading update (12669 of 51248 KB)... [ 24%] Downloading update (12733 of 51248 KB)... [ 24%] Downloading update (12778 of 51248 KB)... [ 2 ==> ./log/script/arkserver-steamcmd.log <== [ 24%] Downloading update (12390 of 51248 KB)... [ 24%] Downloading update (12428 of 51248 KB)... [ 24%] Downloading update (12433 of 51248 KB)... [ 24%] Downloading update (12497 of 51248 KB)... [ 24%] Downloading update (12561 of 51248 KB)... [ 24%] Downloading update (12605 of 51248 KB)... [ 24%] Downloading update (12669 of 51248 KB)... [ 24%] Downloading update (12733 of 51248 KB)... [ 24%] Downloading update (12778 of 51248 KB)... ``` <blockquote><div><strong><a href="https://travis-ci.com/github/DrPsychick/docker-linuxgsm-ark/jobs/379123719">Travis CI - Test and Deploy with Confidence</a></strong></div><div>Travis CI enables your team to test and ship your apps with confidence. Easily sync your projects with Travis CI and you'll be testing your code in minutes.</div></blockquote>
Author
Owner

@github-actions[bot] commented on GitHub (Sep 21, 2021):

This issue has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

<!-- gh-comment-id:923446210 --> @github-actions[bot] commented on GitHub (Sep 21, 2021): This issue has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.
Sign in to join this conversation.
No labels
Atomic
Epic
cannot reproduce
command: backup
command: console
command: debug
command: details
command: fast-dl
command: install
command: mods
command: monitor
command: post-details
command: restart
command: send
command: start
command: stop
command: update
command: update-lgsm
command: validate
command: wipe
distro: AlmaLinux
distro: Arch Linux
distro: CentOS
distro: Debian
distro: Fedora
distro: RedHat
distro: Rocky Linux
distro: Ubuntu
distro: openSUSE
engine: goldsrc
engine: source
game: 7 Days to Die
game: ARMA 3
game: Ark: Survival Evolved
game: Assetto Corsa
game: Avorion
game: BATTALION: Legacy
game: Barotrauma
game: Battalion 1944
game: Battlefield 1942
game: Black Mesa: Deathmatch
game: Blade Symphony
game: Call of Duty 2
game: Call of Duty 4
game: Call of Duty: United Offensive
game: Counter-Strike 1.6
game: Counter-Strike 2
game: Counter-Strike: Global Offensive
game: Counter-Strike: Source
game: Day of Infamy
game: Dayz
game: Death Match Classic
game: Don't Starve Together
game: ET: Legacy
game: Eco
game: Factorio
game: Factorio
game: Garry's Mod
game: Half-Life
game: Hurtword
game: Insurgecy
game: Insurgecy
game: Insurgency: Sandstorm
game: Just Cause 3
game: Killing Floor
game: Killing Floor 2
game: Left 4 Dead 2
game: Minecraft
game: Minecraft Bedrock
game: Mordhau
game: Multi Theft Auto
game: Mumble
game: Natural Selection 2
game: No More Room in Hell
game: Pavlov VR
game: Post Scriptum
game: Project Zomboid
game: Quake 3
game: QuakeWorld
game: Red Orchestra: Ostfront 41-45
game: Return to Castle Wolfenstein
game: Rising World
game: Rust
game: San Andreas Multiplayer
game: Satisfactory
game: Soldat
game: Soldier of Fortune 2
game: Squad
game: Squad 44
game: Starbound
game: Stationeers
game: Sven Co-op
game: Team Fortress 2
game: Teamspeak 3
game: Teeworlds
game: Terraria
game: The Front
game: Unreal Tournament 2004
game: Unreal Tournament 3
game: Unreal Tournament 99
game: Unturned
game: Valheim
game: Wurm Unlimited
game: Zombie Master Reborn
game: label missing
good first issue
help wanted
info: alerts
info: dependency
info: docker
info: docs
info: email
info: query
info: steamcmd
info: systemd
info: tmux
info: website
info: website
needs more info
outcome: duplicate
outcome: issue resolved
outcome: issue resolved
outcome: issue unresolved
outcome: pr accepted
outcome: pr rejected
outcome: unconfirmed
outcome: wontfix
outcome: wrong forum
potential-duplicate
priority
pull-request
type: bug
type: feature
type: feature
type: feature request
type: game server request
type: refactor
waiting response
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/LinuxGSM#2146
No description provided.