[GH-ISSUE #2617] matrix cli parameter can't parse matrix values that have colons within #1188

New issue

Closed

opened 2026-03-01 21:49:32 +03:00 by kerem · 4 comments

kerem commented 2026-03-01 21:49:32 +03:00

Owner

Copy link

Originally created by @Fryguy on GitHub (Jan 14, 2025).
Original GitHub issue: https://github.com/nektos/act/issues/2617

Bug report info

act version:            0.2.71
GOOS:                   darwin
GOARCH:                 arm64
NumCPU:                 10
Docker host:            DOCKER_HOST environment variable is not set
Sockets found:
	/var/run/docker.sock
Config files:
	/Users/jfrey/.actrc:
		-P ubuntu-latest=catthehacker/ubuntu:act-latest
		-P ubuntu-22.04=catthehacker/ubuntu:act-22.04
		-P ubuntu-20.04=catthehacker/ubuntu:act-20.04
		-P ubuntu-18.04=catthehacker/ubuntu:act-18.04
Build info:
	Go version:            go1.23.4
	Module path:           command-line-arguments
	Main version:
	Main path:
	Main checksum:
	Build settings:
		-buildmode:           exe
		-compiler:            gc
		-ldflags:             -X main.version=0.2.71
		CGO_ENABLED:          1
		CGO_CFLAGS:
		CGO_CPPFLAGS:
		CGO_CXXFLAGS:
		CGO_LDFLAGS:
		GOARCH:               arm64
		GOOS:                 darwin
		GOARM64:              v8.0
Docker Engine:
	Engine version:        5.2.1
	Engine runtime:        crun
	Cgroup version:        2
	Cgroup driver:         systemd
	Storage driver:        overlay
	Registry URI:
	OS:                    fedora
	OS type:               linux
	OS version:            40
	OS arch:               arm64
	OS kernel:             6.9.11-200.fc40.aarch64
	OS CPU:                8
	OS memory:             11094 MB
	Security options:
		name=seccomp,profile=default
		name=selinux

Command used with act

act --job ci --matrix 3.1:18:spec\:jest --container-architecture linux/amd64

Describe issue

Our matrix is defined a below. However, because : is the separator character on the command line for the --matrix and some of our matrix entries also use :, I can't specify the test-suite component. I was expecting a way to escape the : or have a different separator character, but I can't seem to find one.

I tried running with both --matrix 3.1:18:spec\:jest and --matrix 3.1:18:spec:jest, but neither work. I expect it to run the test suite specified, and then if it can't find it I expect it to fail saying it can't find that matrix entry. Instead, interestingly, act seems to run a random test suite, but sets up a service for every matrix entry anyway. So I have 14 services, but only one test-suite running which isn't the one I requested. Running multiple times seems to choose different test suites. Perhaps, it is running all of the suites, but since the services all bind to the same port only the first one "wins" - I do see an error at the very end that it can't bind to the service port.

Link to GitHub repository

https://github.com/ManageIQ/manageiq-ui-classic

Workflow content

---
name: CI
on:
  push:
  pull_request:
  workflow_dispatch:
  schedule:
  - cron: 0 0 * * *
jobs:
  ci:
    runs-on: ubuntu-latest
    strategy:
      matrix:
        ruby-version:
        - '3.1'
        - '3.3'
        node-version:
        - 18
        test-suite:
        - spec
        - spec:compile
        - spec:debride
        - spec:javascript
        - spec:jest
        - spec:routes
        - spec:security
    services:
      postgres:
        image: manageiq/postgresql:13
        env:
          POSTGRESQL_USER: root
          POSTGRESQL_PASSWORD: smartvm
          POSTGRESQL_DATABASE: vmdb_test
        options: "--health-cmd pg_isready --health-interval 2s --health-timeout 5s
          --health-retries 5"
        ports:
        - 5432:5432
    env:
      TEST_SUITE: "${{ matrix.test-suite }}"
      PGHOST: localhost
      PGPASSWORD: smartvm
      CC_TEST_REPORTER_ID: "${{ secrets.CC_TEST_REPORTER_ID }}"
    steps:
    - uses: actions/checkout@v4
    - name: Set up system
      run: bin/before_install
    - name: Set up Ruby
      uses: ruby/setup-ruby@v1
      with:
        ruby-version: "${{ matrix.ruby-version }}"
        bundler-cache: true
      timeout-minutes: 30
    - name: Set up Node
      if: "${{ matrix.test-suite == 'spec:compile' || matrix.test-suite == 'spec:javascript'
        || matrix.test-suite == 'spec:jest' }}"
      uses: actions/setup-node@v4
      with:
        node-version: "${{ matrix.node-version }}"
        cache: yarn
        registry-url: https://npm.manageiq.org/
    - name: Prepare tests
      run: bin/setup
    - name: Run tests
      run: bundle exec rake
    - name: Report code coverage
      if: ${{ github.ref == 'refs/heads/master' && matrix.ruby-version == '3.3' && matrix.test-suite == 'spec' }}
      continue-on-error: true
      uses: paambaati/codeclimate-action@v5

Relevant log output

Expecting spec:jest to run but instead it chooses a random one to run:

[CI/ci-4 ] 🧪  Matrix: map[node-version:18 ruby-version:3.1 test-suite:spec:javascript]
[CI/ci-4 ] ⭐ Run Main actions/checkout@v4

Additional information

No response

Originally created by @Fryguy on GitHub (Jan 14, 2025). Original GitHub issue: https://github.com/nektos/act/issues/2617 ### Bug report info ```plain text act version: 0.2.71 GOOS: darwin GOARCH: arm64 NumCPU: 10 Docker host: DOCKER_HOST environment variable is not set Sockets found: /var/run/docker.sock Config files: /Users/jfrey/.actrc: -P ubuntu-latest=catthehacker/ubuntu:act-latest -P ubuntu-22.04=catthehacker/ubuntu:act-22.04 -P ubuntu-20.04=catthehacker/ubuntu:act-20.04 -P ubuntu-18.04=catthehacker/ubuntu:act-18.04 Build info: Go version: go1.23.4 Module path: command-line-arguments Main version: Main path: Main checksum: Build settings: -buildmode: exe -compiler: gc -ldflags: -X main.version=0.2.71 CGO_ENABLED: 1 CGO_CFLAGS: CGO_CPPFLAGS: CGO_CXXFLAGS: CGO_LDFLAGS: GOARCH: arm64 GOOS: darwin GOARM64: v8.0 Docker Engine: Engine version: 5.2.1 Engine runtime: crun Cgroup version: 2 Cgroup driver: systemd Storage driver: overlay Registry URI: OS: fedora OS type: linux OS version: 40 OS arch: arm64 OS kernel: 6.9.11-200.fc40.aarch64 OS CPU: 8 OS memory: 11094 MB Security options: name=seccomp,profile=default name=selinux ``` ### Command used with act ```sh act --job ci --matrix 3.1:18:spec\:jest --container-architecture linux/amd64 ``` ### Describe issue Our matrix is defined a below. However, because `:` is the separator character on the command line for the `--matrix` and some of our matrix entries _also_ use `:`, I can't specify the test-suite component. I was expecting a way to escape the `:` or have a different separator character, but I can't seem to find one. I tried running with both `--matrix 3.1:18:spec\:jest` and `--matrix 3.1:18:spec:jest`, but neither work. I expect it to run the test suite specified, and then if it can't find it I expect it to fail saying it can't find that matrix entry. Instead, interestingly, act seems to run a random test suite, but sets up a service for every matrix entry anyway. So I have 14 services, but only one test-suite running which isn't the one I requested. Running multiple times seems to choose different test suites. Perhaps, it is running all of the suites, but since the services all bind to the same port only the first one "wins" - I do see an error at the very end that it can't bind to the service port. ### Link to GitHub repository https://github.com/ManageIQ/manageiq-ui-classic ### Workflow content ```yml --- name: CI on: push: pull_request: workflow_dispatch: schedule: - cron: 0 0 * * * jobs: ci: runs-on: ubuntu-latest strategy: matrix: ruby-version: - '3.1' - '3.3' node-version: - 18 test-suite: - spec - spec:compile - spec:debride - spec:javascript - spec:jest - spec:routes - spec:security services: postgres: image: manageiq/postgresql:13 env: POSTGRESQL_USER: root POSTGRESQL_PASSWORD: smartvm POSTGRESQL_DATABASE: vmdb_test options: "--health-cmd pg_isready --health-interval 2s --health-timeout 5s --health-retries 5" ports: - 5432:5432 env: TEST_SUITE: "${{ matrix.test-suite }}" PGHOST: localhost PGPASSWORD: smartvm CC_TEST_REPORTER_ID: "${{ secrets.CC_TEST_REPORTER_ID }}" steps: - uses: actions/checkout@v4 - name: Set up system run: bin/before_install - name: Set up Ruby uses: ruby/setup-ruby@v1 with: ruby-version: "${{ matrix.ruby-version }}" bundler-cache: true timeout-minutes: 30 - name: Set up Node if: "${{ matrix.test-suite == 'spec:compile' || matrix.test-suite == 'spec:javascript' || matrix.test-suite == 'spec:jest' }}" uses: actions/setup-node@v4 with: node-version: "${{ matrix.node-version }}" cache: yarn registry-url: https://npm.manageiq.org/ - name: Prepare tests run: bin/setup - name: Run tests run: bundle exec rake - name: Report code coverage if: ${{ github.ref == 'refs/heads/master' && matrix.ruby-version == '3.3' && matrix.test-suite == 'spec' }} continue-on-error: true uses: paambaati/codeclimate-action@v5 ``` ### Relevant log output ```sh Expecting spec:jest to run but instead it chooses a random one to run: [CI/ci-4 ] 🧪 Matrix: map[node-version:18 ruby-version:3.1 test-suite:spec:javascript] [CI/ci-4 ] ⭐ Run Main actions/checkout@v4 ``` ### Additional information _No response_

kerem 2026-03-01 21:49:32 +03:00

• closed this issue
• added the
  kind/bug
  label

kerem commented 2026-03-01 21:49:33 +03:00

Author

Owner

Copy link

@Andy4495 commented on GitHub (Jan 14, 2025):

I don't think you are specifying the matrix correctly on the command line. I didn't test your workflow, but I checked one of mine with a colon and it worked.

I think the matrix option you want to run is this:

--matrix ruby-version:'3.1' test-suite:spec:jest

(I don't think you need to specify node-version, since there is only one choice in your matrix.)

Also, you can run it with the verbose option --verbose to see how act is evaluating the matrix parameters.

<!-- gh-comment-id:2591121957 --> @Andy4495 commented on GitHub (Jan 14, 2025): I don't think you are specifying the matrix correctly on the command line. I didn't test your workflow, but I checked one of mine with a colon and it worked. I think the matrix option you want to run is this: ```shell --matrix ruby-version:'3.1' test-suite:spec:jest ``` (I don't think you need to specify `node-version`, since there is only one choice in your matrix.) Also, you can run it with the verbose option `--verbose` to see how act is evaluating the matrix parameters.

kerem commented 2026-03-01 21:49:33 +03:00

Author

Owner

Copy link

@Fryguy commented on GitHub (Jan 14, 2025):

Ah now I understand - I misunderstood how the matrix parameter works and didn't realize you pass key/value pairs. That being said, the version you specified didn't work and I can't figure out the combo. I can't pass it with spaces between the values, because then it interprets the second value as a filter and I get

DEBU[0000] Evaluated matrix inclusions: map[ruby-version:map[3.1:true]]
...
DEBU[0000] Using first passed in arguments event for filtering: test-suite:spec:jest
DEBU[0000] Preparing plan with a job: ci
DEBU[0000] Using first passed in arguments event: test-suite:spec:jest

with quotes it seems to parse it incorrectly:

--matrix "ruby-version:3.1 node-version:18 test-suite:spec:jest"

DEBU[0000] Job Matrices: [map[node-version:18 ruby-version:3.1 test-suite:spec] map[node-version:18 ruby-version:3.3 test-suite:spec] map[node-version:18 ruby-version:3.1 test-suite:spec:compile] map[node-version:18 ruby-version:3.3 test-suite:spec:compile] map[node-version:18 ruby-version:3.1 test-suite:spec:debride] map[node-version:18 ruby-version:3.3 test-suite:spec:debride] map[node-version:18 ruby-version:3.1 test-suite:spec:javascript] map[node-version:18 ruby-version:3.3 test-suite:spec:javascript] map[node-version:18 ruby-version:3.1 test-suite:spec:jest] map[node-version:18 ruby-version:3.3 test-suite:spec:jest] map[node-version:18 ruby-version:3.1 test-suite:spec:routes] map[node-version:18 ruby-version:3.3 test-suite:spec:routes] map[node-version:18 ruby-version:3.1 test-suite:spec:security] map[node-version:18 ruby-version:3.3 test-suite:spec:security]]
DEBU[0000] Runner Matrices: map[ruby-version:map[3.1 node-version:18 test-suite:spec:jest:true]]
DEBU[0000] Final matrix after applying user inclusions '[]'

Notice that it seems to take the ruby-version: part as the key and the 3.1 node-version:18 test-suite:spec:jest as the value.

<!-- gh-comment-id:2591167142 --> @Fryguy commented on GitHub (Jan 14, 2025): Ah now I understand - I misunderstood how the matrix parameter works and didn't realize you pass key/value pairs. That being said, the version you specified didn't work and I can't figure out the combo. I can't pass it with spaces between the values, because then it interprets the second value as a filter and I get ``` DEBU[0000] Evaluated matrix inclusions: map[ruby-version:map[3.1:true]] ... DEBU[0000] Using first passed in arguments event for filtering: test-suite:spec:jest DEBU[0000] Preparing plan with a job: ci DEBU[0000] Using first passed in arguments event: test-suite:spec:jest ``` with quotes it seems to parse it incorrectly: ``` --matrix "ruby-version:3.1 node-version:18 test-suite:spec:jest" DEBU[0000] Job Matrices: [map[node-version:18 ruby-version:3.1 test-suite:spec] map[node-version:18 ruby-version:3.3 test-suite:spec] map[node-version:18 ruby-version:3.1 test-suite:spec:compile] map[node-version:18 ruby-version:3.3 test-suite:spec:compile] map[node-version:18 ruby-version:3.1 test-suite:spec:debride] map[node-version:18 ruby-version:3.3 test-suite:spec:debride] map[node-version:18 ruby-version:3.1 test-suite:spec:javascript] map[node-version:18 ruby-version:3.3 test-suite:spec:javascript] map[node-version:18 ruby-version:3.1 test-suite:spec:jest] map[node-version:18 ruby-version:3.3 test-suite:spec:jest] map[node-version:18 ruby-version:3.1 test-suite:spec:routes] map[node-version:18 ruby-version:3.3 test-suite:spec:routes] map[node-version:18 ruby-version:3.1 test-suite:spec:security] map[node-version:18 ruby-version:3.3 test-suite:spec:security]] DEBU[0000] Runner Matrices: map[ruby-version:map[3.1 node-version:18 test-suite:spec:jest:true]] DEBU[0000] Final matrix after applying user inclusions '[]' ``` Notice that it seems to take the `ruby-version:` part as the key and the `3.1 node-version:18 test-suite:spec:jest` as the value.

kerem commented 2026-03-01 21:49:33 +03:00

Author

Owner

Copy link

@Fryguy commented on GitHub (Jan 14, 2025):

Oh I think I finally got it:

--matrix ruby-version:3.1 --matrix test-suite:spec:jest

DEBU[0000] Evaluated matrix inclusions: map[ruby-version:map[3.1:true] test-suite:map[spec:jest:true]]
...
DEBU[0000] Job Matrices: [map[node-version:18 ruby-version:3.1 test-suite:spec] map[node-version:18 ruby-version:3.1 test-suite:spec:compile] map[node-version:18 ruby-version:3.1 test-suite:spec:debride] map[node-version:18 ruby-version:3.1 test-suite:spec:javascript] map[node-version:18 ruby-version:3.1 test-suite:spec:jest] map[node-version:18 ruby-version:3.1 test-suite:spec:routes] map[node-version:18 ruby-version:3.1 test-suite:spec:security] map[node-version:18 ruby-version:3.3 test-suite:spec] map[node-version:18 ruby-version:3.3 test-suite:spec:compile] map[node-version:18 ruby-version:3.3 test-suite:spec:debride] map[node-version:18 ruby-version:3.3 test-suite:spec:javascript] map[node-version:18 ruby-version:3.3 test-suite:spec:jest] map[node-version:18 ruby-version:3.3 test-suite:spec:routes] map[node-version:18 ruby-version:3.3 test-suite:spec:security]]
DEBU[0000] Runner Matrices: map[ruby-version:map[3.1:true] test-suite:map[spec:jest:true]]
DEBU[0000] Final matrix after applying user inclusions '[map[node-version:18 ruby-version:3.1 test-suite:spec:jest]]'

I wasn't expecting to pass multiple single values, but it seems to work - I'm not sure how one would pass multiple inclusions this way.

<!-- gh-comment-id:2591173194 --> @Fryguy commented on GitHub (Jan 14, 2025): Oh I think I finally got it: ``` --matrix ruby-version:3.1 --matrix test-suite:spec:jest DEBU[0000] Evaluated matrix inclusions: map[ruby-version:map[3.1:true] test-suite:map[spec:jest:true]] ... DEBU[0000] Job Matrices: [map[node-version:18 ruby-version:3.1 test-suite:spec] map[node-version:18 ruby-version:3.1 test-suite:spec:compile] map[node-version:18 ruby-version:3.1 test-suite:spec:debride] map[node-version:18 ruby-version:3.1 test-suite:spec:javascript] map[node-version:18 ruby-version:3.1 test-suite:spec:jest] map[node-version:18 ruby-version:3.1 test-suite:spec:routes] map[node-version:18 ruby-version:3.1 test-suite:spec:security] map[node-version:18 ruby-version:3.3 test-suite:spec] map[node-version:18 ruby-version:3.3 test-suite:spec:compile] map[node-version:18 ruby-version:3.3 test-suite:spec:debride] map[node-version:18 ruby-version:3.3 test-suite:spec:javascript] map[node-version:18 ruby-version:3.3 test-suite:spec:jest] map[node-version:18 ruby-version:3.3 test-suite:spec:routes] map[node-version:18 ruby-version:3.3 test-suite:spec:security]] DEBU[0000] Runner Matrices: map[ruby-version:map[3.1:true] test-suite:map[spec:jest:true]] DEBU[0000] Final matrix after applying user inclusions '[map[node-version:18 ruby-version:3.1 test-suite:spec:jest]]' ``` I wasn't expecting to pass multiple single values, but it seems to work - I'm not sure how one would pass multiple inclusions this way.

kerem commented 2026-03-01 21:49:33 +03:00

Author

Owner

Copy link

@Fryguy commented on GitHub (Jan 14, 2025):

Closing this, but I might open a separate docs PR to clear up cases like this. Thanks for your help @Andy4495

<!-- gh-comment-id:2591188545 --> @Fryguy commented on GitHub (Jan 14, 2025): Closing this, but I might open a separate docs PR to clear up cases like this. Thanks for your help @Andy4495

kerem referenced this issue 2026-03-01 21:52:51 +03:00

[PR #1188] [CLOSED] Decompress gzipped artifacts before saving to file #1827

Sign in to join this conversation.

No Branch/Tag specified

Branches Tags

master

dependabot/go_modules/github.com/go-git/go-git/v5-5.18.0

dependabot/go_modules/dependencies-08815e2262

mergify/configuration-deprecated-update

dependabot/github_actions/dependencies-a3a104477f

chore/simplify-ci-and-makefile

dependabot/go_modules/golang.org/x/crypto-0.45.0

dependabot/go_modules/github.com/go-viper/mapstructure/v2-2.4.0

panekj/ci/improve-jobs

fix-skip-non-yaml-files-in-dir

normalize-pull-rebuild-flags

fix-no-recurse-by-default

2517-poor-error-for-incomplete-action-step

2472-make-use-new-action-cache-the-new-default-for-downloading-actions

act-tart

act-lxc

act-oidc

act-dind

avoid-slash-in-actor

dependabot/go_modules/github.com/docker/docker-26.1.4incompatible

meta-keep-filetime

local-repository-action-cache

pr-merger

update-docker-deps

follow_local_action_symlink

boltdb-lock-in-handler

use-socket-path

no-pull-no-rebuild

path-issues

fix/env

feat/podman

refactor/testdata

v0.2.87

v0.2.86

v0.2.85

v0.2.84

v0.2.83

v0.2.82

v0.2.81

v0.2.80

v0.2.79

v0.2.78

v0.2.77

v0.2.76

v0.2.75

v0.2.74

v0.2.73

v0.2.72

v0.2.71

v0.2.70

v0.2.69

v0.2.68

v0.2.67

v0.2.66

v0.2.65

v0.2.64

v0.2.63

v0.2.62

v0.2.61

v0.2.60

v0.2.59

v0.2.58

v0.2.57

v0.2.56

v0.2.55

v0.2.54

v0.2.53

v0.2.52

v0.2.51

v0.2.50

v0.2.49

v0.2.48

v0.2.47

v0.2.46

v0.2.45

v0.2.44

v0.2.43

v0.2.42

v0.2.41

v0.2.40

v0.2.39

v0.2.38

v0.2.37

v0.2.36

v0.2.35

v0.2.34

v0.2.33

v0.2.32

v0.2.31

v0.2.30

v0.2.29

v0.2.28

v0.2.27

v0.2.26

v0.2.25

v0.2.24

v0.2.23

v0.2.22

v0.2.21

v0.2.20

v0.2.19

v0.2.18

v0.2.17

v0.2.16

v0.2.15

v0.2.14

v0.2.13

v0.2.12

v0.2.11

v0.2.10

v0.2.9

v0.2.8

v0.2.7

v0.2.6

v0.2.5

v0.2.4

v0.2.3

v0.2.2

v0.2.1

v0.2.0

v0.1.3

v0.1.2

v0.1.1

v0.1.0

v0.0.5

v0.0.4

v0.0.3

v0.0.2

v0.0.1

Labels

Clear labels   

area/action

  

area/cli

  

area/docs

  

area/image

  

area/runner

  

area/workflow

  

backlog

  

confirmed/not-planned

  

kind/bug

  

kind/discussion

  

kind/external

  

kind/feature-request

  

kind/question

  

meta/duplicate

  

meta/invalid

  

meta/need-more-info

  

meta/resolved

  

meta/wontfix

  

meta/workaround

  

needs-work

  

pull-request

Mirrored from GitHub Pull Request

  

review/not-planned

  

size/M

  

size/XL

  

size/XXL

  

stale

  

stale-exempt

No labels

area/action

area/cli

area/docs

area/image

area/runner

area/workflow

backlog

confirmed/not-planned

kind/bug

kind/discussion

kind/external

kind/feature-request

kind/question

meta/duplicate

meta/invalid

meta/need-more-info

meta/resolved

meta/wontfix

meta/workaround

needs-work

pull-request

review/not-planned

size/M

size/XL

size/XXL

stale

stale-exempt

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

starred/act#1188

No description provided.