Changes before error encountered

Co-authored-by: kobenguyent <7845001+kobenguyent@users.noreply.github.com>

Author: Copilot

.github/SHARDING_WORKFLOWS.md

@@ -9,16 +9,18 @@ This document explains the GitHub Actions workflows that demonstrate the new tes
 **Purpose**: Demonstrates sharding with acceptance tests across multiple browser configurations.
 
 **Key Features**:
+
 - Runs traditional docker-compose tests (for backward compatibility)
 - Adds new sharded acceptance tests using CodeceptJS directly
 - Tests across multiple browser configurations (Puppeteer, Playwright)
 - Uses 2x2 matrix: 2 configs × 2 shards = 4 parallel jobs
 
 **Example Output**:
+
 ```
 - Sharded Tests: codecept.Puppeteer.js (Shard 1/2)
 - Sharded Tests: codecept.Puppeteer.js (Shard 2/2)
-- Sharded Tests: codecept.Playwright.js (Shard 1/2)  
+- Sharded Tests: codecept.Playwright.js (Shard 1/2)
 - Sharded Tests: codecept.Playwright.js (Shard 2/2)
 ```
 
@@ -27,29 +29,32 @@ This document explains the GitHub Actions workflows that demonstrate the new tes
 **Purpose**: Comprehensive demonstration of sharding features with larger test suite.
 
 **Key Features**:
-- Uses sandbox tests (38 test files) for meaningful sharding demonstration
-- Shows basic sharding with 4-way split (`1/4`, `2/4`, `3/4`, `4/4`)
+
+- Uses sandbox tests (2 main test files) for sharding demonstration
+- Shows basic sharding with 2-way split (`1/2`, `2/2`)
 - Demonstrates combination of `--shuffle` + `--shard` options
-- Comprehensive documentation and examples
+- Uses `DONT_FAIL_ON_EMPTY_RUN=true` to handle cases where some shards may be empty
 
 ### 3. `test.yml` (Updated)
 
 **Purpose**: Clarifies which tests support sharding.
 
 **Changes**:
+
 - Added comment explaining that runner tests are mocha-based and don't support sharding
 - Points to sharding-demo.yml for examples of CodeceptJS-based sharding
 
 ## Sharding Commands Used
 
 ### Basic Sharding
+
 ```bash
-npx codeceptjs run --config ./codecept.js --shard 1/4
-npx codeceptjs run --config ./codecept.js --shard 2/4
-# etc.
+npx codeceptjs run --config ./codecept.js --shard 1/2
+npx codeceptjs run --config ./codecept.js --shard 2/2
 ```
 
 ### Combined with Other Options
+
 ```bash
 npx codeceptjs run --config ./codecept.js --shuffle --shard 1/2 --verbose
 ```
@@ -59,7 +64,7 @@ npx codeceptjs run --config ./codecept.js --shuffle --shard 1/2 --verbose
 The sharding algorithm distributes tests evenly:
 
 - **38 tests across 4 shards**: ~9-10 tests per shard
-- **6 acceptance tests across 2 shards**: 3 tests per shard  
+- **6 acceptance tests across 2 shards**: 3 tests per shard
 - **Uneven splits handled gracefully**: Earlier shards get extra tests when needed
 
 ## Benefits Demonstrated
@@ -82,9 +87,10 @@ strategy:
 ```
 
 This creates 4 parallel jobs:
+
 - Config A, Shard 1/2
-- Config A, Shard 2/2  
+- Config A, Shard 2/2
 - Config B, Shard 1/2
 - Config B, Shard 2/2
 
-Perfect for scaling test execution across multiple machines and configurations.
+Perfect for scaling test execution across multiple machines and configurations.

.github/workflows/acceptance-tests.yml

@@ -52,7 +52,7 @@ jobs:
   # New sharded acceptance tests using CodeceptJS directly
   sharded-acceptance-tests:
     runs-on: ubuntu-latest
-    name: "Sharded Tests: ${{ matrix.config }} (Shard ${{ matrix.shard }})"
+    name: 'Sharded Tests: ${{ matrix.config }} (Shard ${{ matrix.shard }})'
 
     strategy:
       fail-fast: false
@@ -64,23 +64,39 @@ jobs:
     steps:
       - name: Checkout Repository
         uses: actions/checkout@v5
-        
+
       - name: Use Node.js ${{ matrix.node-version }}
         uses: actions/setup-node@v4
         with:
           node-version: ${{ matrix.node-version }}
-          
+
+      - name: Setup PHP
+        uses: shivammathur/setup-php@v2
+        with:
+          php-version: 7.4
+
       - name: Install dependencies
         run: npm install --ignore-scripts
         env:
           PLAYWRIGHT_SKIP_BROWSER_DOWNLOAD: true
           PUPPETEER_SKIP_CHROMIUM_DOWNLOAD: true
 
+      - name: Install Puppeteer Browser
+        if: contains(matrix.config, 'Puppeteer')
+        run: npx puppeteer browsers install chrome
+
+      - name: Install Playwright Browsers
+        if: contains(matrix.config, 'Playwright')
+        run: npx playwright install chromium && npx playwright install-deps
+
+      - name: Start PHP Server
+        run: php -S 127.0.0.1:8000 -t test/data/app &
+
       - name: Run Acceptance Tests with Sharding
         run: npx codeceptjs run --config ./test/acceptance/${{ matrix.config }} --shard ${{ matrix.shard }} --verbose
         env:
           FORCE_COLOR: 1
-          
+
       - name: Display Test Info
         run: |
           echo "Configuration: ${{ matrix.config }}"

.github/workflows/sharding-demo.yml

@@ -16,45 +16,43 @@ jobs:
   # Demonstrate sharding with a larger test suite (sandbox tests)
   sharded-sandbox-tests:
     runs-on: ubuntu-latest
-    name: "Sandbox Tests (Shard ${{ matrix.shard }})"
+    name: 'Sandbox Tests (Shard ${{ matrix.shard }})'
 
     strategy:
       fail-fast: false
       matrix:
         node-version: [20.x]
-        # Split 38 sandbox tests across 4 shards for demonstration
-        shard: ['1/4', '2/4', '3/4', '4/4']
+        # Split 2 sandbox tests across 2 shards for demonstration
+        shard: ['1/2', '2/2']
 
     steps:
       - name: Checkout Repository
         uses: actions/checkout@v5
-        
+
       - name: Use Node.js ${{ matrix.node-version }}
         uses: actions/setup-node@v4
         with:
           node-version: ${{ matrix.node-version }}
-          
+
       - name: Install dependencies
         run: npm install
-        env:
-          PLAYWRIGHT_SKIP_BROWSER_DOWNLOAD: true
-          PUPPETEER_SKIP_CHROMIUM_DOWNLOAD: true
 
       - name: Run Sandbox Tests with Sharding
         run: npx codeceptjs run --config ./test/data/sandbox/codecept.js --shard ${{ matrix.shard }} --verbose
         working-directory: test/data/sandbox
         env:
           FORCE_COLOR: 1
-          
+          DONT_FAIL_ON_EMPTY_RUN: true
+
       - name: Display Shard Info
         run: |
-          echo "This shard (${{ matrix.shard }}) ran a subset of the total sandbox tests"
+          echo "This shard (${{ matrix.shard }}) ran a subset of the available test files"
           echo "All shards together cover the complete test suite without duplication"
 
   # Show combination with shuffle option
   sharded-shuffled-tests:
-    runs-on: ubuntu-latest  
-    name: "Shuffled + Sharded Tests (Shard ${{ matrix.shard }})"
+    runs-on: ubuntu-latest
+    name: 'Shuffled + Sharded Tests (Shard ${{ matrix.shard }})'
 
     strategy:
       fail-fast: false
@@ -65,25 +63,23 @@ jobs:
     steps:
       - name: Checkout Repository
         uses: actions/checkout@v5
-        
+
       - name: Use Node.js ${{ matrix.node-version }}
         uses: actions/setup-node@v4
         with:
           node-version: ${{ matrix.node-version }}
-          
+
       - name: Install dependencies
         run: npm install
-        env:
-          PLAYWRIGHT_SKIP_BROWSER_DOWNLOAD: true
-          PUPPETEER_SKIP_CHROMIUM_DOWNLOAD: true
 
       - name: Run Tests with Shuffle + Sharding
         run: npx codeceptjs run --config ./test/data/sandbox/codecept.js --shuffle --shard ${{ matrix.shard }} --verbose
         working-directory: test/data/sandbox
         env:
           FORCE_COLOR: 1
-          
+          DONT_FAIL_ON_EMPTY_RUN: true
+
       - name: Display Combined Options Info
         run: |
           echo "This demonstrates sharding combined with shuffle option"
-          echo "Tests are first shuffled, then sharded for this worker (${{ matrix.shard }})"
+          echo "Tests are first shuffled, then sharded for this worker (${{ matrix.shard }})"