Testcase config "verify" triggers must be defined in the reverse order of the linelog messages

[marc-casavant]

Testcase config "verify" triggers must be defined in the reverse order of linelog messages to help the framework properly analyze the expected linelog messages of a run. If the trigger order is not defined in the reverse order of the messages found in the linelog file, not messages will be matched.

freeradius-server branch:

Example of linelog messages of a passing test:

loadgen-recv-status-server - INFO - reply.FreeRADIUS.Stats4.Packet-Counters.Status-Server: 0
loadgen-recv-status-server - INFO - reply.FreeRADIUS.Stats4.Packet-Counters.Access-Request: 41
loadgen-recv-status-server - INFO - reply.FreeRADIUS.Stats4.Packet-Counters.Access-Accept: 41
loadgen-recv-status-server - INFO - reply.FreeRADIUS.Stats4.Packet-Counters.Access-Reject: 0
loadgen-recv-status-server - INFO - 41 requests processed successfully, reply.FreeRADIUS.Stats4.Packet-Counters.Access-Request = 41, reply.FreeRADIUS.Stats4.Packet-Counters.Access-Accept = 41, reply.FreeRADIUS.Stats4.Packet-Counters.Status-Server =

Example of working testcase "verify" trigger order:

verify:
timeout: 5
trigger_mode: unordered
triggers:
- loadgen-recv-status-server:
pattern:
reg_pattern: '- INFO - (\d+) requests processed successfully,'
- loadgen-recv-status-server:
may_pattern:
reg_pattern: '- INFO - reply.FreeRADIUS.Stats4.Packet-Counters.Access-Reject: 0'
- loadgen-recv-status-server:
may_pattern:
reg_pattern: '- INFO - reply.FreeRADIUS.Stats4.Packet-Counters.Access-Accept: (\d+)'
- loadgen-recv-status-server:
may_pattern:
reg_pattern: '- INFO - reply.FreeRADIUS.Stats4.Packet-Counters.Access-Request: (\d+)'
- loadgen-recv-status-server:
may_pattern:
reg_pattern: '- INFO - reply.FreeRADIUS.Stats4.Packet-Counters.Status-Server:'

Test:

testcase: https://github.com/marc-casavant/freeradius-server/tree/multi-server-tests/src/tests/multi-server/test-5hs-autoaccept.yml

freeradius-multi-server % DATA_PATH=$HOME/sandbox/freeradius-server/src/tests/multi-server/environments/configs make test-framework -- -x -vvvv --compose $HOME/sandbox/freeradius-server/src/tests/multi-server/environments/docker-compose/env-loadgen-5hs.yml --test $HOME/sandbox/freeradius-server/src/tests/multi-server/test-5hs-autoaccept.yml --use-files --listener-dir $HOME/freeradius-listener-logs