Skip to content

Commit 0721629

Browse files
fcostaoliveirapaulorsousa
fcostaoliveira
and
paulorsousa
authored
Extended MGET benchmarks to include pipeline 1/10 and data size from 100B->1KiB (redis#345)
* Extended MGET benchmarks to include pipeline 1/10 and data size from 100B->1KiB * Update redis_benchmarks_specification/test-suites/memtier_benchmark-5Mkeys-string-mget-512B-5keys-pipeline-10.yml Co-authored-by: Paulo Sousa <paulo.sousa@redis.com> * Update redis_benchmarks_specification/test-suites/memtier_benchmark-5Mkeys-string-mget-512B-5keys.yml Co-authored-by: Paulo Sousa <paulo.sousa@redis.com> * Removed unused workflow. fixed OS being use for spec validation. (redis#346) * Removed unused workflow. fixed OS being use for spec validation. * Fixed setup_tools import error * Fixed codecov flow --------- Co-authored-by: Paulo Sousa <paulo.sousa@redis.com>
1 parent 26ff4b6 commit 0721629

10 files changed

Lines changed: 350 additions & 0 deletions

‎redis_benchmarks_specification/test-suites/memtier_benchmark-5Mkeys-string-mget-100B-10keys.yml‎

Lines changed: 35 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,35 @@
1+
version: 0.4
2+
name: memtier_benchmark-5Mkeys-string-mget-100B-10keys
3+
description: Runs memtier_benchmark, for a keyspace length of 5M keys with a data
4+
size of 100 Bytes for each key.
5+
dbconfig:
6+
configuration-parameters:
7+
save: '""'
8+
check:
9+
keyspacelen: 5000000
10+
preload_tool:
11+
run_image: redislabs/memtier_benchmark:edge
12+
tool: memtier_benchmark
13+
arguments: --key-minimum 1 --data-size 100 --key-maximum 5000000 --ratio 1:0 -n allkeys --random-data --key-pattern P:P --hide-histogram -t 4 -c 50 --pipeline 50
14+
resources:
15+
requests:
16+
memory: 2g
17+
tested-commands:
18+
- mget
19+
redis-topologies:
20+
- oss-standalone
21+
build-variants:
22+
- gcc:15.2.0-amd64-debian-bookworm-default
23+
- gcc:15.2.0-arm64-debian-bookworm-default
24+
- dockerhub
25+
clientconfig:
26+
run_image: redislabs/memtier_benchmark:edge
27+
tool: memtier_benchmark
28+
arguments: --key-minimum 1 --key-maximum 5000000 --command "MGET __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__" -c 50 -t 8 --hide-histogram --test-time 120
29+
resources:
30+
requests:
31+
cpus: '8'
32+
memory: 2g
33+
tested-groups:
34+
- string
35+
priority: 1

‎redis_benchmarks_specification/test-suites/memtier_benchmark-5Mkeys-string-mget-100B-20keys.yml‎

Lines changed: 35 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,35 @@
1+
version: 0.4
2+
name: memtier_benchmark-5Mkeys-string-mget-100B-20keys
3+
description: Runs memtier_benchmark, for a keyspace length of 5M keys with a data
4+
size of 100 Bytes for each key.
5+
dbconfig:
6+
configuration-parameters:
7+
save: '""'
8+
check:
9+
keyspacelen: 5000000
10+
preload_tool:
11+
run_image: redislabs/memtier_benchmark:edge
12+
tool: memtier_benchmark
13+
arguments: --key-minimum 1 --data-size 100 --key-maximum 5000000 --ratio 1:0 -n allkeys --random-data --key-pattern P:P --hide-histogram -t 4 -c 50 --pipeline 50
14+
resources:
15+
requests:
16+
memory: 2g
17+
tested-commands:
18+
- mget
19+
redis-topologies:
20+
- oss-standalone
21+
build-variants:
22+
- gcc:15.2.0-amd64-debian-bookworm-default
23+
- gcc:15.2.0-arm64-debian-bookworm-default
24+
- dockerhub
25+
clientconfig:
26+
run_image: redislabs/memtier_benchmark:edge
27+
tool: memtier_benchmark
28+
arguments: --key-minimum 1 --key-maximum 5000000 --command "MGET __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__ __key__" -c 50 -t 8 --hide-histogram --test-time 120
29+
resources:
30+
requests:
31+
cpus: '8'
32+
memory: 2g
33+
tested-groups:
34+
- string
35+
priority: 1

‎redis_benchmarks_specification/test-suites/memtier_benchmark-5Mkeys-string-mget-100B-2keys-pipeline-10.yml‎

Lines changed: 35 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,35 @@
1+
version: 0.4
2+
name: memtier_benchmark-5Mkeys-string-mget-100B-2keys-pipeline-10
3+
description: Runs memtier_benchmark, for a keyspace length of 5M keys with a data
4+
size of 100 Bytes for each key.
5+
dbconfig:
6+
configuration-parameters:
7+
save: '""'
8+
check:
9+
keyspacelen: 5000000
10+
preload_tool:
11+
run_image: redislabs/memtier_benchmark:edge
12+
tool: memtier_benchmark
13+
arguments: --key-minimum 1 --data-size 100 --key-maximum 5000000 --ratio 1:0 -n allkeys --random-data --key-pattern P:P --hide-histogram -t 4 -c 50 --pipeline 50
14+
resources:
15+
requests:
16+
memory: 2g
17+
tested-commands:
18+
- mget
19+
redis-topologies:
20+
- oss-standalone
21+
build-variants:
22+
- gcc:15.2.0-amd64-debian-bookworm-default
23+
- gcc:15.2.0-arm64-debian-bookworm-default
24+
- dockerhub
25+
clientconfig:
26+
run_image: redislabs/memtier_benchmark:edge
27+
tool: memtier_benchmark
28+
arguments: --pipeline 10 --key-minimum 1 --key-maximum 5000000 --command "MGET __key__ __key__" -c 50 -t 8 --hide-histogram --test-time 120
29+
resources:
30+
requests:
31+
cpus: '8'
32+
memory: 2g
33+
tested-groups:
34+
- string
35+
priority: 1

‎redis_benchmarks_specification/test-suites/memtier_benchmark-5Mkeys-string-mget-100B-2keys.yml‎

Lines changed: 35 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,35 @@
1+
version: 0.4
2+
name: memtier_benchmark-5Mkeys-string-mget-100B-2keys
3+
description: Runs memtier_benchmark, for a keyspace length of 5M keys with a data
4+
size of 100 Bytes for each key.
5+
dbconfig:
6+
configuration-parameters:
7+
save: '""'
8+
check:
9+
keyspacelen: 5000000
10+
preload_tool:
11+
run_image: redislabs/memtier_benchmark:edge
12+
tool: memtier_benchmark
13+
arguments: --key-minimum 1 --data-size 100 --key-maximum 5000000 --ratio 1:0 -n allkeys --random-data --key-pattern P:P --hide-histogram -t 4 -c 50 --pipeline 50
14+
resources:
15+
requests:
16+
memory: 2g
17+
tested-commands:
18+
- mget
19+
redis-topologies:
20+
- oss-standalone
21+
build-variants:
22+
- gcc:15.2.0-amd64-debian-bookworm-default
23+
- gcc:15.2.0-arm64-debian-bookworm-default
24+
- dockerhub
25+
clientconfig:
26+
run_image: redislabs/memtier_benchmark:edge
27+
tool: memtier_benchmark
28+
arguments: --key-minimum 1 --key-maximum 5000000 --command "MGET __key__ __key__" -c 50 -t 8 --hide-histogram --test-time 120
29+
resources:
30+
requests:
31+
cpus: '8'
32+
memory: 2g
33+
tested-groups:
34+
- string
35+
priority: 1

‎redis_benchmarks_specification/test-suites/memtier_benchmark-5Mkeys-string-mget-100B-5keys-pipeline-10.yml‎

Lines changed: 35 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,35 @@
1+
version: 0.4
2+
name: memtier_benchmark-5Mkeys-string-mget-100B-5keys-pipeline-10
3+
description: Runs memtier_benchmark, for a keyspace length of 5M keys with a data
4+
size of 100 Bytes for each key.
5+
dbconfig:
6+
configuration-parameters:
7+
save: '""'
8+
check:
9+
keyspacelen: 5000000
10+
preload_tool:
11+
run_image: redislabs/memtier_benchmark:edge
12+
tool: memtier_benchmark
13+
arguments: --key-minimum 1 --data-size 100 --key-maximum 5000000 --ratio 1:0 -n allkeys --random-data --key-pattern P:P --hide-histogram -t 4 -c 50 --pipeline 50
14+
resources:
15+
requests:
16+
memory: 2g
17+
tested-commands:
18+
- mget
19+
redis-topologies:
20+
- oss-standalone
21+
build-variants:
22+
- gcc:15.2.0-amd64-debian-bookworm-default
23+
- gcc:15.2.0-arm64-debian-bookworm-default
24+
- dockerhub
25+
clientconfig:
26+
run_image: redislabs/memtier_benchmark:edge
27+
tool: memtier_benchmark
28+
arguments: --key-minimum 1 --pipeline 10 --key-maximum 5000000 --command "MGET __key__ __key__ __key__ __key__ __key__" -c 50 -t 8 --hide-histogram --test-time 120
29+
resources:
30+
requests:
31+
cpus: '8'
32+
memory: 2g
33+
tested-groups:
34+
- string
35+
priority: 1

‎redis_benchmarks_specification/test-suites/memtier_benchmark-5Mkeys-string-mget-100B-5keys.yml‎

Lines changed: 35 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,35 @@
1+
version: 0.4
2+
name: memtier_benchmark-5Mkeys-string-mget-100B-5keys
3+
description: Runs memtier_benchmark, for a keyspace length of 5M keys with a data
4+
size of 100 Bytes for each key.
5+
dbconfig:
6+
configuration-parameters:
7+
save: '""'
8+
check:
9+
keyspacelen: 5000000
10+
preload_tool:
11+
run_image: redislabs/memtier_benchmark:edge
12+
tool: memtier_benchmark
13+
arguments: --key-minimum 1 --data-size 100 --key-maximum 5000000 --ratio 1:0 -n allkeys --random-data --key-pattern P:P --hide-histogram -t 4 -c 50 --pipeline 50
14+
resources:
15+
requests:
16+
memory: 2g
17+
tested-commands:
18+
- mget
19+
redis-topologies:
20+
- oss-standalone
21+
build-variants:
22+
- gcc:15.2.0-amd64-debian-bookworm-default
23+
- gcc:15.2.0-arm64-debian-bookworm-default
24+
- dockerhub
25+
clientconfig:
26+
run_image: redislabs/memtier_benchmark:edge
27+
tool: memtier_benchmark
28+
arguments: --key-minimum 1 --key-maximum 5000000 --command "MGET __key__ __key__ __key__ __key__ __key__" -c 50 -t 8 --hide-histogram --test-time 120
29+
resources:
30+
requests:
31+
cpus: '8'
32+
memory: 2g
33+
tested-groups:
34+
- string
35+
priority: 1

‎redis_benchmarks_specification/test-suites/memtier_benchmark-5Mkeys-string-mget-1KiB-5keys-pipeline-10.yml‎

Lines changed: 35 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,35 @@
1+
version: 0.4
2+
name: memtier_benchmark-5Mkeys-string-mget-1KiB-5keys-pipeline-10
3+
description: Runs memtier_benchmark, for a keyspace length of 5M keys with a data
4+
size of 1024 Bytes for each key.
5+
dbconfig:
6+
configuration-parameters:
7+
save: '""'
8+
check:
9+
keyspacelen: 5000000
10+
preload_tool:
11+
run_image: redislabs/memtier_benchmark:edge
12+
tool: memtier_benchmark
13+
arguments: --key-minimum 1 --data-size 1024 --key-maximum 5000000 --ratio 1:0 -n allkeys --random-data --key-pattern P:P --hide-histogram -t 4 -c 50 --pipeline 50
14+
resources:
15+
requests:
16+
memory: 10g
17+
tested-commands:
18+
- mget
19+
redis-topologies:
20+
- oss-standalone
21+
build-variants:
22+
- gcc:15.2.0-amd64-debian-bookworm-default
23+
- gcc:15.2.0-arm64-debian-bookworm-default
24+
- dockerhub
25+
clientconfig:
26+
run_image: redislabs/memtier_benchmark:edge
27+
tool: memtier_benchmark
28+
arguments: --key-minimum 1 --key-maximum 5000000 --command "MGET __key__ __key__ __key__ __key__ __key__" -c 50 -t 8 --hide-histogram --test-time 120
29+
resources:
30+
requests:
31+
cpus: '8'
32+
memory: 2g
33+
tested-groups:
34+
- string
35+
priority: 1

‎redis_benchmarks_specification/test-suites/memtier_benchmark-5Mkeys-string-mget-1KiB-5keys.yml‎

Lines changed: 35 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,35 @@
1+
version: 0.4
2+
name: memtier_benchmark-5Mkeys-string-mget-1KiB-5keys
3+
description: Runs memtier_benchmark, for a keyspace length of 5M keys with a data
4+
size of 1024 Bytes for each key.
5+
dbconfig:
6+
configuration-parameters:
7+
save: '""'
8+
check:
9+
keyspacelen: 5000000
10+
preload_tool:
11+
run_image: redislabs/memtier_benchmark:edge
12+
tool: memtier_benchmark
13+
arguments: --key-minimum 1 --data-size 1024 --key-maximum 5000000 --ratio 1:0 -n allkeys --random-data --key-pattern P:P --hide-histogram -t 4 -c 50 --pipeline 50
14+
resources:
15+
requests:
16+
memory: 10g
17+
tested-commands:
18+
- mget
19+
redis-topologies:
20+
- oss-standalone
21+
build-variants:
22+
- gcc:15.2.0-amd64-debian-bookworm-default
23+
- gcc:15.2.0-arm64-debian-bookworm-default
24+
- dockerhub
25+
clientconfig:
26+
run_image: redislabs/memtier_benchmark:edge
27+
tool: memtier_benchmark
28+
arguments: --key-minimum 1 --key-maximum 5000000 --command "MGET __key__ __key__ __key__ __key__ __key__" -c 50 -t 8 --hide-histogram --test-time 120
29+
resources:
30+
requests:
31+
cpus: '8'
32+
memory: 2g
33+
tested-groups:
34+
- string
35+
priority: 1

‎redis_benchmarks_specification/test-suites/memtier_benchmark-5Mkeys-string-mget-512B-5keys-pipeline-10.yml‎

Lines changed: 35 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,35 @@
1+
version: 0.4
2+
name: memtier_benchmark-5Mkeys-string-mget-512B-5keys-pipeline-10
3+
description: Runs memtier_benchmark, for a keyspace length of 5M keys with a data
4+
size of 512 Bytes for each key.
5+
dbconfig:
6+
configuration-parameters:
7+
save: '""'
8+
check:
9+
keyspacelen: 5000000
10+
preload_tool:
11+
run_image: redislabs/memtier_benchmark:edge
12+
tool: memtier_benchmark
13+
arguments: --key-minimum 1 --data-size 512 --key-maximum 5000000 --ratio 1:0 -n allkeys --random-data --key-pattern P:P --hide-histogram -t 4 -c 50 --pipeline 50
14+
resources:
15+
requests:
16+
memory: 5g
17+
tested-commands:
18+
- mget
19+
redis-topologies:
20+
- oss-standalone
21+
build-variants:
22+
- gcc:15.2.0-amd64-debian-bookworm-default
23+
- gcc:15.2.0-arm64-debian-bookworm-default
24+
- dockerhub
25+
clientconfig:
26+
run_image: redislabs/memtier_benchmark:edge
27+
tool: memtier_benchmark
28+
arguments: --pipeline 10 --key-minimum 1 --key-maximum 5000000 --command "MGET __key__ __key__ __key__ __key__ __key__" -c 50 -t 8 --hide-histogram --test-time 120
29+
resources:
30+
requests:
31+
cpus: '8'
32+
memory: 2g
33+
tested-groups:
34+
- string
35+
priority: 1

‎redis_benchmarks_specification/test-suites/memtier_benchmark-5Mkeys-string-mget-512B-5keys.yml‎

Lines changed: 35 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,35 @@
1+
version: 0.4
2+
name: memtier_benchmark-5Mkeys-string-mget-512B-5keys
3+
description: Runs memtier_benchmark, for a keyspace length of 5M keys with a data
4+
size of 512 Bytes for each key.
5+
dbconfig:
6+
configuration-parameters:
7+
save: '""'
8+
check:
9+
keyspacelen: 5000000
10+
preload_tool:
11+
run_image: redislabs/memtier_benchmark:edge
12+
tool: memtier_benchmark
13+
arguments: --key-minimum 1 --data-size 512 --key-maximum 5000000 --ratio 1:0 -n allkeys --random-data --key-pattern P:P --hide-histogram -t 4 -c 50 --pipeline 50
14+
resources:
15+
requests:
16+
memory: 5g
17+
tested-commands:
18+
- mget
19+
redis-topologies:
20+
- oss-standalone
21+
build-variants:
22+
- gcc:15.2.0-amd64-debian-bookworm-default
23+
- gcc:15.2.0-arm64-debian-bookworm-default
24+
- dockerhub
25+
clientconfig:
26+
run_image: redislabs/memtier_benchmark:edge
27+
tool: memtier_benchmark
28+
arguments: --key-minimum 1 --key-maximum 5000000 --command "MGET __key__ __key__ __key__ __key__ __key__" -c 50 -t 8 --hide-histogram --test-time 120
29+
resources:
30+
requests:
31+
cpus: '8'
32+
memory: 2g
33+
tested-groups:
34+
- string
35+
priority: 1

0 commit comments

Comments
 (0)