feat: benchmarks #450

gfyrag · 2023-07-21T10:21:31Z

wip
feat: add runID as resource attribute
feat: gracefully stop ledger container
feat: add debug
fix: container stop
feat: Add k6 script
feat: export data from prometheus
feat: update following rebase
feat: Upgrade tests with k6
fix: ledger stopping
fix: ledger stopping
feat: Update configuration
feat: Update configuration
feat: add cpuCount
feat: disable prometheus data export
feat: Update configuration
feat: Update
feat: Update
feat: add metric about locking

vercel · 2023-07-21T10:21:35Z

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
docs	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 7, 2023 1:22pm

github-actions · 2023-07-21T10:25:45Z

Run report for 60631df8

Total time: 2m 8s | Comparison time: 12m 40s | Estimated savings: 10m 32s (83.1% faster)

	Action	Time	Status
⬛️	`SetupSystemTool`	0.1ms	Skipped
⬛️	`SetupNodeTool(global)`	0.2ms	Skipped
🟩	`SyncNodeProject(openapi)`	0.2ms	Passed
⬛️	`InstallSystemDepsInProject(openapi)`	0ms	Skipped
🟩	`RunTarget(openapi:deps)`	1.7s	Passed
🟩	`RunTarget(openapi:build)`	7.5s	Passed
⬛️	`InstallSystemDepsInProject(go-libs)`	0.4ms	Skipped
🟩	`SyncSystemProject(go-libs)`	0.3ms	Passed
⬛️	`InstallSystemDepsInProject(auth)`	0ms	Skipped
⬛️	`InstallSystemDepsInProject(webhooks)`	0ms	Skipped
⬛️	`InstallSystemDepsInProject(wallets)`	0ms	Skipped
⬛️	`InstallSystemDepsInProject(gateway)`	0ms	Skipped
⬛️	`InstallSystemDepsInProject(fctl)`	0.5ms	Skipped
⬛️	`InstallSystemDepsInProject(search)`	0.4ms	Skipped
🟩	`SyncSystemProject(ledger)`	0.4ms	Passed
⬛️	`InstallSystemDepsInProject(ledger)`	0.4ms	Skipped
🟩	`RunTarget(go-libs:mod)`	3.4s	Passed
🟩	`SyncSystemProject(stargate)`	0.4ms	Passed
⬛️	`InstallSystemDepsInProject(stargate)`	0.5ms	Skipped
🟩	`RunTarget(go-libs:sync/ledger)`	681.3ms	Passed
	And 46 more...

Expanded report

	Action	Time	Status
🟩	`SyncSystemProject(loadtesting)`	669.7ms	Passed
🟩	`SyncSystemProject(operator)`	669.7ms	Passed
🟩	`SyncSystemProject(agent)`	670ms	Passed
🟩	`SyncSystemProject(payments)`	670.3ms	Passed
🟩	`SyncSystemProject(orchestration)`	669.6ms	Passed
🟩	`SyncSystemProject(auth)`	669.5ms	Passed
🟩	`SyncSystemProject(webhooks)`	0.6ms	Passed
🟩	`SyncSystemProject(wallets)`	0.8ms	Passed
🟩	`SyncSystemProject(gateway)`	0.6ms	Passed
🟩	`SyncSystemProject(fctl)`	0.5ms	Passed
🟩	`SyncSystemProject(search)`	0.3ms	Passed
⬛️	`InstallSystemDepsInProject(loadtesting)`	0ms	Skipped
⬛️	`InstallSystemDepsInProject(operator)`	0ms	Skipped
⬛️	`InstallSystemDepsInProject(agent)`	0ms	Skipped
⬛️	`InstallSystemDepsInProject(payments)`	0ms	Skipped
⬛️	`InstallSystemDepsInProject(orchestration)`	0ms	Skipped
🟩	`SyncWorkspace`	0ms	Passed
🟩	`RunTarget(operator:mod)`	4.6s	Passed
🟥	`RunTarget(ledger:build/ci)`	56.8s	Failed
🟩	`RunTarget(wallets:mod)`	591.9ms	Passed
🟩	`RunTarget(orchestration:mod)`	29.5s	Passed
🟩	`RunTarget(loadtesting:mod)`	3.3s	Passed
🟩	`RunTarget(search:mod)`	3.7s	Passed
🟩	`RunTarget(agent:lint)`	54.3s	Passed
🟩	`RunTarget(operator:lint)`	56.4s	Passed
🟩	`RunTarget(orchestration:lint)`	1m 7s	Passed
🟩	`RunTarget(payments:lint)`	1m 22s	Passed
🟩	`RunTarget(webhooks:lint)`	1m 18s	Passed
🟩	`RunTarget(auth:lint)`	1m 14s	Passed
🟩	`RunTarget(gateway:lint)`	1m 4s	Passed
🟩	`RunTarget(wallets:lint)`	21.3s	Passed
🟩	`RunTarget(search:lint)`	16.9s	Passed
🟩	`RunTarget(fctl:lint)`	45.2s	Passed
🟩	`RunTarget(ledger:lint)`	34.6s	Passed
🟩	`RunTarget(go-libs:lint)`	31.3s	Passed
🟩	`RunTarget(ledger:test)`	30.9s	Passed
🟩	`RunTarget(go-libs:sync)`	27.4s	Passed
🟩	`RunTarget(payments:mod)`	23.8s	Passed
🟩	`RunTarget(webhooks:mod)`	21s	Passed
🟩	`RunTarget(fctl:mod)`	12.8s	Passed
🟩	`RunTarget(stargate:mod)`	5.9s	Passed
🟩	`RunTarget(agent:mod)`	4.9s	Passed
🟩	`RunTarget(auth:mod)`	3.1s	Passed
🟩	`RunTarget(gateway:mod)`	7.9s	Passed
🟥	`RunTarget(ledger:mod)`	9s	Failed
🟩	`RunTarget(stargate:lint)`	9s	Passed

Touched files

README.md
components/ledger/internal/engine/command/lock.go
components/ledger/internal/engine/command/lock_test.go
components/ledger/libs/otlp/otlpmetrics/module.go
libs/go-libs/otlp/otlpmetrics/module.go
tests/benchmarks/.gitignore
tests/benchmarks/README.md
tests/benchmarks/Taskfile.yaml
tests/benchmarks/extension/extension.go
tests/benchmarks/extension/go.mod
tests/benchmarks/extension/go.sum
tests/benchmarks/scripts/.gitignore
tests/benchmarks/scripts/benchs/ledger-v2.js
tests/benchmarks/scripts/package-lock.json
tests/benchmarks/scripts/package.json
tests/benchmarks/scripts/simulates/ingestion/rate.js
tests/benchmarks/scripts/src/generators/simple.numscript
tests/benchmarks/scripts/src/generators/transactions.js
tests/benchmarks/scripts/src/options.js
tests/benchmarks/scripts/src/steps/account.js
tests/benchmarks/scripts/src/steps/aggregateBalances.js
tests/benchmarks/scripts/src/steps/balances.js
tests/benchmarks/scripts/src/steps/transactions.js
tests/benchmarks/scripts/webpack.config.js
tests/benchmarks/tools/.env
tests/benchmarks/tools/docker-compose.yml
tests/benchmarks/tools/otel-collector-config.yaml
tests/benchmarks/tools/postgresql.conf
tests/benchmarks/tools/prometheus.yaml
tests/benchmarks/tools/provisioning/dashboards/dashboards.yml
tests/benchmarks/tools/provisioning/dashboards/default/k6.json
tests/benchmarks/tools/provisioning/dashboards/default/perf.json
tests/benchmarks/tools/provisioning/dashboards/default/rps.json
tests/benchmarks/tools/provisioning/datasources/datasource.yml

github-actions · 2023-07-21T10:30:10Z

Mode async:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats    │
                │          sec/op           │   sec/op     vs base          │
ParallelWrites-2                 119.5µ ± 2%   118.8µ ± 1%  ~ (p=0.436 n=10)

                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats      │
                │      ms/transaction       │ ms/transaction  vs base          │
ParallelWrites-2                  237.0 ± 2%       235.0 ± 1%  ~ (p=0.439 n=10)

                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats    │
                │            t/s            │     t/s      vs base          │
ParallelWrites-2                 8.368k ± 2%   8.417k ± 1%  ~ (p=0.436 n=10)

                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats     │
                │           B/op            │     B/op      vs base          │
ParallelWrites-2                34.29Ki ± 0%   34.34Ki ± 0%  ~ (p=0.105 n=10)

                │ ./benchs/main-async.stats │   ./benchs/pr-async.stats    │
                │         allocs/op         │ allocs/op   vs base          │
ParallelWrites-2                  429.0 ± 0%   429.5 ± 0%  ~ (p=0.610 n=10)

github-actions · 2023-07-21T10:41:45Z

Mode sync:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats     │
                │          sec/op          │   sec/op     vs base          │
ParallelWrites-2                6.748m ± 1%   6.743m ± 1%  ~ (p=0.853 n=10)

                │ ./benchs/main-sync.stats │      ./benchs/pr-sync.stats      │
                │      ms/transaction      │ ms/transaction  vs base          │
ParallelWrites-2                11.49k ± 1%      11.46k ± 3%  ~ (p=0.954 n=10)

                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats    │
                │           t/s            │    t/s      vs base          │
ParallelWrites-2                 148.2 ± 1%   148.3 ± 1%  ~ (p=0.839 n=10)

                │ ./benchs/main-sync.stats │       ./benchs/pr-sync.stats        │
                │           B/op           │     B/op      vs base               │
ParallelWrites-2               97.68Ki ± 0%   97.93Ki ± 1%  +0.26% (p=0.002 n=10)

                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats    │
                │        allocs/op         │ allocs/op   vs base          │
ParallelWrites-2                 572.5 ± 0%   573.0 ± 0%  ~ (p=0.141 n=10)

github-actions · 2023-07-21T13:39:17Z

Mode async:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats     │
                │          sec/op           │   sec/op     vs base            │
ParallelWrites-2                 119.5µ ± 2%   118.3µ ± 1%  ~ (p=0.079 n=10+9)

                │ ./benchs/main-async.stats │      ./benchs/pr-async.stats       │
                │      ms/transaction       │ ms/transaction  vs base            │
ParallelWrites-2                  237.0 ± 2%       235.0 ± 2%  ~ (p=0.059 n=10+9)

                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats     │
                │            t/s            │     t/s      vs base            │
ParallelWrites-2                 8.368k ± 2%   8.450k ± 1%  ~ (p=0.079 n=10+9)

                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats      │
                │           B/op            │     B/op      vs base            │
ParallelWrites-2                34.29Ki ± 0%   34.25Ki ± 0%  ~ (p=0.619 n=10+9)

                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats     │
                │         allocs/op         │ allocs/op   vs base            │
ParallelWrites-2                  429.0 ± 0%   428.0 ± 0%  ~ (p=0.198 n=10+9)

github-actions · 2023-07-21T13:50:17Z

Mode sync:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats     │
                │          sec/op          │   sec/op     vs base          │
ParallelWrites-2                6.748m ± 1%   6.755m ± 1%  ~ (p=0.853 n=10)

                │ ./benchs/main-sync.stats │      ./benchs/pr-sync.stats      │
                │      ms/transaction      │ ms/transaction  vs base          │
ParallelWrites-2                11.49k ± 1%      11.48k ± 3%  ~ (p=0.853 n=10)

                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats    │
                │           t/s            │    t/s      vs base          │
ParallelWrites-2                 148.2 ± 1%   148.0 ± 1%  ~ (p=0.868 n=10)

                │ ./benchs/main-sync.stats │       ./benchs/pr-sync.stats        │
                │           B/op           │     B/op      vs base               │
ParallelWrites-2               97.68Ki ± 0%   98.12Ki ± 0%  +0.45% (p=0.009 n=10)

                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats    │
                │        allocs/op         │ allocs/op   vs base          │
ParallelWrites-2                 572.5 ± 0%   573.0 ± 0%  ~ (p=0.350 n=10)

github-actions · 2023-07-21T14:51:07Z

Mode sync:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats     │
                │          sec/op          │   sec/op     vs base          │
ParallelWrites-2                6.748m ± 1%   6.803m ± 1%  ~ (p=0.075 n=10)

                │ ./benchs/main-sync.stats │      ./benchs/pr-sync.stats      │
                │      ms/transaction      │ ms/transaction  vs base          │
ParallelWrites-2                11.49k ± 1%      11.55k ± 1%  ~ (p=0.436 n=10)

                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats    │
                │           t/s            │    t/s      vs base          │
ParallelWrites-2                 148.2 ± 1%   147.0 ± 1%  ~ (p=0.072 n=10)

                │ ./benchs/main-sync.stats │       ./benchs/pr-sync.stats        │
                │           B/op           │     B/op      vs base               │
ParallelWrites-2               97.68Ki ± 0%   98.18Ki ± 0%  +0.51% (p=0.000 n=10)

                │ ./benchs/main-sync.stats │      ./benchs/pr-sync.stats       │
                │        allocs/op         │ allocs/op   vs base               │
ParallelWrites-2                 572.5 ± 0%   573.0 ± 0%  +0.09% (p=0.033 n=10)

github-actions · 2023-07-21T14:58:52Z

Mode async:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats    │
                │          sec/op           │   sec/op     vs base          │
ParallelWrites-2                 119.5µ ± 2%   118.3µ ± 1%  ~ (p=0.165 n=10)

                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats      │
                │      ms/transaction       │ ms/transaction  vs base          │
ParallelWrites-2                  237.0 ± 2%       234.0 ± 1%  ~ (p=0.114 n=10)

                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats    │
                │            t/s            │     t/s      vs base          │
ParallelWrites-2                 8.368k ± 2%   8.454k ± 1%  ~ (p=0.165 n=10)

                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats     │
                │           B/op            │     B/op      vs base          │
ParallelWrites-2                34.29Ki ± 0%   34.26Ki ± 0%  ~ (p=0.494 n=10)

                │ ./benchs/main-async.stats │   ./benchs/pr-async.stats    │
                │         allocs/op         │ allocs/op   vs base          │
ParallelWrites-2                  429.0 ± 0%   428.5 ± 0%  ~ (p=0.210 n=10)

github-actions · 2023-07-21T15:05:49Z

Mode async:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats    │
                │          sec/op           │   sec/op     vs base          │
ParallelWrites-2                 119.5µ ± 2%   118.8µ ± 1%  ~ (p=0.739 n=10)

                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats      │
                │      ms/transaction       │ ms/transaction  vs base          │
ParallelWrites-2                  237.0 ± 2%       235.0 ± 1%  ~ (p=0.628 n=10)

                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats    │
                │            t/s            │     t/s      vs base          │
ParallelWrites-2                 8.368k ± 2%   8.421k ± 1%  ~ (p=0.725 n=10)

                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats     │
                │           B/op            │     B/op      vs base          │
ParallelWrites-2                34.29Ki ± 0%   34.29Ki ± 0%  ~ (p=0.812 n=10)

                │ ./benchs/main-async.stats │   ./benchs/pr-async.stats    │
                │         allocs/op         │ allocs/op   vs base          │
ParallelWrites-2                  429.0 ± 0%   429.0 ± 0%  ~ (p=0.574 n=10)

github-actions · 2023-07-21T15:17:29Z

Mode sync:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-sync.stats │       ./benchs/pr-sync.stats       │
                │          sec/op          │   sec/op     vs base               │
ParallelWrites-2                6.748m ± 1%   6.823m ± 1%  +1.11% (p=0.023 n=10)

                │ ./benchs/main-sync.stats │      ./benchs/pr-sync.stats      │
                │      ms/transaction      │ ms/transaction  vs base          │
ParallelWrites-2                11.49k ± 1%      11.61k ± 2%  ~ (p=0.105 n=10)

                │ ./benchs/main-sync.stats │      ./benchs/pr-sync.stats       │
                │           t/s            │    t/s      vs base               │
ParallelWrites-2                 148.2 ± 1%   146.6 ± 1%  -1.08% (p=0.020 n=10)

                │ ./benchs/main-sync.stats │       ./benchs/pr-sync.stats        │
                │           B/op           │     B/op      vs base               │
ParallelWrites-2               97.68Ki ± 0%   98.16Ki ± 0%  +0.50% (p=0.001 n=10)

                │ ./benchs/main-sync.stats │      ./benchs/pr-sync.stats       │
                │        allocs/op         │ allocs/op   vs base               │
ParallelWrites-2                 572.5 ± 0%   573.0 ± 0%  +0.09% (p=0.033 n=10)

github-actions · 2023-07-21T15:25:08Z

Mode async:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats     │
                │          sec/op           │   sec/op     vs base            │
ParallelWrites-2                 119.5µ ± 2%   119.5µ ± 1%  ~ (p=0.968 n=10+9)

                │ ./benchs/main-async.stats │      ./benchs/pr-async.stats       │
                │      ms/transaction       │ ms/transaction  vs base            │
ParallelWrites-2                  237.0 ± 2%       237.0 ± 1%  ~ (p=0.982 n=10+9)

                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats     │
                │            t/s            │     t/s      vs base            │
ParallelWrites-2                 8.368k ± 2%   8.367k ± 1%  ~ (p=0.952 n=10+9)

                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats      │
                │           B/op            │     B/op      vs base            │
ParallelWrites-2                34.29Ki ± 0%   34.30Ki ± 0%  ~ (p=0.604 n=10+9)

                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats     │
                │         allocs/op         │ allocs/op   vs base            │
ParallelWrites-2                  429.0 ± 0%   429.0 ± 0%  ~ (p=0.512 n=10+9)

github-actions · 2023-07-21T15:37:02Z

Mode sync:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats     │
                │          sec/op          │   sec/op     vs base          │
ParallelWrites-2                6.748m ± 1%   6.782m ± 1%  ~ (p=0.143 n=10)

                │ ./benchs/main-sync.stats │      ./benchs/pr-sync.stats      │
                │      ms/transaction      │ ms/transaction  vs base          │
ParallelWrites-2                11.49k ± 1%      11.53k ± 1%  ~ (p=0.481 n=10)

                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats    │
                │           t/s            │    t/s      vs base          │
ParallelWrites-2                 148.2 ± 1%   147.4 ± 1%  ~ (p=0.171 n=10)

                │ ./benchs/main-sync.stats │       ./benchs/pr-sync.stats        │
                │           B/op           │     B/op      vs base               │
ParallelWrites-2               97.68Ki ± 0%   98.17Ki ± 0%  +0.50% (p=0.000 n=10)

                │ ./benchs/main-sync.stats │      ./benchs/pr-sync.stats       │
                │        allocs/op         │ allocs/op   vs base               │
ParallelWrites-2                 572.5 ± 0%   573.0 ± 0%  +0.09% (p=0.033 n=10)

github-actions · 2023-07-21T16:59:04Z

Mode sync:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-sync.stats │       ./benchs/pr-sync.stats       │
                │          sec/op          │   sec/op     vs base               │
ParallelWrites-2                6.748m ± 1%   6.691m ± 1%  -0.85% (p=0.029 n=10)

                │ ./benchs/main-sync.stats │        ./benchs/pr-sync.stats         │
                │      ms/transaction      │ ms/transaction  vs base               │
ParallelWrites-2                11.49k ± 1%      11.37k ± 1%  -1.02% (p=0.023 n=10)

                │ ./benchs/main-sync.stats │      ./benchs/pr-sync.stats       │
                │           t/s            │    t/s      vs base               │
ParallelWrites-2                 148.2 ± 1%   149.5 ± 1%  +0.91% (p=0.022 n=10)

                │ ./benchs/main-sync.stats │       ./benchs/pr-sync.stats        │
                │           B/op           │     B/op      vs base               │
ParallelWrites-2               97.68Ki ± 0%   98.07Ki ± 0%  +0.40% (p=0.000 n=10)

                │ ./benchs/main-sync.stats │      ./benchs/pr-sync.stats       │
                │        allocs/op         │ allocs/op   vs base               │
ParallelWrites-2                 572.5 ± 0%   573.0 ± 0%  +0.09% (p=0.033 n=10)

github-actions · 2023-07-21T17:06:50Z

Mode async:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats     │
                │          sec/op           │   sec/op     vs base            │
ParallelWrites-2                 119.5µ ± 2%   118.1µ ± 2%  ~ (p=0.447 n=10+9)

                │ ./benchs/main-async.stats │      ./benchs/pr-async.stats       │
                │      ms/transaction       │ ms/transaction  vs base            │
ParallelWrites-2                  237.0 ± 2%       234.0 ± 2%  ~ (p=0.335 n=10+9)

                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats     │
                │            t/s            │     t/s      vs base            │
ParallelWrites-2                 8.368k ± 2%   8.465k ± 2%  ~ (p=0.447 n=10+9)

                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats      │
                │           B/op            │     B/op      vs base            │
ParallelWrites-2                34.29Ki ± 0%   34.29Ki ± 0%  ~ (p=0.497 n=10+9)

                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats     │
                │         allocs/op         │ allocs/op   vs base            │
ParallelWrites-2                  429.0 ± 0%   429.0 ± 0%  ~ (p=0.800 n=10+9)

github-actions · 2023-07-21T18:49:35Z

Mode sync:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats     │
                │          sec/op          │   sec/op     vs base          │
ParallelWrites-2                6.748m ± 1%   6.757m ± 2%  ~ (p=0.393 n=10)

                │ ./benchs/main-sync.stats │      ./benchs/pr-sync.stats      │
                │      ms/transaction      │ ms/transaction  vs base          │
ParallelWrites-2                11.49k ± 1%      11.52k ± 2%  ~ (p=0.382 n=10)

                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats    │
                │           t/s            │    t/s      vs base          │
ParallelWrites-2                 148.2 ± 1%   147.9 ± 2%  ~ (p=0.363 n=10)

                │ ./benchs/main-sync.stats │       ./benchs/pr-sync.stats        │
                │           B/op           │     B/op      vs base               │
ParallelWrites-2               97.68Ki ± 0%   98.10Ki ± 0%  +0.43% (p=0.000 n=10)

                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats    │
                │        allocs/op         │ allocs/op   vs base          │
ParallelWrites-2                 572.5 ± 0%   573.0 ± 0%  ~ (p=0.141 n=10)

github-actions · 2023-07-21T18:56:15Z

Mode async:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats    │
                │          sec/op           │   sec/op     vs base          │
ParallelWrites-2                 119.5µ ± 2%   118.8µ ± 2%  ~ (p=0.796 n=10)

                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats      │
                │      ms/transaction       │ ms/transaction  vs base          │
ParallelWrites-2                  237.0 ± 2%       235.5 ± 3%  ~ (p=0.697 n=10)

                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats    │
                │            t/s            │     t/s      vs base          │
ParallelWrites-2                 8.368k ± 2%   8.417k ± 2%  ~ (p=0.796 n=10)

                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats     │
                │           B/op            │     B/op      vs base          │
ParallelWrites-2                34.29Ki ± 0%   34.28Ki ± 0%  ~ (p=0.853 n=10)

                │ ./benchs/main-async.stats │   ./benchs/pr-async.stats    │
                │         allocs/op         │ allocs/op   vs base          │
ParallelWrites-2                  429.0 ± 0%   429.0 ± 0%  ~ (p=0.325 n=10)

github-actions · 2023-08-08T13:57:45Z

Mode sync:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats     │
                │          sec/op          │   sec/op     vs base          │
ParallelWrites-2                6.781m ± 1%   6.697m ± 3%  ~ (p=0.315 n=10)

                │ ./benchs/main-sync.stats │      ./benchs/pr-sync.stats      │
                │      ms/transaction      │ ms/transaction  vs base          │
ParallelWrites-2                11.52k ± 2%      11.40k ± 4%  ~ (p=0.645 n=10)

                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats    │
                │           t/s            │    t/s      vs base          │
ParallelWrites-2                 147.4 ± 1%   149.3 ± 3%  ~ (p=0.305 n=10)

                │ ./benchs/main-sync.stats │       ./benchs/pr-sync.stats        │
                │           B/op           │     B/op      vs base               │
ParallelWrites-2               98.01Ki ± 0%   97.71Ki ± 0%  -0.31% (p=0.019 n=10)

                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats    │
                │        allocs/op         │ allocs/op   vs base          │
ParallelWrites-2                 573.0 ± 0%   573.0 ± 0%  ~ (p=0.303 n=10)

github-actions · 2023-08-08T14:05:01Z

Mode async:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats     │
                │          sec/op           │   sec/op     vs base            │
ParallelWrites-2                 118.4µ ± 1%   118.8µ ± 1%  ~ (p=0.968 n=10+9)

                │ ./benchs/main-async.stats │      ./benchs/pr-async.stats       │
                │      ms/transaction       │ ms/transaction  vs base            │
ParallelWrites-2                  234.5 ± 1%       235.0 ± 1%  ~ (p=0.637 n=10+9)

                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats     │
                │            t/s            │     t/s      vs base            │
ParallelWrites-2                 8.448k ± 1%   8.421k ± 1%  ~ (p=0.968 n=10+9)

                │ ./benchs/main-async.stats │     ./benchs/pr-async.stats      │
                │           B/op            │     B/op      vs base            │
ParallelWrites-2                34.21Ki ± 0%   34.31Ki ± 0%  ~ (p=0.203 n=10+9)

                │ ./benchs/main-async.stats │    ./benchs/pr-async.stats     │
                │         allocs/op         │ allocs/op   vs base            │
ParallelWrites-2                  428.0 ± 0%   429.0 ± 0%  ~ (p=0.728 n=10+9)

github-actions · 2023-08-08T14:16:43Z

Mode sync:

goarch: amd64
pkg: github.com/formancehq/ledger/benchmarks
cpu: AMD EPYC 7R32
                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats     │
                │          sec/op          │   sec/op     vs base          │
ParallelWrites-2                6.781m ± 1%   6.803m ± 3%  ~ (p=0.579 n=10)

                │ ./benchs/main-sync.stats │      ./benchs/pr-sync.stats      │
                │      ms/transaction      │ ms/transaction  vs base          │
ParallelWrites-2                11.52k ± 2%      11.59k ± 4%  ~ (p=0.481 n=10)

                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats    │
                │           t/s            │    t/s      vs base          │
ParallelWrites-2                 147.4 ± 1%   146.9 ± 2%  ~ (p=0.564 n=10)

                │ ./benchs/main-sync.stats │     ./benchs/pr-sync.stats     │
                │           B/op           │     B/op      vs base          │
ParallelWrites-2               98.01Ki ± 0%   97.85Ki ± 0%  ~ (p=0.143 n=10)

                │ ./benchs/main-sync.stats │    ./benchs/pr-sync.stats    │
                │        allocs/op         │ allocs/op   vs base          │
ParallelWrites-2                 573.0 ± 0%   573.0 ± 0%  ~ (p=1.000 n=10)

gfyrag requested a review from a team as a code owner July 21, 2023 10:21

vercel bot deployed to Preview July 21, 2023 13:30 View deployment

github-actions bot added the components/ledger label Jul 21, 2023

vercel bot deployed to Preview July 21, 2023 14:38 View deployment

vercel bot deployed to Preview July 21, 2023 14:50 View deployment

vercel bot deployed to Preview July 21, 2023 14:52 View deployment

vercel bot deployed to Preview July 21, 2023 16:47 View deployment

vercel bot deployed to Preview July 21, 2023 18:36 View deployment

flemzord force-pushed the feat/benchmarks branch from 04968c1 to 5c6e197 Compare August 8, 2023 13:44

vercel bot deployed to Preview August 8, 2023 13:45 View deployment

vercel bot deployed to Preview August 8, 2023 13:52 View deployment

gfyrag and others added 24 commits November 6, 2023 12:32

fix: ledger stopping

1c3e1a7

feat: Update configuration

93ae31f

feat: Update configuration

678a153

feat: add cpuCount

ba698d6

feat: disable prometheus data export

80cb777

feat: Update configuration

c549908

feat: Update

d4db1aa

feat: Update

5ab397c

feat: add metric about locking

595daa2

fix: metrics frequency

0c68396

feat: Upate configuration

3659d40

feat: Upate configuration

9a42398

fix: db lifecycle

5b42110

feat: add auto explain on postgres

4ce78da

chore: Add bench

f0ee93c

chore: Update benchmarks

a0b62b7

chore: upgrade k6 & add README.md

9e33c11

chore: Nmscript ugprade

c355de5

feat: Add dashboard provisionning

b46539d

feat: Add dashboard provisionning

556005d

feat: not drop postgres container between each test

f14a9f1

feat: add postgres config

cfd3965

feat: some optimization

c996750

feat: clean

69536ca

gfyrag force-pushed the feat/benchmarks branch from 37b0c51 to 69536ca Compare November 6, 2023 11:32

vercel bot deployed to Preview November 6, 2023 11:34 View deployment

chore: fix all lint

23fc59a

vercel bot deployed to Preview November 7, 2023 13:22 View deployment

flemzord merged commit e0bd558 into main Nov 7, 2023
8 checks passed

flemzord deleted the feat/benchmarks branch November 7, 2023 14:11

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: benchmarks #450

feat: benchmarks #450

gfyrag commented Jul 21, 2023

vercel bot commented Jul 21, 2023 •

edited

Loading

github-actions bot commented Jul 21, 2023 •

edited

Loading

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Aug 8, 2023

github-actions bot commented Aug 8, 2023

github-actions bot commented Aug 8, 2023

feat: benchmarks #450

feat: benchmarks #450

Conversation

gfyrag commented Jul 21, 2023

vercel bot commented Jul 21, 2023 • edited Loading

github-actions bot commented Jul 21, 2023 • edited Loading

Run report for 60631df8

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Jul 21, 2023

github-actions bot commented Aug 8, 2023

github-actions bot commented Aug 8, 2023

github-actions bot commented Aug 8, 2023

vercel bot commented Jul 21, 2023 •

edited

Loading

github-actions bot commented Jul 21, 2023 •

edited

Loading