Measure heap memory usage in ci-bench

[ctz]

So the plan here is:

• update the bot with the proposed changes at Track memory usage over time rustls-bench-app#38
• check that basically works
• merge this, which will generate baseline memory measurements for main
• open a PR which regresses memory usage and sanity-check the output
• merge Track memory usage over time rustls-bench-app#38

[rustls-benchmarking]

Benchmark results

Instruction counts

Significant differences

⚠️ There are significant instruction count differences

Click to expand

Scenario	Baseline	Candidate	Diff	Threshold
handshake_no_resume_aws_lc_rs_1.3_ecdsap256_aes_server	1505948	1487214	✅ -18734 (-1.24%)	0.20%
handshake_no_resume_aws_lc_rs_1.3_ecdsap256_aes_client	3840408	3800473	✅ -39935 (-1.04%)	0.26%
handshake_no_resume_1.2_no_crypto_server	43644	43256	✅ -388 (-0.89%)	0.20%
handshake_no_resume_1.3_no_crypto_server	65482	64904	✅ -578 (-0.88%)	0.20%
handshake_no_resume_aws_lc_rs_1.3_ecdsap384_aes_server	2409599	2429813	⚠️ 20214 (0.84%)	0.20%
handshake_session_id_ring_1.2_rsa_aes_server	3442023	3421938	✅ -20085 (-0.58%)	0.20%
handshake_session_id_1.2_no_crypto_server	1143692	1150175	⚠️ 6483 (0.57%)	0.20%
handshake_session_id_1.2_no_crypto_client	1213586	1219638	⚠️ 6052 (0.50%)	0.20%
handshake_no_resume_1.2_no_crypto_client	62140	62350	⚠️ 210 (0.34%)	0.20%
handshake_tickets_1.2_no_crypto_server	1303187	1299247	✅ -3940 (-0.30%)	0.20%
handshake_tickets_1.3_no_crypto_client	2387834	2382502	✅ -5332 (-0.22%)	0.20%
handshake_tickets_1.2_no_crypto_client	1306222	1309073	⚠️ 2851 (0.22%)	0.20%
handshake_session_id_1.3_no_crypto_server	2279195	2274424	✅ -4771 (-0.21%)	0.20%

Other differences

Click to expand

Scenario	Baseline	Candidate	Diff	Threshold
handshake_no_resume_aws_lc_rs_1.3_rsa_chacha_server	11110367	11055040	-55327 (-0.50%)	1.43%
handshake_no_resume_aws_lc_rs_1.3_ecdsap384_aes_client	9034431	9078794	44363 (0.49%)	1.35%
handshake_no_resume_aws_lc_rs_1.2_rsa_aes_server	10409674	10447680	38006 (0.37%)	1.03%
handshake_tickets_aws_lc_rs_1.3_rsa_aes_client	50399773	50252279	-147494 (-0.29%)	0.41%
handshake_session_id_aws_lc_rs_1.3_rsa_aes_client	50202011	50060672	-141339 (-0.28%)	0.65%
handshake_session_id_aws_lc_rs_1.3_ecdsap384_aes_client	50235144	50100079	-135065 (-0.27%)	0.59%
handshake_no_resume_aws_lc_rs_1.3_ecdsap384_chacha_client	9006378	9028942	22564 (0.25%)	0.94%
handshake_no_resume_aws_lc_rs_1.3_rsa_aes_server	11043736	11066786	23050 (0.21%)	1.07%
handshake_session_id_aws_lc_rs_1.3_ecdsap256_aes_client	50151546	50051582	-99964 (-0.20%)	0.51%
handshake_tickets_aws_lc_rs_1.3_rsa_chacha_client	50330673	50423319	92646 (0.18%)	0.56%
handshake_tickets_aws_lc_rs_1.3_rsa_aes_server	43008187	42935388	-72799 (-0.17%)	0.27%
handshake_tickets_ring_1.2_rsa_aes_client	3896735	3902858	6123 (0.16%)	0.20%
handshake_session_id_aws_lc_rs_1.2_rsa_aes_server	3865451	3859726	-5725 (-0.15%)	0.24%
handshake_tickets_aws_lc_rs_1.3_ecdsap256_chacha_client	50328292	50254229	-74063 (-0.15%)	0.47%
handshake_tickets_aws_lc_rs_1.3_ecdsap384_chacha_client	50297854	50227319	-70535 (-0.14%)	0.44%
handshake_tickets_aws_lc_rs_1.3_ecdsap384_chacha_server	43011600	42954704	-56896 (-0.13%)	0.26%
handshake_session_id_aws_lc_rs_1.3_ecdsap256_aes_server	41747976	41694457	-53519 (-0.13%)	0.32%
handshake_session_id_1.3_no_crypto_client	2367810	2365050	-2760 (-0.12%)	0.20%
handshake_session_id_aws_lc_rs_1.2_rsa_aes_client	3951493	3946967	-4526 (-0.11%)	0.20%
handshake_tickets_aws_lc_rs_1.3_ecdsap384_aes_server	43055613	43007826	-47787 (-0.11%)	0.27%
handshake_tickets_aws_lc_rs_1.2_rsa_aes_client	4346317	4341537	-4780 (-0.11%)	0.20%
handshake_no_resume_1.3_no_crypto_client	73280	73202	-78 (-0.11%)	0.20%
handshake_tickets_aws_lc_rs_1.3_ecdsap384_aes_client	50329486	50277580	-51906 (-0.10%)	0.47%
handshake_tickets_aws_lc_rs_1.3_ecdsap256_aes_server	43026271	43070117	43846 (0.10%)	0.32%
handshake_session_id_aws_lc_rs_1.3_rsa_aes_server	41651278	41609814	-41464 (-0.10%)	0.36%
handshake_session_id_aws_lc_rs_1.3_ecdsap384_chacha_client	50126580	50080512	-46068 (-0.09%)	0.58%
handshake_tickets_aws_lc_rs_1.3_rsa_chacha_server	42950363	42988161	37798 (0.09%)	0.30%
handshake_session_id_aws_lc_rs_1.3_rsa_chacha_server	41554628	41590925	36297 (0.09%)	0.38%
handshake_session_id_ring_1.3_rsa_chacha_client	30560022	30534927	-25095 (-0.08%)	0.20%
handshake_session_id_ring_1.3_rsa_aes_client	30651672	30626607	-25065 (-0.08%)	0.20%
handshake_no_resume_aws_lc_rs_1.3_ecdsap256_chacha_server	1488333	1489523	1190 (0.08%)	5.22%
handshake_session_id_ring_1.3_ecdsap256_chacha_client	30556271	30533117	-23154 (-0.08%)	0.20%
handshake_session_id_aws_lc_rs_1.3_ecdsap384_chacha_server	41652857	41684357	31500 (0.08%)	0.27%
handshake_session_id_ring_1.3_ecdsap256_aes_client	30647921	30624797	-23124 (-0.08%)	0.20%
transfer_no_resume_ring_1.3_rsa_aes_client	57830923	57789684	-41239 (-0.07%)	0.20%
handshake_session_id_ring_1.2_rsa_aes_client	3511572	3514052	2480 (0.07%)	0.20%
transfer_no_resume_ring_1.2_rsa_aes_client	57706679	57666932	-39747 (-0.07%)	0.20%
handshake_session_id_aws_lc_rs_1.3_rsa_chacha_client	50091962	50120744	28782 (0.06%)	0.72%
transfer_no_resume_ring_1.3_ecdsap256_aes_client	57819966	57788154	-31812 (-0.06%)	0.20%
transfer_no_resume_ring_1.3_ecdsap384_aes_client	57819977	57788165	-31812 (-0.06%)	0.20%
handshake_no_resume_aws_lc_rs_1.2_rsa_aes_client	1686776	1685980	-796 (-0.05%)	0.20%
transfer_no_resume_ring_1.3_rsa_chacha_client	92357003	92315124	-41879 (-0.05%)	0.20%
handshake_tickets_1.3_no_crypto_server	2218359	2217423	-936 (-0.04%)	0.20%
handshake_session_id_ring_1.3_ecdsap384_chacha_client	30532065	30543974	11909 (0.04%)	0.20%
handshake_session_id_ring_1.3_ecdsap384_aes_client	30623715	30635624	11909 (0.04%)	0.20%
transfer_no_resume_ring_1.3_ecdsap384_aes_server	45842772	45860189	17417 (0.04%)	0.20%
transfer_no_resume_ring_1.3_ecdsap256_aes_server	45842825	45859222	16397 (0.04%)	0.20%
transfer_no_resume_ring_1.3_ecdsap256_chacha_client	92346046	92314234	-31812 (-0.03%)	0.20%
transfer_no_resume_ring_1.3_ecdsap384_chacha_client	92346057	92314245	-31812 (-0.03%)	0.20%
handshake_tickets_ring_1.2_rsa_aes_server	3994572	3993230	-1342 (-0.03%)	0.20%
handshake_session_id_ring_1.3_rsa_chacha_server	31711133	31700691	-10442 (-0.03%)	0.20%
handshake_session_id_ring_1.3_rsa_aes_server	31833323	31822881	-10442 (-0.03%)	0.20%
handshake_session_id_aws_lc_rs_1.3_ecdsap384_aes_server	41756473	41742968	-13505 (-0.03%)	0.37%
transfer_no_resume_1.2_no_crypto_client	116938304	116906062	-32242 (-0.03%)	0.20%
transfer_no_resume_1.3_no_crypto_client	116982867	116951045	-31822 (-0.03%)	0.20%
handshake_tickets_ring_1.3_ecdsap384_chacha_server	32001094	32009442	8348 (0.03%)	0.20%
handshake_tickets_ring_1.3_ecdsap384_aes_server	32104054	32112402	8348 (0.03%)	0.20%
handshake_no_resume_ring_1.3_rsa_aes_client	2301678	2301089	-589 (-0.03%)	0.20%
handshake_no_resume_ring_1.3_rsa_chacha_client	2307332	2306743	-589 (-0.03%)	0.20%
transfer_no_resume_ring_1.3_rsa_aes_server	45849751	45861357	11606 (0.03%)	0.20%
handshake_tickets_ring_1.3_ecdsap384_chacha_client	30651200	30643665	-7535 (-0.02%)	0.20%
handshake_tickets_ring_1.3_ecdsap384_aes_client	30723410	30715875	-7535 (-0.02%)	0.20%
transfer_no_resume_ring_1.2_rsa_aes_server	45752923	45764076	11153 (0.02%)	0.20%
handshake_no_resume_ring_1.2_rsa_aes_client	2175456	2175985	529 (0.02%)	0.20%
transfer_no_resume_aws_lc_rs_1.3_rsa_aes_server	46023996	46012812	-11184 (-0.02%)	0.20%
handshake_tickets_aws_lc_rs_1.2_rsa_aes_server	4991461	4992666	1205 (0.02%)	0.57%
handshake_session_id_ring_1.3_ecdsap384_chacha_server	31715571	31708302	-7269 (-0.02%)	0.20%
handshake_session_id_ring_1.3_ecdsap384_aes_server	31837761	31830492	-7269 (-0.02%)	0.20%
handshake_tickets_aws_lc_rs_1.3_ecdsap256_chacha_server	42982714	42992476	9762 (0.02%)	0.25%
transfer_no_resume_ring_1.3_ecdsap256_chacha_server	80078345	80096022	17677 (0.02%)	0.20%
transfer_no_resume_ring_1.3_ecdsap384_chacha_server	80078292	80095709	17417 (0.02%)	0.20%
handshake_tickets_ring_1.3_rsa_chacha_server	32010397	32003942	-6455 (-0.02%)	0.20%
handshake_tickets_ring_1.3_rsa_aes_server	32113357	32106902	-6455 (-0.02%)	0.20%
handshake_session_id_aws_lc_rs_1.3_ecdsap256_chacha_server	41684299	41675928	-8371 (-0.02%)	0.34%
handshake_session_id_ring_1.3_ecdsap256_chacha_server	31709704	31715566	5862 (0.02%)	0.20%
handshake_session_id_ring_1.3_ecdsap256_aes_server	31831894	31837756	5862 (0.02%)	0.20%
transfer_no_resume_1.2_no_crypto_server	104810157	104828244	18087 (0.02%)	0.20%
transfer_no_resume_1.3_no_crypto_server	104850671	104867977	17306 (0.02%)	0.20%
handshake_no_resume_aws_lc_rs_1.3_ecdsap256_chacha_client	3802512	3803123	611 (0.02%)	4.10%
handshake_no_resume_ring_1.3_rsa_chacha_server	11088885	11090610	1725 (0.02%)	0.20%
handshake_no_resume_ring_1.3_rsa_aes_server	11083131	11084854	1723 (0.02%)	0.20%
handshake_no_resume_aws_lc_rs_1.3_rsa_chacha_client	2631314	2631707	393 (0.01%)	0.20%
transfer_no_resume_aws_lc_rs_1.3_rsa_chacha_server	80204476	80192652	-11824 (-0.01%)	0.20%
handshake_tickets_ring_1.3_ecdsap256_aes_client	30726510	30730819	4309 (0.01%)	0.20%
handshake_tickets_ring_1.3_ecdsap256_chacha_client	30654300	30658579	4279 (0.01%)	0.20%
handshake_tickets_ring_1.3_rsa_aes_client	30747448	30751689	4241 (0.01%)	0.20%
handshake_tickets_ring_1.3_rsa_chacha_client	30675238	30679449	4211 (0.01%)	0.20%
transfer_no_resume_aws_lc_rs_1.2_rsa_aes_client	57861234	57853398	-7836 (-0.01%)	0.20%
transfer_no_resume_ring_1.3_rsa_chacha_server	80086551	80096237	9686 (0.01%)	0.20%
transfer_no_resume_aws_lc_rs_1.3_rsa_aes_client	57941914	57936178	-5736 (-0.01%)	0.20%
handshake_no_resume_aws_lc_rs_1.3_ecdsap384_chacha_server	2412696	2412906	210 (0.01%)	0.20%
transfer_no_resume_aws_lc_rs_1.3_ecdsap256_aes_client	57937449	57932422	-5027 (-0.01%)	0.20%
handshake_no_resume_ring_1.3_ecdsap256_aes_server	1237183	1237290	107 (0.01%)	0.20%
handshake_no_resume_ring_1.3_ecdsap256_chacha_server	1238360	1238467	107 (0.01%)	0.20%
transfer_no_resume_aws_lc_rs_1.3_ecdsap384_aes_client	57937368	57932413	-4955 (-0.01%)	0.20%
handshake_no_resume_ring_1.3_ecdsap256_chacha_client	3274051	3273801	-250 (-0.01%)	0.25%
handshake_no_resume_ring_1.3_ecdsap384_chacha_server	7187786	7187253	-533 (-0.01%)	0.20%
handshake_no_resume_ring_1.3_ecdsap384_aes_server	7185810	7185279	-531 (-0.01%)	0.20%
handshake_no_resume_ring_1.2_rsa_aes_server	10928337	10929103	766 (0.01%)	0.20%
handshake_no_resume_aws_lc_rs_1.3_rsa_aes_client	2624788	2624964	176 (0.01%)	0.20%
transfer_no_resume_aws_lc_rs_1.3_rsa_chacha_client	92402074	92396338	-5736 (-0.01%)	0.20%
transfer_no_resume_aws_lc_rs_1.2_rsa_aes_server	45960280	45957514	-2766 (-0.01%)	0.20%
transfer_no_resume_aws_lc_rs_1.3_ecdsap384_chacha_client	92397528	92392573	-4955 (-0.01%)	0.20%
transfer_no_resume_aws_lc_rs_1.3_ecdsap256_chacha_client	92397530	92392582	-4948 (-0.01%)	0.20%
handshake_no_resume_ring_1.3_ecdsap256_aes_client	3272907	3272738	-169 (-0.01%)	0.23%
handshake_tickets_ring_1.3_ecdsap256_chacha_server	32008913	32007524	-1389 (-0.00%)	0.20%
handshake_tickets_ring_1.3_ecdsap256_aes_server	32111873	32110574	-1299 (-0.00%)	0.20%
transfer_no_resume_aws_lc_rs_1.3_ecdsap384_aes_server	46003071	46001890	-1181 (-0.00%)	0.20%
handshake_tickets_aws_lc_rs_1.3_ecdsap256_aes_client	50359054	50358327	-727 (-0.00%)	0.53%
transfer_no_resume_aws_lc_rs_1.3_ecdsap384_chacha_server	80182911	80182370	-541 (-0.00%)	0.20%
transfer_no_resume_aws_lc_rs_1.3_ecdsap256_aes_server	46002435	46002147	-288 (-0.00%)	0.20%
handshake_no_resume_ring_1.3_ecdsap384_aes_client	34713123	34712971	-152 (-0.00%)	0.20%
handshake_no_resume_ring_1.3_ecdsap384_chacha_client	34714869	34714717	-152 (-0.00%)	0.20%
transfer_no_resume_aws_lc_rs_1.3_ecdsap256_chacha_server	80182915	80182627	-288 (-0.00%)	0.20%
handshake_session_id_aws_lc_rs_1.3_ecdsap256_chacha_client	50112526	50112539	13 (0.00%)	0.57%

Wall-time

Significant differences

There are no significant wall-time differences

Other differences

Click to expand

Scenario	Baseline	Candidate	Diff	Threshold
handshake_session_id_1.3_no_crypto	704.22 µs	721.79 µs	17.56 µs (2.49%)	3.58%
handshake_tickets_1.3_no_crypto	675.24 µs	691.40 µs	16.17 µs (2.39%)	4.69%
handshake_no_resume_1.3_no_crypto	82.85 µs	84.73 µs	1.89 µs (2.28%)	11.83%
handshake_no_resume_1.2_no_crypto	74.59 µs	76.04 µs	1.45 µs (1.94%)	12.24%
handshake_tickets_1.2_no_crypto	405.03 µs	408.99 µs	3.96 µs (0.98%)	4.47%
handshake_no_resume_ring_1.3_ecdsap256_chacha	454.16 µs	457.73 µs	3.57 µs (0.79%)	2.74%
handshake_session_id_1.2_no_crypto	378.12 µs	380.88 µs	2.76 µs (0.73%)	7.52%
handshake_session_id_aws_lc_rs_1.2_rsa_aes	1.63 ms	1.64 ms	0.01 ms (0.66%)	1.91%
handshake_no_resume_ring_1.3_ecdsap256_aes	456.02 µs	458.57 µs	2.55 µs (0.56%)	3.19%
handshake_no_resume_aws_lc_rs_1.3_ecdsap256_aes	536.69 µs	539.64 µs	2.95 µs (0.55%)	3.91%
handshake_no_resume_aws_lc_rs_1.3_ecdsap256_chacha	535.62 µs	538.41 µs	2.79 µs (0.52%)	2.70%
handshake_tickets_aws_lc_rs_1.2_rsa_aes	1.80 ms	1.81 ms	0.01 ms (0.45%)	3.08%
handshake_session_id_aws_lc_rs_1.3_ecdsap256_chacha	7.35 ms	7.39 ms	0.03 ms (0.45%)	1.89%
handshake_tickets_aws_lc_rs_1.3_ecdsap384_chacha	8.23 ms	8.26 ms	0.03 ms (0.41%)	1.00%
handshake_no_resume_aws_lc_rs_1.3_ecdsap384_aes	1.22 ms	1.23 ms	0.00 ms (0.40%)	1.53%
transfer_no_resume_ring_1.3_ecdsap256_aes	5.59 ms	5.62 ms	0.02 ms (0.39%)	4.47%
handshake_session_id_aws_lc_rs_1.3_ecdsap384_chacha	8.03 ms	8.06 ms	0.03 ms (0.36%)	1.57%
transfer_no_resume_ring_1.3_rsa_aes	6.08 ms	6.11 ms	0.02 ms (0.35%)	4.10%
handshake_tickets_aws_lc_rs_1.3_ecdsap256_chacha	7.54 ms	7.57 ms	0.03 ms (0.35%)	1.20%
handshake_session_id_aws_lc_rs_1.3_rsa_chacha	8.01 ms	8.04 ms	0.03 ms (0.35%)	1.55%
transfer_no_resume_ring_1.2_rsa_aes	5.99 ms	6.01 ms	0.02 ms (0.35%)	3.69%
handshake_tickets_aws_lc_rs_1.3_rsa_chacha	8.20 ms	8.23 ms	0.03 ms (0.34%)	1.35%
transfer_no_resume_1.3_no_crypto	11.98 ms	12.02 ms	0.04 ms (0.34%)	2.39%
handshake_session_id_aws_lc_rs_1.3_ecdsap256_aes	7.38 ms	7.40 ms	0.02 ms (0.31%)	1.60%
transfer_no_resume_aws_lc_rs_1.2_rsa_aes	5.26 ms	5.27 ms	0.02 ms (0.31%)	3.05%
handshake_tickets_aws_lc_rs_1.3_ecdsap256_aes	7.57 ms	7.59 ms	0.02 ms (0.31%)	1.44%
handshake_no_resume_ring_1.3_rsa_chacha	948.50 µs	951.29 µs	2.79 µs (0.29%)	1.00%
transfer_no_resume_ring_1.3_ecdsap384_aes	8.69 ms	8.71 ms	0.02 ms (0.28%)	2.83%
handshake_tickets_aws_lc_rs_1.3_ecdsap384_aes	8.26 ms	8.28 ms	0.02 ms (0.27%)	1.35%
handshake_tickets_aws_lc_rs_1.3_rsa_aes	8.22 ms	8.24 ms	0.02 ms (0.27%)	1.44%
handshake_session_id_aws_lc_rs_1.3_ecdsap384_aes	8.06 ms	8.08 ms	0.02 ms (0.27%)	1.44%
transfer_no_resume_aws_lc_rs_1.3_ecdsap384_aes	5.48 ms	5.50 ms	0.01 ms (0.26%)	4.23%
transfer_no_resume_aws_lc_rs_1.3_rsa_aes	5.43 ms	5.45 ms	0.01 ms (0.25%)	3.47%
handshake_no_resume_ring_1.2_rsa_aes	937.25 µs	939.58 µs	2.33 µs (0.25%)	1.17%
handshake_session_id_aws_lc_rs_1.3_rsa_aes	8.04 ms	8.06 ms	0.02 ms (0.25%)	1.41%
handshake_no_resume_aws_lc_rs_1.3_ecdsap384_chacha	1.22 ms	1.22 ms	0.00 ms (0.22%)	1.00%
handshake_no_resume_aws_lc_rs_1.3_rsa_chacha	1.17 ms	1.17 ms	0.00 ms (0.22%)	1.81%
transfer_no_resume_aws_lc_rs_1.3_rsa_chacha	13.92 ms	13.95 ms	0.03 ms (0.21%)	1.56%
transfer_no_resume_aws_lc_rs_1.3_ecdsap256_chacha	13.28 ms	13.30 ms	0.03 ms (0.19%)	1.76%
transfer_no_resume_aws_lc_rs_1.3_ecdsap256_aes	4.79 ms	4.80 ms	0.01 ms (0.19%)	4.56%
transfer_no_resume_ring_1.3_rsa_chacha	13.66 ms	13.68 ms	0.02 ms (0.16%)	1.50%
transfer_no_resume_ring_1.3_ecdsap256_chacha	13.17 ms	13.19 ms	0.02 ms (0.15%)	1.85%
handshake_session_id_ring_1.2_rsa_aes	1.45 ms	1.45 ms	0.00 ms (0.15%)	1.76%
transfer_no_resume_aws_lc_rs_1.3_ecdsap384_chacha	13.97 ms	13.99 ms	0.02 ms (0.14%)	1.60%
handshake_no_resume_aws_lc_rs_1.3_rsa_aes	1.17 ms	1.17 ms	0.00 ms (0.14%)	2.15%
handshake_tickets_ring_1.2_rsa_aes	1.54 ms	1.54 ms	0.00 ms (0.14%)	1.86%
handshake_no_resume_ring_1.3_rsa_aes	947.55 µs	948.81 µs	1.26 µs (0.13%)	1.34%
handshake_tickets_ring_1.3_rsa_aes	6.04 ms	6.05 ms	0.01 ms (0.13%)	1.17%
transfer_no_resume_ring_1.3_ecdsap384_chacha	16.26 ms	16.28 ms	0.02 ms (0.13%)	1.38%
handshake_tickets_ring_1.3_rsa_chacha	6.00 ms	6.01 ms	0.01 ms (0.12%)	1.01%
handshake_tickets_ring_1.3_ecdsap256_chacha	5.50 ms	5.51 ms	0.01 ms (0.11%)	1.01%
handshake_tickets_ring_1.3_ecdsap256_aes	5.54 ms	5.54 ms	0.01 ms (0.10%)	1.11%
handshake_session_id_ring_1.3_ecdsap256_chacha	5.45 ms	5.46 ms	0.00 ms (0.08%)	1.00%
handshake_session_id_ring_1.3_rsa_chacha	5.95 ms	5.95 ms	0.00 ms (0.07%)	1.00%
handshake_session_id_ring_1.3_ecdsap256_aes	5.49 ms	5.48 ms	-0.00 ms (-0.05%)	1.00%
handshake_tickets_ring_1.3_ecdsap384_chacha	8.60 ms	8.61 ms	0.00 ms (0.05%)	1.00%
handshake_session_id_ring_1.3_ecdsap384_chacha	8.54 ms	8.55 ms	0.00 ms (0.03%)	1.00%
handshake_no_resume_ring_1.3_ecdsap384_aes	3.55 ms	3.55 ms	-0.00 ms (-0.03%)	1.00%
handshake_session_id_ring_1.3_ecdsap384_aes	8.57 ms	8.57 ms	-0.00 ms (-0.02%)	1.00%
handshake_session_id_ring_1.3_rsa_aes	5.99 ms	5.99 ms	-0.00 ms (-0.02%)	1.04%
handshake_no_resume_ring_1.3_ecdsap384_chacha	3.55 ms	3.55 ms	-0.00 ms (-0.01%)	1.00%
handshake_tickets_ring_1.3_ecdsap384_aes	8.64 ms	8.64 ms	0.00 ms (0.01%)	1.00%
transfer_no_resume_1.2_no_crypto	11.97 ms	11.97 ms	-0.00 ms (-0.00%)	1.92%
handshake_no_resume_aws_lc_rs_1.2_rsa_aes	1.05 ms	1.05 ms	-0.00 ms (-0.00%)	1.71%

Memory usage

⚠️ Missing benchmarks

The following benchmark scenarios are present in the candidate but not in the baseline:

• handshake_no_resume_ring_1.3_rsa_chacha_server

• handshake_no_resume_ring_1.2_rsa_aes_client

• handshake_no_resume_aws_lc_rs_1.3_rsa_chacha_server

• handshake_session_id_ring_1.3_ecdsap384_chacha_server

• handshake_tickets_ring_1.3_ecdsap384_aes_server

• handshake_no_resume_ring_1.3_ecdsap384_chacha_client

• handshake_no_resume_aws_lc_rs_1.3_ecdsap256_aes_server

• handshake_no_resume_ring_1.3_ecdsap256_chacha_server

• handshake_session_id_aws_lc_rs_1.3_rsa_chacha_client

• handshake_tickets_aws_lc_rs_1.3_rsa_aes_client

• transfer_no_resume_1.2_no_crypto_client

• handshake_tickets_ring_1.3_ecdsap384_chacha_server

• transfer_no_resume_ring_1.3_rsa_chacha_client

• handshake_no_resume_aws_lc_rs_1.3_ecdsap256_chacha_client

• handshake_session_id_aws_lc_rs_1.3_ecdsap384_aes_client

• transfer_no_resume_ring_1.2_rsa_aes_client

• handshake_session_id_ring_1.2_rsa_aes_server

• handshake_tickets_1.3_no_crypto_client

• handshake_session_id_1.2_no_crypto_client

• handshake_no_resume_1.2_no_crypto_client

• handshake_no_resume_1.3_no_crypto_server

• handshake_no_resume_ring_1.3_rsa_aes_server

• handshake_no_resume_1.2_no_crypto_server

• handshake_session_id_aws_lc_rs_1.3_ecdsap256_chacha_client

• transfer_no_resume_ring_1.3_ecdsap384_aes_server

• handshake_no_resume_ring_1.3_ecdsap384_aes_client

• handshake_no_resume_ring_1.3_ecdsap256_aes_client

• handshake_tickets_aws_lc_rs_1.2_rsa_aes_client

• handshake_tickets_aws_lc_rs_1.3_ecdsap256_aes_server

• handshake_session_id_aws_lc_rs_1.3_rsa_aes_server

• transfer_no_resume_aws_lc_rs_1.2_rsa_aes_client

• handshake_session_id_1.2_no_crypto_server

• handshake_tickets_ring_1.3_ecdsap384_aes_client

• transfer_no_resume_aws_lc_rs_1.2_rsa_aes_server

• transfer_no_resume_aws_lc_rs_1.3_ecdsap384_aes_server

• transfer_no_resume_ring_1.3_ecdsap256_chacha_server

• transfer_no_resume_ring_1.3_ecdsap256_chacha_client

• transfer_no_resume_aws_lc_rs_1.3_ecdsap256_aes_server

• transfer_no_resume_ring_1.3_rsa_chacha_server

• handshake_tickets_ring_1.3_rsa_chacha_server

• transfer_no_resume_aws_lc_rs_1.3_ecdsap384_chacha_client

• transfer_no_resume_aws_lc_rs_1.3_ecdsap384_chacha_server

• transfer_no_resume_aws_lc_rs_1.3_rsa_aes_server

• transfer_no_resume_1.3_no_crypto_server

• handshake_session_id_ring_1.2_rsa_aes_client

• handshake_session_id_ring_1.3_rsa_chacha_server

• handshake_session_id_aws_lc_rs_1.3_ecdsap384_chacha_client

• transfer_no_resume_ring_1.3_ecdsap256_aes_server

• handshake_tickets_ring_1.3_ecdsap384_chacha_client

• transfer_no_resume_1.2_no_crypto_server

• handshake_no_resume_aws_lc_rs_1.3_ecdsap384_aes_server

• handshake_tickets_ring_1.3_ecdsap256_chacha_server

• handshake_tickets_ring_1.3_rsa_aes_client

• handshake_session_id_ring_1.3_rsa_chacha_client

• handshake_no_resume_aws_lc_rs_1.2_rsa_aes_client

• handshake_tickets_aws_lc_rs_1.3_ecdsap256_chacha_client

• transfer_no_resume_1.3_no_crypto_client

• handshake_no_resume_ring_1.3_ecdsap256_chacha_client

• handshake_no_resume_ring_1.2_rsa_aes_server

• handshake_no_resume_ring_1.3_rsa_aes_client

• handshake_session_id_aws_lc_rs_1.3_ecdsap256_aes_server

• handshake_tickets_1.3_no_crypto_server

• handshake_session_id_ring_1.3_ecdsap256_chacha_server

• handshake_tickets_aws_lc_rs_1.3_rsa_chacha_server

• handshake_session_id_1.3_no_crypto_client

• handshake_no_resume_aws_lc_rs_1.3_ecdsap384_chacha_server

• handshake_session_id_ring_1.3_ecdsap256_chacha_client

• handshake_tickets_ring_1.3_ecdsap256_aes_client

• handshake_tickets_aws_lc_rs_1.2_rsa_aes_server

• handshake_session_id_ring_1.3_ecdsap384_aes_client

• transfer_no_resume_aws_lc_rs_1.3_rsa_aes_client

• transfer_no_resume_aws_lc_rs_1.3_rsa_chacha_server

• handshake_session_id_1.3_no_crypto_server

• handshake_tickets_aws_lc_rs_1.3_ecdsap384_aes_server

• handshake_tickets_ring_1.2_rsa_aes_client

• handshake_no_resume_ring_1.3_ecdsap384_aes_server

• handshake_tickets_aws_lc_rs_1.3_rsa_aes_server

• handshake_no_resume_ring_1.3_rsa_chacha_client

• handshake_tickets_ring_1.3_ecdsap256_aes_server

• transfer_no_resume_ring_1.3_ecdsap384_aes_client

• handshake_no_resume_ring_1.3_ecdsap384_chacha_server

• transfer_no_resume_ring_1.3_ecdsap384_chacha_server

• handshake_tickets_aws_lc_rs_1.3_ecdsap384_chacha_client

• transfer_no_resume_aws_lc_rs_1.3_rsa_chacha_client

• handshake_tickets_aws_lc_rs_1.3_ecdsap256_chacha_server

• handshake_tickets_aws_lc_rs_1.3_rsa_chacha_client

• transfer_no_resume_aws_lc_rs_1.3_ecdsap256_chacha_client

• handshake_tickets_ring_1.2_rsa_aes_server

• handshake_session_id_aws_lc_rs_1.2_rsa_aes_client

• handshake_session_id_aws_lc_rs_1.3_rsa_chacha_server

• transfer_no_resume_ring_1.2_rsa_aes_server

• handshake_session_id_ring_1.3_rsa_aes_server

• handshake_no_resume_aws_lc_rs_1.3_ecdsap384_aes_client

• handshake_no_resume_1.3_no_crypto_client

• handshake_tickets_ring_1.3_rsa_chacha_client

• handshake_session_id_aws_lc_rs_1.3_ecdsap384_aes_server

• handshake_session_id_ring_1.3_ecdsap384_aes_server

• transfer_no_resume_ring_1.3_rsa_aes_client

• transfer_no_resume_aws_lc_rs_1.3_ecdsap256_chacha_server

• handshake_no_resume_aws_lc_rs_1.3_rsa_aes_client

• handshake_tickets_aws_lc_rs_1.3_ecdsap384_aes_client

• transfer_no_resume_ring_1.3_rsa_aes_server

• handshake_session_id_aws_lc_rs_1.3_ecdsap256_chacha_server

• handshake_no_resume_aws_lc_rs_1.3_rsa_aes_server

• handshake_no_resume_aws_lc_rs_1.3_ecdsap384_chacha_client

• handshake_tickets_1.2_no_crypto_server

• handshake_no_resume_ring_1.3_ecdsap256_aes_server

• handshake_session_id_ring_1.3_rsa_aes_client

• handshake_session_id_ring_1.3_ecdsap256_aes_client

• transfer_no_resume_ring_1.3_ecdsap256_aes_client

• handshake_session_id_aws_lc_rs_1.3_ecdsap384_chacha_server

• handshake_no_resume_aws_lc_rs_1.3_rsa_chacha_client

• handshake_tickets_ring_1.3_ecdsap256_chacha_client

• handshake_session_id_aws_lc_rs_1.3_ecdsap256_aes_client

• handshake_session_id_aws_lc_rs_1.3_rsa_aes_client

• transfer_no_resume_aws_lc_rs_1.3_ecdsap256_aes_client

• handshake_session_id_aws_lc_rs_1.2_rsa_aes_server

• handshake_no_resume_aws_lc_rs_1.2_rsa_aes_server

• transfer_no_resume_aws_lc_rs_1.3_ecdsap384_aes_client

• handshake_no_resume_aws_lc_rs_1.3_ecdsap256_chacha_server

• handshake_session_id_ring_1.3_ecdsap256_aes_server

• handshake_tickets_ring_1.3_rsa_aes_server

• handshake_tickets_1.2_no_crypto_client

• handshake_tickets_aws_lc_rs_1.3_ecdsap384_chacha_server

• transfer_no_resume_ring_1.3_ecdsap384_chacha_client

• handshake_no_resume_aws_lc_rs_1.3_ecdsap256_aes_client

• handshake_tickets_aws_lc_rs_1.3_ecdsap256_aes_client

• handshake_session_id_ring_1.3_ecdsap384_chacha_client

Significant differences

There are no significant memory usage differences

Other differences

There are no other memory usage differences

Additional information

Historical results

Checkout details:

• Base repo: https://github.com/rustls/rustls.git
• Base branch: main (1a426f8)
• Candidate repo: https://github.com/rustls/rustls.git
• Candidate branch: jbp-measure-memory (b91bdbf)

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 94.98%. Comparing base (1a426f8) to head (b91bdbf).
⚠️ Report is 7 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #2730   +/-   ##
=======================================
  Coverage   94.98%   94.98%           
=======================================
  Files          98       98           
  Lines       22075    22075           
  Branches      632      632           
=======================================
  Hits        20967    20967           
  Misses        971      971           
  Partials      137      137           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.