# fqxv decode thread-scaling — combined results backing docs/decode-scaling.md # Two dedicated Slurm jobs, one per build; every row's byte count verified # against the plain FASTQ: # job 227034 (compute19, 32 CPU / 64 GB): DRR174812 + SRR2627175 rows, # fqxv v0.6.2-8-g4d6b434 — short-read archives byte-identical to v0.7.0 # (quality mode 5 is long-read-only) # job 227269 (compute21, 32 CPU / 64 GB): DRR205413 rows, # fqxv v0.6.2-9-g102fa86 — the v0.7.0 chunked-quality codebase (#279) # cpu: Intel(R) Xeon(R) Gold 6240R CPU @ 2.40GHz (both nodes) # gzip: gzip 1.12 # pigz: pigz 2.8 # zstd: zstd 1.5.7 # timer: hyperfine 1.20.0 (median of 3 runs, 1 warmup) # thread_steps: 1 2 4 8 16 32 tools: fqxv fqxv-max gzip pigz zstd dataset tool threads seconds mb_per_s bytes_out bytes_ok comp_bytes reps DRR174812 fqxv 1 342.690 29.4 10085268548 yes 1167711281 3 DRR174812 fqxv 2 211.842 47.6 10085268548 yes 1167711281 3 DRR174812 fqxv 4 132.252 76.3 10085268548 yes 1167711281 3 DRR174812 fqxv 8 90.028 112.0 10085268548 yes 1167711281 3 DRR174812 fqxv 16 56.429 178.7 10085268548 yes 1167711281 3 DRR174812 fqxv 32 42.321 238.3 10085268548 yes 1167711281 3 DRR174812 fqxv-max 1 154.075 65.5 10085268548 yes 496094456 3 DRR174812 fqxv-max 2 99.787 101.1 10085268548 yes 496094456 3 DRR174812 fqxv-max 4 72.697 138.7 10085268548 yes 496094456 3 DRR174812 fqxv-max 8 58.773 171.6 10085268548 yes 496094456 3 DRR174812 fqxv-max 16 52.089 193.6 10085268548 yes 496094456 3 DRR174812 fqxv-max 32 52.029 193.8 10085268548 yes 496094456 3 DRR174812 gzip 1 58.512 172.4 10085268548 yes 2137288036 3 DRR174812 pigz 1 38.640 261.0 10085268548 yes 2137288036 3 DRR174812 pigz 2 29.835 338.0 10085268548 yes 2137288036 3 DRR174812 pigz 4 29.841 338.0 10085268548 yes 2137288036 3 DRR174812 pigz 8 29.773 338.7 10085268548 yes 2137288036 3 DRR174812 pigz 16 29.799 338.4 10085268548 yes 2137288036 3 DRR174812 pigz 32 29.965 336.6 10085268548 yes 2137288036 3 DRR174812 zstd 1 12.973 777.4 10085268548 yes 1132604951 3 DRR174812 zstd 2 12.923 780.4 10085268548 yes 1132604951 3 DRR174812 zstd 4 12.966 777.8 10085268548 yes 1132604951 3 DRR174812 zstd 8 12.926 780.2 10085268548 yes 1132604951 3 DRR174812 zstd 16 12.956 778.4 10085268548 yes 1132604951 3 DRR174812 zstd 32 13.003 775.6 10085268548 yes 1132604951 3 SRR2627175 fqxv 1 113.488 20.7 2343806117 yes 567778946 3 SRR2627175 fqxv 2 68.472 34.2 2343806117 yes 567778946 3 SRR2627175 fqxv 4 41.534 56.4 2343806117 yes 567778946 3 SRR2627175 fqxv 8 26.918 87.1 2343806117 yes 567778946 3 SRR2627175 fqxv 16 26.493 88.5 2343806117 yes 567778946 3 SRR2627175 fqxv 32 26.523 88.4 2343806117 yes 567778946 3 SRR2627175 fqxv-max 1 62.963 37.2 2343806117 yes 392606607 3 SRR2627175 fqxv-max 2 37.499 62.5 2343806117 yes 392606607 3 SRR2627175 fqxv-max 4 24.435 95.9 2343806117 yes 392606607 3 SRR2627175 fqxv-max 8 18.354 127.7 2343806117 yes 392606607 3 SRR2627175 fqxv-max 16 15.226 153.9 2343806117 yes 392606607 3 SRR2627175 fqxv-max 32 13.912 168.5 2343806117 yes 392606607 3 SRR2627175 gzip 1 18.791 124.7 2343806117 yes 881385274 3 SRR2627175 pigz 1 14.175 165.3 2343806117 yes 881385274 3 SRR2627175 pigz 2 11.865 197.5 2343806117 yes 881385274 3 SRR2627175 pigz 4 11.844 197.9 2343806117 yes 881385274 3 SRR2627175 pigz 8 11.838 198.0 2343806117 yes 881385274 3 SRR2627175 pigz 16 11.855 197.7 2343806117 yes 881385274 3 SRR2627175 pigz 32 11.880 197.3 2343806117 yes 881385274 3 SRR2627175 zstd 1 4.112 570.0 2343806117 yes 536229614 3 SRR2627175 zstd 2 4.063 576.9 2343806117 yes 536229614 3 SRR2627175 zstd 4 4.086 573.6 2343806117 yes 536229614 3 SRR2627175 zstd 8 4.096 572.2 2343806117 yes 536229614 3 SRR2627175 zstd 16 4.062 577.0 2343806117 yes 536229614 3 SRR2627175 zstd 32 4.083 574.0 2343806117 yes 536229614 3 DRR205413 fqxv 1 73.057 8.3 603202667 yes 203864700 3 DRR205413 fqxv 2 38.899 15.5 603202667 yes 203864700 3 DRR205413 fqxv 4 22.567 26.7 603202667 yes 203864700 3 DRR205413 fqxv 8 13.503 44.7 603202667 yes 203864700 3 DRR205413 fqxv 16 9.714 62.1 603202667 yes 203864700 3 DRR205413 fqxv 32 9.043 66.7 603202667 yes 203864700 3 DRR205413 fqxv-max 1 63.568 9.5 603202667 yes 197124217 3 DRR205413 fqxv-max 2 56.256 10.7 603202667 yes 197124217 3 DRR205413 fqxv-max 4 56.281 10.7 603202667 yes 197124217 3 DRR205413 fqxv-max 8 56.699 10.6 603202667 yes 197124217 3 DRR205413 fqxv-max 16 55.842 10.8 603202667 yes 197124217 3 DRR205413 fqxv-max 32 56.579 10.7 603202667 yes 197124217 3 DRR205413 gzip 1 5.741 105.1 603202667 yes 311111651 3 DRR205413 pigz 1 3.966 152.1 603202667 yes 311111651 3 DRR205413 pigz 2 3.345 180.3 603202667 yes 311111651 3 DRR205413 pigz 4 3.351 180.0 603202667 yes 311111651 3 DRR205413 pigz 8 3.353 179.9 603202667 yes 311111651 3 DRR205413 pigz 16 3.351 180.0 603202667 yes 311111651 3 DRR205413 pigz 32 3.355 179.8 603202667 yes 311111651 3 DRR205413 zstd 1 1.709 353.0 603202667 yes 253707442 3 DRR205413 zstd 2 1.708 353.2 603202667 yes 253707442 3 DRR205413 zstd 4 1.717 351.3 603202667 yes 253707442 3 DRR205413 zstd 8 1.715 351.7 603202667 yes 253707442 3 DRR205413 zstd 16 1.720 350.7 603202667 yes 253707442 3 DRR205413 zstd 32 1.710 352.8 603202667 yes 253707442 3