DOM update 2024-09-25 by sandersn · Pull Request #60061 · microsoft/TypeScript (original) (raw)

@jakebailey
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr

Metric baseline pr Delta Best Worst p-value
Compiler-Unions - node (v18.15.0, x64)
Errors 31 31 ~ ~ ~ p=1.000 n=6
Symbols 62,340 62,340 ~ ~ ~ p=1.000 n=6
Types 50,378 50,378 ~ ~ ~ p=1.000 n=6
Memory used 195,734k (± 0.70%) 195,536k (± 0.80%) ~ 192,360k 196,436k p=0.471 n=6
Parse Time 1.60s (± 1.29%) 1.62s (± 0.84%) ~ 1.60s 1.64s p=0.328 n=6
Bind Time 0.87s (± 0.87%) 0.87s (± 1.74%) ~ 0.85s 0.89s p=0.864 n=6
Check Time 11.69s (± 0.27%) 11.71s (± 0.42%) ~ 11.64s 11.79s p=0.517 n=6
Emit Time 3.40s (± 5.43%) 3.49s (± 4.09%) ~ 3.25s 3.60s p=0.688 n=6
Total Time 17.57s (± 1.11%) 17.69s (± 0.79%) ~ 17.44s 17.82s p=0.229 n=6
angular-1 - node (v18.15.0, x64)
Errors 7 33 🔻+26 (+371.43%) ~ ~ p=0.001 n=6
Symbols 947,102 947,872 +770 (+ 0.08%) ~ ~ p=0.001 n=6
Types 410,738 410,831 +93 (+ 0.02%) ~ ~ p=0.001 n=6
Memory used 1,224,158k (± 0.01%) 1,224,103k (± 0.01%) ~ 1,224,021k 1,224,177k p=0.261 n=6
Parse Time 8.11s (± 1.00%) 8.11s (± 0.52%) ~ 8.08s 8.19s p=0.936 n=6
Bind Time 2.27s (± 1.07%) 2.28s (± 0.76%) ~ 2.25s 2.30s p=0.226 n=6
Check Time 37.85s (± 0.52%) 37.84s (± 0.20%) ~ 37.71s 37.92s p=0.469 n=6
Emit Time 18.21s (± 0.74%) 18.24s (± 0.67%) ~ 18.12s 18.45s p=0.470 n=6
Total Time 66.43s (± 0.37%) 66.47s (± 0.22%) ~ 66.31s 66.73s p=0.810 n=6
mui-docs - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 2,521,651 2,521,993 +342 (+ 0.01%) ~ ~ p=0.001 n=6
Types 936,037 936,048 +11 (+ 0.00%) ~ ~ p=0.001 n=6
Memory used 2,351,990k (± 0.00%) 2,352,433k (± 0.01%) +443k (+ 0.02%) 2,352,230k 2,352,661k p=0.005 n=6
Parse Time 11.22s (± 0.47%) 11.16s (± 0.51%) ~ 11.08s 11.23s p=0.091 n=6
Bind Time 2.61s (± 0.56%) 2.63s (± 0.74%) ~ 2.60s 2.66s p=0.060 n=6
Check Time 90.71s (± 0.22%) 91.62s (± 2.95%) ~ 89.86s 97.07s p=1.000 n=6
Emit Time 0.35s (± 3.32%) 0.34s (± 3.98%) ~ 0.32s 0.36s p=0.406 n=6
Total Time 104.90s (± 0.22%) 105.75s (± 2.60%) ~ 103.99s 111.28s p=0.810 n=6
self-build-src - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,250,482 1,250,482 ~ ~ ~ p=1.000 n=6
Types 265,040 265,040 ~ ~ ~ p=1.000 n=6
Memory used 3,129,069k (± 0.09%) 3,128,348k (± 0.02%) ~ 3,127,507k 3,129,568k p=0.810 n=6
Parse Time 6.62s (± 1.32%) 6.61s (± 0.71%) ~ 6.58s 6.68s p=0.575 n=6
Bind Time 2.33s (± 4.56%) 2.35s (± 1.18%) ~ 2.32s 2.38s p=1.000 n=6
Check Time 42.90s (± 0.35%) 42.94s (± 0.28%) ~ 42.82s 43.12s p=1.000 n=6
Emit Time 3.42s (± 1.93%) 3.38s (± 1.73%) ~ 3.27s 3.43s p=0.520 n=6
Total Time 55.25s (± 0.39%) 55.28s (± 0.32%) ~ 54.98s 55.46s p=1.000 n=6
self-build-src-public-api - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,250,482 1,250,482 ~ ~ ~ p=1.000 n=6
Types 265,040 265,040 ~ ~ ~ p=1.000 n=6
Memory used 2,867,576k (±13.42%) 2,867,038k (±13.42%) ~ 2,484,946k 3,247,315k p=1.000 n=6
Parse Time 6.73s (± 2.08%) 6.81s (± 3.07%) ~ 6.59s 7.03s p=0.471 n=6
Bind Time 2.19s (± 4.53%) 2.16s (± 2.09%) ~ 2.09s 2.22s p=0.872 n=6
Check Time 43.00s (± 0.44%) 42.87s (± 0.43%) ~ 42.63s 43.04s p=0.575 n=6
Emit Time 3.36s (± 1.82%) 3.30s (± 0.70%) ~ 3.28s 3.34s p=0.090 n=6
Total Time 55.27s (± 0.45%) 55.13s (± 0.36%) ~ 54.78s 55.33s p=0.261 n=6
self-compiler - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 260,980 260,980 ~ ~ ~ p=1.000 n=6
Types 106,406 106,406 ~ ~ ~ p=1.000 n=6
Memory used 436,855k (± 0.01%) 436,837k (± 0.01%) ~ 436,777k 436,908k p=0.521 n=6
Parse Time 3.49s (± 0.62%) 3.50s (± 0.86%) ~ 3.46s 3.54s p=0.935 n=6
Bind Time 1.29s (± 1.42%) 1.30s (± 1.06%) ~ 1.29s 1.33s p=0.346 n=6
Check Time 18.83s (± 0.33%) 18.81s (± 0.44%) ~ 18.72s 18.91s p=0.809 n=6
Emit Time 1.49s (± 1.18%) 1.46s (± 1.96%) ~ 1.44s 1.50s p=0.157 n=6
Total Time 25.09s (± 0.24%) 25.07s (± 0.48%) ~ 24.94s 25.24s p=0.575 n=6
ts-pre-modules - node (v18.15.0, x64)
Errors 68 68 ~ ~ ~ p=1.000 n=6
Symbols 225,916 225,916 ~ ~ ~ p=1.000 n=6
Types 94,414 94,414 ~ ~ ~ p=1.000 n=6
Memory used 370,916k (± 0.02%) 370,944k (± 0.01%) ~ 370,909k 371,014k p=0.296 n=6
Parse Time 2.90s (± 1.61%) 2.89s (± 0.89%) ~ 2.86s 2.92s p=0.872 n=6
Bind Time 1.60s (± 1.10%) 1.59s (± 1.18%) ~ 1.57s 1.62s p=0.139 n=6
Check Time 16.34s (± 0.28%) 16.36s (± 0.29%) ~ 16.31s 16.42s p=0.375 n=6
Emit Time 0.00s 0.00s ~ ~ ~ p=1.000 n=6
Total Time 20.84s (± 0.30%) 20.84s (± 0.18%) ~ 20.79s 20.89s p=0.872 n=6
vscode - node (v18.15.0, x64)
Errors 1 1 ~ ~ ~ p=1.000 n=6
Symbols 3,104,519 3,105,038 +519 (+ 0.02%) ~ ~ p=0.001 n=6
Types 1,070,045 1,070,237 +192 (+ 0.02%) ~ ~ p=0.001 n=6
Memory used 3,199,818k (± 0.00%) 3,200,277k (± 0.01%) +459k (+ 0.01%) 3,200,048k 3,200,487k p=0.005 n=6
Parse Time 14.20s (± 0.42%) 14.17s (± 0.21%) ~ 14.13s 14.21s p=0.336 n=6
Bind Time 4.41s (± 0.57%) 4.41s (± 0.45%) ~ 4.39s 4.44s p=1.000 n=6
Check Time 87.31s (± 3.57%) 86.12s (± 2.52%) ~ 84.13s 89.12s p=0.689 n=6
Emit Time 24.09s (± 9.35%) 24.77s (± 9.91%) ~ 22.52s 27.14s p=0.689 n=6
Total Time 130.01s (± 3.47%) 129.47s (± 2.68%) ~ 125.26s 134.68s p=0.689 n=6
webpack - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 279,071 279,481 +410 (+ 0.15%) ~ ~ p=0.001 n=6
Types 113,893 114,023 +130 (+ 0.11%) ~ ~ p=0.001 n=6
Memory used 428,661k (± 0.02%) 429,423k (± 0.03%) +761k (+ 0.18%) 429,272k 429,631k p=0.005 n=6
Parse Time 4.04s (± 0.72%) 4.06s (± 1.06%) ~ 4.00s 4.11s p=0.332 n=6
Bind Time 1.73s (± 1.19%) 1.74s (± 1.85%) ~ 1.70s 1.78s p=0.808 n=6
Check Time 18.07s (± 0.37%) 18.15s (± 0.35%) +0.08s (+ 0.42%) 18.05s 18.24s p=0.045 n=6
Emit Time 0.00s 0.00s ~ ~ ~ p=1.000 n=6
Total Time 23.84s (± 0.28%) 23.95s (± 0.29%) +0.11s (+ 0.45%) 23.86s 24.05s p=0.037 n=6
xstate-main - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 540,027 540,378 +351 (+ 0.06%) ~ ~ p=0.001 n=6
Types 181,292 181,305 +13 (+ 0.01%) ~ ~ p=0.001 n=6
Memory used 483,565k (± 0.01%) 484,135k (± 0.01%) +570k (+ 0.12%) 484,090k 484,179k p=0.005 n=6
Parse Time 2.73s (± 0.45%) 2.74s (± 0.36%) ~ 2.72s 2.75s p=0.097 n=6
Bind Time 0.98s 0.98s (± 0.64%) ~ 0.97s 0.99s p=1.000 n=6
Check Time 15.94s (± 0.49%) 15.94s (± 0.34%) ~ 15.88s 16.01s p=0.808 n=6
Emit Time 0.00s 0.00s ~ ~ ~ p=1.000 n=6
Total Time 19.65s (± 0.44%) 19.66s (± 0.30%) ~ 19.58s 19.72s p=0.572 n=6

System info unknown

Hosts

Scenarios

Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks