[experiment] Run babel over output for let/const to var by jakebailey · Pull Request #52656 · microsoft/TypeScript (original) (raw)
@jakebailey
The results of the perf run you requested are in!
Here they are:
Compiler
Comparison Report - main..52656
| Metric | main | 52656 | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| Angular - node (v18.10.0, x64) | ||||||
| Memory used | 359,797k (± 0.02%) | 358,447k (± 0.03%) | -1,350k (- 0.38%) | 358,300k | 358,548k | p=0.005 n=6 |
| Parse Time | 3.93s (± 0.90%) | 3.52s (± 0.45%) | 🟩-0.41s (-10.44%) | 3.50s | 3.54s | p=0.005 n=6 |
| Bind Time | 1.17s (± 0.64%) | 1.13s (± 0.46%) | 🟩-0.04s (- 3.27%) | 1.13s | 1.14s | p=0.004 n=6 |
| Check Time | 8.71s (± 0.72%) | 8.46s (± 0.43%) | -0.25s (- 2.93%) | 8.42s | 8.52s | p=0.005 n=6 |
| Emit Time | 7.61s (± 0.87%) | 7.39s (± 1.32%) | -0.22s (- 2.91%) | 7.26s | 7.55s | p=0.008 n=6 |
| Total Time | 21.42s (± 0.68%) | 20.50s (± 0.67%) | 🟩-0.92s (- 4.29%) | 20.34s | 20.73s | p=0.005 n=6 |
| Compiler-Unions - node (v18.10.0, x64) | ||||||
| Memory used | 193,220k (± 1.19%) | 194,214k (± 1.58%) | ~ | 191,380k | 197,145k | p=0.689 n=6 |
| Parse Time | 1.63s (± 1.32%) | 1.48s (± 0.35%) | 🟩-0.15s (- 9.28%) | 1.48s | 1.49s | p=0.004 n=6 |
| Bind Time | 0.80s (± 0.65%) | 0.77s (± 0.67%) | 🟩-0.03s (- 3.77%) | 0.76s | 0.77s | p=0.004 n=6 |
| Check Time | 9.75s (± 0.52%) | 9.56s (± 0.41%) | -0.19s (- 1.97%) | 9.51s | 9.61s | p=0.005 n=6 |
| Emit Time | 2.80s (± 1.01%) | 2.73s (± 1.05%) | -0.07s (- 2.38%) | 2.69s | 2.77s | p=0.008 n=6 |
| Total Time | 14.98s (± 0.46%) | 14.54s (± 0.40%) | -0.44s (- 2.90%) | 14.48s | 14.61s | p=0.005 n=6 |
| Monaco - node (v18.10.0, x64) | ||||||
| Memory used | 343,965k (± 0.01%) | 342,807k (± 0.01%) | -1,159k (- 0.34%) | 342,750k | 342,834k | p=0.005 n=6 |
| Parse Time | 2.94s (± 0.84%) | 2.60s (± 1.13%) | 🟩-0.33s (-11.40%) | 2.55s | 2.63s | p=0.005 n=6 |
| Bind Time | 1.04s (± 1.32%) | 1.02s (± 1.01%) | ~ | 1.01s | 1.04s | p=0.098 n=6 |
| Check Time | 7.07s (± 0.47%) | 6.89s (± 0.35%) | -0.18s (- 2.57%) | 6.86s | 6.91s | p=0.005 n=6 |
| Emit Time | 4.33s (± 1.22%) | 4.21s (± 0.32%) | -0.12s (- 2.73%) | 4.19s | 4.23s | p=0.005 n=6 |
| Total Time | 15.37s (± 0.45%) | 14.72s (± 0.33%) | 🟩-0.64s (- 4.19%) | 14.68s | 14.79s | p=0.005 n=6 |
| TFS - node (v18.10.0, x64) | ||||||
| Memory used | 300,377k (± 0.01%) | 299,321k (± 0.01%) | -1,055k (- 0.35%) | 299,297k | 299,343k | p=0.005 n=6 |
| Parse Time | 2.27s (± 1.71%) | 2.10s (± 1.11%) | 🟩-0.18s (- 7.77%) | 2.07s | 2.13s | p=0.005 n=6 |
| Bind Time | 1.17s (± 0.44%) | 1.14s (± 0.45%) | -0.03s (- 2.57%) | 1.13s | 1.14s | p=0.004 n=6 |
| Check Time | 6.54s (± 0.65%) | 6.47s (± 0.62%) | -0.08s (- 1.20%) | 6.41s | 6.51s | p=0.020 n=6 |
| Emit Time | 3.93s (± 1.01%) | 3.82s (± 0.66%) | -0.11s (- 2.76%) | 3.79s | 3.85s | p=0.005 n=6 |
| Total Time | 13.92s (± 0.51%) | 13.52s (± 0.35%) | -0.40s (- 2.85%) | 13.45s | 13.57s | p=0.005 n=6 |
| material-ui - node (v18.10.0, x64) | ||||||
| Memory used | 476,782k (± 0.01%) | 475,737k (± 0.01%) | -1,045k (- 0.22%) | 475,696k | 475,792k | p=0.005 n=6 |
| Parse Time | 3.53s (± 0.46%) | 3.11s (± 0.24%) | 🟩-0.42s (-11.77%) | 3.10s | 3.12s | p=0.005 n=6 |
| Bind Time | 0.97s (± 0.53%) | 0.93s (± 0.87%) | 🟩-0.03s (- 3.45%) | 0.92s | 0.94s | p=0.004 n=6 |
| Check Time | 17.12s (± 0.55%) | 17.06s (± 0.63%) | ~ | 16.89s | 17.21s | p=0.469 n=6 |
| Emit Time | 0.00s (± 0.00%) | 0.00s (± 0.00%) | ~ | 0.00s | 0.00s | p=1.000 n=6 |
| Total Time | 21.61s (± 0.38%) | 21.11s (± 0.52%) | -0.51s (- 2.35%) | 20.93s | 21.25s | p=0.005 n=6 |
| xstate - node (v18.10.0, x64) | ||||||
| Memory used | 549,092k (± 0.03%) | 546,665k (± 0.02%) | -2,426k (- 0.44%) | 546,562k | 546,807k | p=0.005 n=6 |
| Parse Time | 4.58s (± 0.67%) | 4.03s (± 0.36%) | 🟩-0.55s (-12.07%) | 4.01s | 4.05s | p=0.005 n=6 |
| Bind Time | 1.71s (± 1.26%) | 1.67s (± 0.82%) | -0.05s (- 2.82%) | 1.65s | 1.69s | p=0.006 n=6 |
| Check Time | 2.81s (± 0.54%) | 2.75s (± 0.92%) | -0.06s (- 2.31%) | 2.73s | 2.80s | p=0.007 n=6 |
| Emit Time | 0.08s (± 0.00%) | 0.08s (± 6.19%) | ~ | 0.08s | 0.09s | p=0.174 n=6 |
| Total Time | 9.20s (± 0.25%) | 8.53s (± 0.38%) | 🟩-0.67s (- 7.32%) | 8.49s | 8.59s | p=0.005 n=6 |
| Angular - node (v16.17.1, x64) | ||||||
| Memory used | 359,144k (± 0.01%) | 357,763k (± 0.01%) | -1,381k (- 0.38%) | 357,733k | 357,806k | p=0.005 n=6 |
| Parse Time | 4.17s (± 0.45%) | 3.69s (± 0.44%) | 🟩-0.47s (-11.32%) | 3.68s | 3.72s | p=0.005 n=6 |
| Bind Time | 1.24s (± 0.41%) | 1.19s (± 0.86%) | 🟩-0.05s (- 4.02%) | 1.18s | 1.21s | p=0.004 n=6 |
| Check Time | 9.49s (± 0.19%) | 9.23s (± 0.23%) | -0.26s (- 2.72%) | 9.21s | 9.27s | p=0.005 n=6 |
| Emit Time | 8.06s (± 0.35%) | 7.91s (± 0.73%) | -0.15s (- 1.90%) | 7.84s | 7.99s | p=0.004 n=6 |
| Total Time | 22.96s (± 0.23%) | 22.02s (± 0.32%) | 🟩-0.94s (- 4.07%) | 21.96s | 22.14s | p=0.005 n=6 |
| Compiler-Unions - node (v16.17.1, x64) | ||||||
| Memory used | 193,814k (± 0.04%) | 193,031k (± 0.02%) | -783k (- 0.40%) | 192,959k | 193,064k | p=0.005 n=6 |
| Parse Time | 1.80s (± 0.93%) | 1.57s (± 0.87%) | 🟩-0.23s (-12.96%) | 1.55s | 1.59s | p=0.005 n=6 |
| Bind Time | 0.84s (± 0.00%) | 0.82s (± 0.50%) | -0.02s (- 2.18%) | 0.82s | 0.83s | p=0.002 n=6 |
| Check Time | 10.42s (± 0.35%) | 10.10s (± 0.73%) | 🟩-0.32s (- 3.04%) | 10.01s | 10.20s | p=0.005 n=6 |
| Emit Time | 3.10s (± 4.70%) | 3.01s (± 0.91%) | 🟩-0.10s (- 3.17%) | 2.97s | 3.05s | p=0.024 n=6 |
| Total Time | 16.17s (± 1.07%) | 15.50s (± 0.38%) | 🟩-0.67s (- 4.16%) | 15.41s | 15.55s | p=0.005 n=6 |
| Monaco - node (v16.17.1, x64) | ||||||
| Memory used | 343,232k (± 0.01%) | 342,073k (± 0.01%) | -1,159k (- 0.34%) | 342,035k | 342,106k | p=0.005 n=6 |
| Parse Time | 3.14s (± 1.50%) | 2.78s (± 1.13%) | 🟩-0.36s (-11.52%) | 2.74s | 2.82s | p=0.005 n=6 |
| Bind Time | 1.11s (± 1.51%) | 1.08s (± 0.48%) | -0.03s (- 2.40%) | 1.08s | 1.09s | p=0.024 n=6 |
| Check Time | 7.73s (± 0.25%) | 7.50s (± 0.39%) | 🟩-0.23s (- 3.02%) | 7.46s | 7.53s | p=0.005 n=6 |
| Emit Time | 4.54s (± 0.46%) | 4.46s (± 0.94%) | -0.08s (- 1.73%) | 4.40s | 4.51s | p=0.005 n=6 |
| Total Time | 16.51s (± 0.50%) | 15.82s (± 0.50%) | 🟩-0.70s (- 4.22%) | 15.69s | 15.90s | p=0.005 n=6 |
| TFS - node (v16.17.1, x64) | ||||||
| Memory used | 299,706k (± 0.01%) | 298,645k (± 0.01%) | -1,061k (- 0.35%) | 298,626k | 298,663k | p=0.005 n=6 |
| Parse Time | 2.46s (± 0.99%) | 2.21s (± 0.50%) | 🟩-0.25s (-10.16%) | 2.20s | 2.22s | p=0.004 n=6 |
| Bind Time | 1.26s (± 0.82%) | 1.23s (± 1.03%) | -0.03s (- 2.12%) | 1.22s | 1.25s | p=0.012 n=6 |
| Check Time | 7.21s (± 0.39%) | 7.09s (± 0.61%) | -0.12s (- 1.66%) | 7.05s | 7.15s | p=0.005 n=6 |
| Emit Time | 4.22s (± 0.21%) | 4.31s (± 0.76%) | +0.09s (+ 2.05%) | 4.27s | 4.35s | p=0.005 n=6 |
| Total Time | 15.15s (± 0.23%) | 14.84s (± 0.46%) | -0.31s (- 2.04%) | 14.76s | 14.94s | p=0.005 n=6 |
| material-ui - node (v16.17.1, x64) | ||||||
| Memory used | 476,012k (± 0.01%) | 475,060k (± 0.01%) | -952k (- 0.20%) | 475,033k | 475,101k | p=0.005 n=6 |
| Parse Time | 3.68s (± 0.14%) | 3.29s (± 0.23%) | 🟩-0.39s (-10.47%) | 3.28s | 3.30s | p=0.004 n=6 |
| Bind Time | 1.02s (± 0.40%) | 0.97s (± 0.78%) | 🟩-0.05s (- 4.91%) | 0.96s | 0.98s | p=0.003 n=6 |
| Check Time | 18.21s (± 0.67%) | 17.91s (± 0.37%) | -0.30s (- 1.66%) | 17.81s | 17.97s | p=0.005 n=6 |
| Emit Time | 0.00s (± 0.00%) | 0.00s (± 0.00%) | ~ | 0.00s | 0.00s | p=1.000 n=6 |
| Total Time | 22.91s (± 0.54%) | 22.17s (± 0.26%) | 🟩-0.74s (- 3.22%) | 22.08s | 22.23s | p=0.005 n=6 |
| xstate - node (v16.17.1, x64) | ||||||
| Memory used | 546,665k (± 0.01%) | 544,187k (± 0.02%) | -2,477k (- 0.45%) | 544,121k | 544,373k | p=0.005 n=6 |
| Parse Time | 4.77s (± 0.22%) | 4.22s (± 0.30%) | 🟩-0.55s (-11.47%) | 4.20s | 4.23s | p=0.004 n=6 |
| Bind Time | 1.84s (± 0.28%) | 1.73s (± 0.44%) | 🟩-0.11s (- 6.24%) | 1.72s | 1.74s | p=0.004 n=6 |
| Check Time | 3.06s (± 0.65%) | 2.97s (± 0.56%) | -0.09s (- 2.94%) | 2.94s | 2.99s | p=0.005 n=6 |
| Emit Time | 0.09s (± 4.45%) | 0.09s (± 0.00%) | ~ | 0.09s | 0.09s | p=0.405 n=6 |
| Total Time | 9.76s (± 0.29%) | 9.01s (± 0.33%) | 🟩-0.75s (- 7.68%) | 8.97s | 9.04s | p=0.005 n=6 |
| Angular - node (v14.15.1, x64) | ||||||
| Memory used | 352,818k (± 0.01%) | 351,944k (± 0.00%) | -874k (- 0.25%) | 351,918k | 351,956k | p=0.005 n=6 |
| Parse Time | 4.23s (± 0.35%) | 3.74s (± 0.53%) | 🟩-0.49s (-11.55%) | 3.72s | 3.77s | p=0.005 n=6 |
| Bind Time | 1.28s (± 0.80%) | 1.25s (± 0.51%) | -0.03s (- 2.60%) | 1.24s | 1.26s | p=0.004 n=6 |
| Check Time | 9.74s (± 0.71%) | 9.66s (± 0.33%) | ~ | 9.62s | 9.70s | p=0.065 n=6 |
| Emit Time | 8.37s (± 0.54%) | 8.20s (± 0.64%) | -0.17s (- 2.01%) | 8.16s | 8.30s | p=0.006 n=6 |
| Total Time | 23.61s (± 0.42%) | 22.85s (± 0.22%) | 🟩-0.77s (- 3.24%) | 22.77s | 22.92s | p=0.005 n=6 |
| Compiler-Unions - node (v14.15.1, x64) | ||||||
| Memory used | 188,784k (± 0.05%) | 188,435k (± 0.01%) | -348k (- 0.18%) | 188,417k | 188,455k | p=0.005 n=6 |
| Parse Time | 1.83s (± 0.41%) | 1.59s (± 0.51%) | 🟩-0.25s (-13.38%) | 1.58s | 1.60s | p=0.004 n=6 |
| Bind Time | 0.87s (± 0.97%) | 0.85s (± 0.61%) | -0.02s (- 2.12%) | 0.84s | 0.85s | p=0.004 n=6 |
| Check Time | 10.50s (± 0.59%) | 10.26s (± 0.37%) | -0.24s (- 2.25%) | 10.19s | 10.29s | p=0.005 n=6 |
| Emit Time | 3.39s (± 3.89%) | 3.08s (± 0.93%) | 🟩-0.31s (- 9.14%) | 3.04s | 3.12s | p=0.005 n=6 |
| Total Time | 16.59s (± 1.03%) | 15.78s (± 0.32%) | 🟩-0.81s (- 4.89%) | 15.70s | 15.85s | p=0.005 n=6 |
| Monaco - node (v14.15.1, x64) | ||||||
| Memory used | 337,993k (± 0.00%) | 337,278k (± 0.01%) | -715k (- 0.21%) | 337,262k | 337,310k | p=0.005 n=6 |
| Parse Time | 3.20s (± 0.67%) | 2.87s (± 0.36%) | 🟩-0.33s (-10.16%) | 2.86s | 2.89s | p=0.005 n=6 |
| Bind Time | 1.11s (± 0.46%) | 1.12s (± 0.49%) | ~ | 1.11s | 1.12s | p=0.640 n=6 |
| Check Time | 8.11s (± 0.56%) | 7.96s (± 0.81%) | -0.15s (- 1.85%) | 7.86s | 8.03s | p=0.005 n=6 |
| Emit Time | 4.80s (± 0.83%) | 4.55s (± 0.98%) | 🟩-0.25s (- 5.27%) | 4.49s | 4.60s | p=0.005 n=6 |
| Total Time | 17.23s (± 0.34%) | 16.50s (± 0.51%) | 🟩-0.73s (- 4.22%) | 16.33s | 16.56s | p=0.005 n=6 |
| TFS - node (v14.15.1, x64) | ||||||
| Memory used | 294,575k (± 0.01%) | 293,924k (± 0.01%) | -651k (- 0.22%) | 293,884k | 293,941k | p=0.005 n=6 |
| Parse Time | 2.74s (± 0.68%) | 2.42s (± 0.48%) | 🟩-0.32s (-11.78%) | 2.41s | 2.44s | p=0.005 n=6 |
| Bind Time | 1.11s (± 0.95%) | 1.08s (± 0.50%) | -0.02s (- 1.81%) | 1.08s | 1.09s | p=0.008 n=6 |
| Check Time | 7.51s (± 0.47%) | 7.45s (± 0.40%) | -0.07s (- 0.93%) | 7.41s | 7.48s | p=0.013 n=6 |
| Emit Time | 4.63s (± 1.03%) | 4.29s (± 1.01%) | 🟩-0.34s (- 7.31%) | 4.21s | 4.33s | p=0.005 n=6 |
| Total Time | 15.99s (± 0.44%) | 15.24s (± 0.43%) | 🟩-0.75s (- 4.69%) | 15.12s | 15.31s | p=0.005 n=6 |
| material-ui - node (v14.15.1, x64) | ||||||
| Memory used | 471,622k (± 0.00%) | 470,749k (± 0.01%) | -873k (- 0.19%) | 470,722k | 470,778k | p=0.005 n=6 |
| Parse Time | 3.88s (± 0.72%) | 3.44s (± 0.61%) | 🟩-0.44s (-11.26%) | 3.42s | 3.48s | p=0.005 n=6 |
| Bind Time | 1.05s (± 0.00%) | 1.01s (± 0.40%) | 🟩-0.04s (- 3.97%) | 1.00s | 1.01s | p=0.002 n=6 |
| Check Time | 19.14s (± 0.77%) | 18.92s (± 0.31%) | -0.22s (- 1.16%) | 18.82s | 18.99s | p=0.005 n=6 |
| Emit Time | 0.00s (± 0.00%) | 0.00s (± 0.00%) | ~ | 0.00s | 0.00s | p=1.000 n=6 |
| Total Time | 24.07s (± 0.57%) | 23.37s (± 0.23%) | -0.70s (- 2.89%) | 23.27s | 23.42s | p=0.005 n=6 |
| xstate - node (v14.15.1, x64) | ||||||
| Memory used | 534,749k (± 0.00%) | 533,029k (± 0.02%) | -1,721k (- 0.32%) | 532,837k | 533,091k | p=0.005 n=6 |
| Parse Time | 5.12s (± 0.82%) | 4.36s (± 0.23%) | 🟩-0.76s (-14.87%) | 4.35s | 4.37s | p=0.005 n=6 |
| Bind Time | 1.71s (± 0.60%) | 1.76s (± 0.78%) | +0.06s (+ 3.42%) | 1.74s | 1.78s | p=0.004 n=6 |
| Check Time | 3.13s (± 0.48%) | 3.14s (± 0.70%) | ~ | 3.11s | 3.17s | p=0.256 n=6 |
| Emit Time | 0.10s (± 4.01%) | 0.09s (± 0.00%) | 🟩-0.01s (-11.48%) | 0.09s | 0.09s | p=0.002 n=6 |
| Total Time | 10.06s (± 0.36%) | 9.36s (± 0.34%) | 🟩-0.70s (- 6.96%) | 9.32s | 9.40s | p=0.005 n=6 |
System
| Machine Name | ts-ci-ubuntu |
|---|---|
| Platform | linux 5.4.0-135-generic |
| Architecture | x64 |
| Available Memory | 16 GB |
| Available Memory | 15 GB |
| CPUs | 4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz |
Hosts
- node (v18.10.0, x64)
- node (v16.17.1, x64)
- node (v14.15.1, x64)
Scenarios
- Angular - node (v18.10.0, x64)
- Angular - node (v16.17.1, x64)
- Angular - node (v14.15.1, x64)
- Compiler-Unions - node (v18.10.0, x64)
- Compiler-Unions - node (v16.17.1, x64)
- Compiler-Unions - node (v14.15.1, x64)
- Monaco - node (v18.10.0, x64)
- Monaco - node (v16.17.1, x64)
- Monaco - node (v14.15.1, x64)
- TFS - node (v18.10.0, x64)
- TFS - node (v16.17.1, x64)
- TFS - node (v14.15.1, x64)
- material-ui - node (v18.10.0, x64)
- material-ui - node (v16.17.1, x64)
- material-ui - node (v14.15.1, x64)
- xstate - node (v18.10.0, x64)
- xstate - node (v16.17.1, x64)
- xstate - node (v14.15.1, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | 52656 | 6 |
| Baseline | main | 6 |
TSServer
Comparison Report - main..52656
| Metric | main | 52656 | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| Compiler-UnionsTSServer - node (v18.10.0, x64) | ||||||
| Req 1 - updateOpen | 2,496ms (± 1.28%) | 2,378ms (± 1.33%) | 🟩-118ms (- 4.73%) | 2,338ms | 2,422ms | p=0.005 n=6 |
| Req 2 - geterr | 5,511ms (± 0.57%) | 5,413ms (± 0.51%) | -98ms (- 1.77%) | 5,375ms | 5,452ms | p=0.005 n=6 |
| Req 3 - references | 370ms (± 1.13%) | 345ms (± 1.33%) | 🟩-25ms (- 6.77%) | 340ms | 353ms | p=0.005 n=6 |
| Req 4 - navto | 284ms (± 0.99%) | 277ms (± 0.90%) | -7ms (- 2.52%) | 272ms | 279ms | p=0.005 n=6 |
| Req 5 - completionInfo count | 1,356 (± 0.00%) | 1,356 (± 0.00%) | ~ | 1,356 | 1,356 | p=1.000 n=6 |
| Req 5 - completionInfo | 73ms (± 1.03%) | 69ms (± 5.72%) | ~ | 67ms | 77ms | p=0.061 n=6 |
| CompilerTSServer - node (v18.10.0, x64) | ||||||
| Req 1 - updateOpen | 2,739ms (± 0.79%) | 2,494ms (± 0.89%) | 🟩-245ms (- 8.93%) | 2,459ms | 2,522ms | p=0.005 n=6 |
| Req 2 - geterr | 4,059ms (± 0.64%) | 3,990ms (± 0.63%) | -69ms (- 1.70%) | 3,959ms | 4,035ms | p=0.008 n=6 |
| Req 3 - references | 368ms (± 0.72%) | 362ms (± 0.69%) | -6ms (- 1.63%) | 359ms | 366ms | p=0.013 n=6 |
| Req 4 - navto | 293ms (± 0.88%) | 293ms (± 0.91%) | ~ | 290ms | 298ms | p=1.000 n=6 |
| Req 5 - completionInfo count | 1,518 (± 0.00%) | 1,518 (± 0.00%) | ~ | 1,518 | 1,518 | p=1.000 n=6 |
| Req 5 - completionInfo | 66ms (± 0.79%) | 66ms (± 9.84%) | ~ | 62ms | 77ms | p=0.366 n=6 |
| xstateTSServer - node (v18.10.0, x64) | ||||||
| Req 1 - updateOpen | 3,490ms (± 0.82%) | 3,181ms (± 0.70%) | 🟩-309ms (- 8.85%) | 3,145ms | 3,204ms | p=0.005 n=6 |
| Req 2 - geterr | 1,648ms (± 0.66%) | 1,682ms (± 1.35%) | +35ms (+ 2.09%) | 1,657ms | 1,711ms | p=0.005 n=6 |
| Req 3 - references | 104ms (± 1.05%) | 103ms (± 2.07%) | ~ | 101ms | 106ms | p=0.566 n=6 |
| Req 4 - navto | 355ms (± 0.53%) | 367ms (± 0.93%) | +13ms (+ 3.57%) | 363ms | 373ms | p=0.005 n=6 |
| Req 5 - completionInfo count | 3,175 (± 0.00%) | 3,175 (± 0.00%) | ~ | 3,175 | 3,175 | p=1.000 n=6 |
| Req 5 - completionInfo | 450ms (± 0.90%) | 445ms (± 1.17%) | ~ | 439ms | 452ms | p=0.092 n=6 |
| Compiler-UnionsTSServer - node (v16.17.1, x64) | ||||||
| Req 1 - updateOpen | 2,770ms (± 0.58%) | 2,529ms (± 0.91%) | 🟩-242ms (- 8.72%) | 2,496ms | 2,554ms | p=0.005 n=6 |
| Req 2 - geterr | 5,930ms (± 0.53%) | 5,774ms (± 0.36%) | -156ms (- 2.63%) | 5,743ms | 5,800ms | p=0.005 n=6 |
| Req 3 - references | 377ms (± 0.76%) | 360ms (± 0.49%) | 🟩-18ms (- 4.64%) | 357ms | 362ms | p=0.005 n=6 |
| Req 4 - navto | 277ms (± 0.91%) | 265ms (± 0.67%) | 🟩-12ms (- 4.33%) | 263ms | 268ms | p=0.005 n=6 |
| Req 5 - completionInfo count | 1,356 (± 0.00%) | 1,356 (± 0.00%) | ~ | 1,356 | 1,356 | p=1.000 n=6 |
| Req 5 - completionInfo | 79ms (± 2.70%) | 88ms (± 2.42%) | +9ms (+11.37%) | 84ms | 90ms | p=0.005 n=6 |
| CompilerTSServer - node (v16.17.1, x64) | ||||||
| Req 1 - updateOpen | 2,924ms (± 0.37%) | 2,654ms (± 1.00%) | 🟩-270ms (- 9.23%) | 2,615ms | 2,692ms | p=0.005 n=6 |
| Req 2 - geterr | 4,412ms (± 0.53%) | 4,332ms (± 0.38%) | -81ms (- 1.82%) | 4,308ms | 4,352ms | p=0.005 n=6 |
| Req 3 - references | 382ms (± 1.07%) | 376ms (± 0.48%) | -6ms (- 1.66%) | 373ms | 378ms | p=0.036 n=6 |
| Req 4 - navto | 287ms (± 0.56%) | 284ms (± 0.36%) | -4ms (- 1.22%) | 282ms | 285ms | p=0.004 n=6 |
| Req 5 - completionInfo count | 1,518 (± 0.00%) | 1,518 (± 0.00%) | ~ | 1,518 | 1,518 | p=1.000 n=6 |
| Req 5 - completionInfo | 71ms (± 0.57%) | 67ms (± 1.26%) | 🟩-5ms (- 6.56%) | 65ms | 67ms | p=0.003 n=6 |
| xstateTSServer - node (v16.17.1, x64) | ||||||
| Req 1 - updateOpen | 3,626ms (± 0.35%) | 3,341ms (± 0.52%) | 🟩-285ms (- 7.86%) | 3,319ms | 3,362ms | p=0.005 n=6 |
| Req 2 - geterr | 1,825ms (± 1.51%) | 2,014ms (± 2.38%) | +189ms (+10.37%) | 1,923ms | 2,049ms | p=0.005 n=6 |
| Req 3 - references | 113ms (± 1.42%) | 110ms (± 2.07%) | -3ms (- 2.51%) | 106ms | 112ms | p=0.034 n=6 |
| Req 4 - navto | 344ms (± 1.02%) | 355ms (± 0.95%) | +11ms (+ 3.15%) | 349ms | 358ms | p=0.006 n=6 |
| Req 5 - completionInfo count | 3,175 (± 0.00%) | 3,175 (± 0.00%) | ~ | 3,175 | 3,175 | p=1.000 n=6 |
| Req 5 - completionInfo | 457ms (± 0.99%) | 450ms (± 1.43%) | ~ | 443ms | 462ms | p=0.064 n=6 |
| Compiler-UnionsTSServer - node (v14.15.1, x64) | ||||||
| Req 1 - updateOpen | 2,884ms (± 0.28%) | 2,589ms (± 0.51%) | 🟩-295ms (-10.22%) | 2,572ms | 2,604ms | p=0.005 n=6 |
| Req 2 - geterr | 6,277ms (± 0.73%) | 6,207ms (± 0.59%) | -70ms (- 1.11%) | 6,156ms | 6,250ms | p=0.020 n=6 |
| Req 3 - references | 391ms (± 0.53%) | 368ms (± 0.48%) | 🟩-23ms (- 5.85%) | 365ms | 370ms | p=0.005 n=6 |
| Req 4 - navto | 280ms (± 1.31%) | 279ms (± 0.67%) | ~ | 278ms | 283ms | p=0.933 n=6 |
| Req 5 - completionInfo count | 1,356 (± 0.00%) | 1,356 (± 0.00%) | ~ | 1,356 | 1,356 | p=1.000 n=6 |
| Req 5 - completionInfo | 99ms (± 1.69%) | 98ms (± 2.29%) | ~ | 94ms | 100ms | p=0.676 n=6 |
| CompilerTSServer - node (v14.15.1, x64) | ||||||
| Req 1 - updateOpen | 3,038ms (± 0.96%) | 2,772ms (± 0.97%) | 🟩-266ms (- 8.75%) | 2,735ms | 2,811ms | p=0.005 n=6 |
| Req 2 - geterr | 4,695ms (± 0.40%) | 4,642ms (± 1.86%) | ~ | 4,468ms | 4,700ms | p=0.093 n=6 |
| Req 3 - references | 404ms (± 0.43%) | 388ms (± 0.53%) | 🟩-16ms (- 3.96%) | 386ms | 391ms | p=0.005 n=6 |
| Req 4 - navto | 293ms (± 1.30%) | 287ms (± 1.15%) | -6ms (- 1.94%) | 284ms | 293ms | p=0.035 n=6 |
| Req 5 - completionInfo count | 1,518 (± 0.00%) | 1,518 (± 0.00%) | ~ | 1,518 | 1,518 | p=1.000 n=6 |
| Req 5 - completionInfo | 82ms (± 3.84%) | 82ms (± 7.67%) | ~ | 79ms | 95ms | p=0.230 n=6 |
| xstateTSServer - node (v14.15.1, x64) | ||||||
| Req 1 - updateOpen | 3,955ms (± 0.60%) | 3,628ms (± 0.52%) | 🟩-327ms (- 8.27%) | 3,600ms | 3,655ms | p=0.005 n=6 |
| Req 2 - geterr | 1,776ms (± 1.68%) | 1,804ms (± 0.78%) | ~ | 1,785ms | 1,825ms | p=0.066 n=6 |
| Req 3 - references | 133ms (± 1.99%) | 124ms (± 1.56%) | 🟩-9ms (- 6.88%) | 121ms | 126ms | p=0.005 n=6 |
| Req 4 - navto | 375ms (± 0.95%) | 383ms (± 0.47%) | +8ms (+ 2.13%) | 381ms | 386ms | p=0.005 n=6 |
| Req 5 - completionInfo count | 3,175 (± 0.00%) | 3,175 (± 0.00%) | ~ | 3,175 | 3,175 | p=1.000 n=6 |
| Req 5 - completionInfo | 470ms (± 2.40%) | 461ms (± 0.60%) | ~ | 457ms | 465ms | p=0.297 n=6 |
System
| Machine Name | ts-ci-ubuntu |
|---|---|
| Platform | linux 5.4.0-135-generic |
| Architecture | x64 |
| Available Memory | 16 GB |
| Available Memory | 15 GB |
| CPUs | 4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz |
Hosts
- node (v18.10.0, x64)
- node (v16.17.1, x64)
- node (v14.15.1, x64)
Scenarios
- Compiler-UnionsTSServer - node (v18.10.0, x64)
- Compiler-UnionsTSServer - node (v16.17.1, x64)
- Compiler-UnionsTSServer - node (v14.15.1, x64)
- CompilerTSServer - node (v18.10.0, x64)
- CompilerTSServer - node (v16.17.1, x64)
- CompilerTSServer - node (v14.15.1, x64)
- xstateTSServer - node (v18.10.0, x64)
- xstateTSServer - node (v16.17.1, x64)
- xstateTSServer - node (v14.15.1, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | 52656 | 6 |
| Baseline | main | 6 |
Startup
Comparison Report - main..52656
| Metric | main | 52656 | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| tsc-startup - node (v16.17.1, x64) | ||||||
| Execution time | 142.53ms (± 0.21%) | 140.66ms (± 0.18%) | -1.87ms (- 1.31%) | 140.03ms | 143.81ms | p=0.000 n=600 |
| tsserver-startup - node (v16.17.1, x64) | ||||||
| Execution time | 227.47ms (± 0.18%) | 223.95ms (± 0.18%) | -3.52ms (- 1.55%) | 222.71ms | 227.24ms | p=0.000 n=600 |
| tsserverlibrary-startup - node (v16.17.1, x64) | ||||||
| Execution time | 228.98ms (± 0.13%) | 228.47ms (± 0.41%) | -0.51ms (- 0.22%) | 225.12ms | 239.95ms | p=0.000 n=600 |
| typescript-startup - node (v16.17.1, x64) | ||||||
| Execution time | 209.74ms (± 0.15%) | 209.00ms (± 0.37%) | -0.74ms (- 0.35%) | 206.25ms | 214.83ms | p=0.000 n=600 |
System
| Machine Name | ts-ci-ubuntu |
|---|---|
| Platform | linux 5.4.0-135-generic |
| Architecture | x64 |
| Available Memory | 16 GB |
| Available Memory | 15 GB |
| CPUs | 4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz |
Hosts
- node (v16.17.1, x64)
Scenarios
- tsc-startup - node (v16.17.1, x64)
- tsserver-startup - node (v16.17.1, x64)
- tsserverlibrary-startup - node (v16.17.1, x64)
- typescript-startup - node (v16.17.1, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | 52656 | 6 |
| Baseline | main | 6 |
Developer Information: