msquic/.azure/azure-pipelines.periodic.yml

#
# Continuous Integration (CI)
# This pipeline builds and runs MsQuic performance RPS long run tests.
#

trigger: none
pr: none

schedules:
- cron: "0 0 * * Sun"
  displayName: Weekly Perf Run
  branches:
    include:
    - main
  always: true

name: 0.$(Date:yyyy).$(Date:MM).$(DayOfMonth).$(Rev:rr).0
stages:

#
# Builds
#

- stage: build_winuser_schannel
  displayName: Build Windows (Schannel)
  dependsOn: []
  variables:
    runCodesignValidationInjection: false
  jobs:
  - template: ./templates/build-config-user.yml
    parameters:
      image: windows-latest
      platform: windows
      arch: x64
      tls: schannel
      config: Release
      extraPrepareArgs: -DisableTest
      extraBuildArgs: -DisableTest -DisableTools -PGO

- stage: build_winuser_openssl
  displayName: Build Windows (OpenSSL)
  dependsOn: []
  variables:
    runCodesignValidationInjection: false
  jobs:
  - template: ./templates/build-config-user.yml
    parameters:
      image: windows-latest
      platform: windows
      arch: x64
      tls: openssl
      config: Release
      extraPrepareArgs: -DisableTest
      extraBuildArgs: -DisableTest -DisableTools -PGO

- stage: build_winuser_xdp
  displayName: Build Windows (XDP)
  dependsOn: []
  variables:
    runCodesignValidationInjection: false
  jobs:
  - template: ./templates/build-config-user.yml
    parameters:
      image: windows-latest
      platform: windows
      arch: x64
      tls: schannel
      config: Release
      extraName: 'xdp'
      extraPrepareArgs: -DisableTest -InstallXdpSdk
      extraBuildArgs: -DisableTest -DisableTools -UseXdp -ExtraArtifactDir Xdp -PGO

#
# Performance Tests
#

- stage: perf_winuser_schannel
  displayName: Performance Testing Windows (Schannel)
  dependsOn:
  - build_winuser_schannel
  jobs:
  - template: ./templates/run-performance.yml
    parameters:
      pool: MsQuic-Win-Perf
      platform: windows
      localTls: schannel
      remoteTls: schannel
      arch: x64
      testTypes: Remote
      extraArgs: -PGO
      failOnRegression: 0

- stage: perf_winuser_openssl
  displayName: Performance Testing Windows (OpenSSL)
  dependsOn:
  - build_winuser_openssl
  jobs:
  - template: ./templates/run-performance.yml
    parameters:
      pool: MsQuic-Win-Perf
      platform: windows
      localTls: openssl
      remoteTls: openssl
      arch: x64
      testTypes: Remote
      extraArgs: -PGO
      failOnRegression: 0

- stage: perf_winuser_xdp
  displayName: Performance Testing Windows (XDP)
  dependsOn:
  - build_winuser_xdp
  jobs:
  - template: ./templates/run-performance.yml
    parameters:
      pool: MsQuic-Win-Perf
      platform: windows
      localTls: schannel
      remoteTls: schannel
      arch: x64
      extraArtifactDir: '_Xdp'
      extraTestArgs: -ExtraArtifactDir _Xdp -XDP
      testTypes: Remote
      extraArgs: -PGO
      failOnRegression: 0

- stage: make_pull_request
  displayName: Make Pull Request
  dependsOn:
  - perf_winuser_schannel
  - perf_winuser_openssl
  - perf_winuser_xdp
  jobs:
  - template: ./templates/make-pgo-pr.yml
Add full RPS matrix, and a pipeline to run it. (#1146) * Add full RPS matrix, and a pipeline to run it. Pipeline is manual only currently, and test suite likely needs more, but adding more is easy once this is going * Fix name to periodic, trigger the blank space group * fixup comments, add cron trigger * Fix yaml * Another yaml fix * Turn into full run matrix * Catch on missing old results * Expand timeout to 5 hours * Another timeout fix attempt * 1 more attempt at timeout fixes 2021-01-09 05:02:55 +03:00			`#`
			`# Continuous Integration (CI)`
			`# This pipeline builds and runs MsQuic performance RPS long run tests.`
			`#`

			`trigger: none`
			`pr: none`

			`schedules:`
Only run PGO weekly. Only use non-loopback results for PGO. (#3030) 2022-08-29 23:35:58 +03:00			`- cron: "0 0 * * Sun"`
			`displayName: Weekly Perf Run`
Add full RPS matrix, and a pipeline to run it. (#1146) * Add full RPS matrix, and a pipeline to run it. Pipeline is manual only currently, and test suite likely needs more, but adding more is easy once this is going * Fix name to periodic, trigger the blank space group * fixup comments, add cron trigger * Fix yaml * Another yaml fix * Turn into full run matrix * Catch on missing old results * Expand timeout to 5 hours * Another timeout fix attempt * 1 more attempt at timeout fixes 2021-01-09 05:02:55 +03:00			`branches:`
			`include:`
			`- main`
			`always: true`

			`name: 0.$(Date:yyyy).$(Date:MM).$(DayOfMonth).$(Rev:rr).0`
			`stages:`

			`#`
			`# Builds`
			`#`

Automate user mode PGO (#3007) 2022-08-23 02:09:24 +03:00			`- stage: build_winuser_schannel`
			`displayName: Build Windows (Schannel)`
Add full RPS matrix, and a pipeline to run it. (#1146) * Add full RPS matrix, and a pipeline to run it. Pipeline is manual only currently, and test suite likely needs more, but adding more is easy once this is going * Fix name to periodic, trigger the blank space group * fixup comments, add cron trigger * Fix yaml * Another yaml fix * Turn into full run matrix * Catch on missing old results * Expand timeout to 5 hours * Another timeout fix attempt * 1 more attempt at timeout fixes 2021-01-09 05:02:55 +03:00			`dependsOn: []`
			`variables:`
			`runCodesignValidationInjection: false`
			`jobs:`
			`- template: ./templates/build-config-user.yml`
			`parameters:`
Automate user mode PGO (#3007) 2022-08-23 02:09:24 +03:00			`image: windows-latest`
Add full RPS matrix, and a pipeline to run it. (#1146) * Add full RPS matrix, and a pipeline to run it. Pipeline is manual only currently, and test suite likely needs more, but adding more is easy once this is going * Fix name to periodic, trigger the blank space group * fixup comments, add cron trigger * Fix yaml * Another yaml fix * Turn into full run matrix * Catch on missing old results * Expand timeout to 5 hours * Another timeout fix attempt * 1 more attempt at timeout fixes 2021-01-09 05:02:55 +03:00			`platform: windows`
			`arch: x64`
			`tls: schannel`
			`config: Release`
Refactor prepare-machine.ps1 (#2506) 2022-03-12 00:08:56 +03:00			`extraPrepareArgs: -DisableTest`
Automate user mode PGO (#3007) 2022-08-23 02:09:24 +03:00			`extraBuildArgs: -DisableTest -DisableTools -PGO`
Add full RPS matrix, and a pipeline to run it. (#1146) * Add full RPS matrix, and a pipeline to run it. Pipeline is manual only currently, and test suite likely needs more, but adding more is easy once this is going * Fix name to periodic, trigger the blank space group * fixup comments, add cron trigger * Fix yaml * Another yaml fix * Turn into full run matrix * Catch on missing old results * Expand timeout to 5 hours * Another timeout fix attempt * 1 more attempt at timeout fixes 2021-01-09 05:02:55 +03:00
Add PGO support for OpenSSL (#3014) * Add PGO support for OpenSSL * Don't run TCP perf tests during PGO runs. * Use the build name in the branch. 2022-08-26 22:29:55 +03:00			`- stage: build_winuser_openssl`
			`displayName: Build Windows (OpenSSL)`
			`dependsOn: []`
			`variables:`
			`runCodesignValidationInjection: false`
			`jobs:`
			`- template: ./templates/build-config-user.yml`
			`parameters:`
			`image: windows-latest`
			`platform: windows`
			`arch: x64`
			`tls: openssl`
			`config: Release`
			`extraPrepareArgs: -DisableTest`
			`extraBuildArgs: -DisableTest -DisableTools -PGO`

Automate PGO for Shared EC and XDP (#3024) 2022-08-28 23:47:59 +03:00			`- stage: build_winuser_xdp`
			`displayName: Build Windows (XDP)`
			`dependsOn: []`
			`variables:`
			`runCodesignValidationInjection: false`
			`jobs:`
			`- template: ./templates/build-config-user.yml`
			`parameters:`
			`image: windows-latest`
			`platform: windows`
			`arch: x64`
			`tls: schannel`
			`config: Release`
			`extraName: 'xdp'`
			`extraPrepareArgs: -DisableTest -InstallXdpSdk`
			`extraBuildArgs: -DisableTest -DisableTools -UseXdp -ExtraArtifactDir Xdp -PGO`

Add full RPS matrix, and a pipeline to run it. (#1146) * Add full RPS matrix, and a pipeline to run it. Pipeline is manual only currently, and test suite likely needs more, but adding more is easy once this is going * Fix name to periodic, trigger the blank space group * fixup comments, add cron trigger * Fix yaml * Another yaml fix * Turn into full run matrix * Catch on missing old results * Expand timeout to 5 hours * Another timeout fix attempt * 1 more attempt at timeout fixes 2021-01-09 05:02:55 +03:00			`#`
			`# Performance Tests`
			`#`

Automate user mode PGO (#3007) 2022-08-23 02:09:24 +03:00			`- stage: perf_winuser_schannel`
			`displayName: Performance Testing Windows (Schannel)`
Add full RPS matrix, and a pipeline to run it. (#1146) * Add full RPS matrix, and a pipeline to run it. Pipeline is manual only currently, and test suite likely needs more, but adding more is easy once this is going * Fix name to periodic, trigger the blank space group * fixup comments, add cron trigger * Fix yaml * Another yaml fix * Turn into full run matrix * Catch on missing old results * Expand timeout to 5 hours * Another timeout fix attempt * 1 more attempt at timeout fixes 2021-01-09 05:02:55 +03:00			`dependsOn:`
Automate user mode PGO (#3007) 2022-08-23 02:09:24 +03:00			`- build_winuser_schannel`
Add full RPS matrix, and a pipeline to run it. (#1146) * Add full RPS matrix, and a pipeline to run it. Pipeline is manual only currently, and test suite likely needs more, but adding more is easy once this is going * Fix name to periodic, trigger the blank space group * fixup comments, add cron trigger * Fix yaml * Another yaml fix * Turn into full run matrix * Catch on missing old results * Expand timeout to 5 hours * Another timeout fix attempt * 1 more attempt at timeout fixes 2021-01-09 05:02:55 +03:00			`jobs:`
			`- template: ./templates/run-performance.yml`
			`parameters:`
			`pool: MsQuic-Win-Perf`
			`platform: windows`
			`localTls: schannel`
			`remoteTls: schannel`
			`arch: x64`
Only run PGO weekly. Only use non-loopback results for PGO. (#3030) 2022-08-29 23:35:58 +03:00			`testTypes: Remote`
Automate user mode PGO (#3007) 2022-08-23 02:09:24 +03:00			`extraArgs: -PGO`
Add full RPS matrix, and a pipeline to run it. (#1146) * Add full RPS matrix, and a pipeline to run it. Pipeline is manual only currently, and test suite likely needs more, but adding more is easy once this is going * Fix name to periodic, trigger the blank space group * fixup comments, add cron trigger * Fix yaml * Another yaml fix * Turn into full run matrix * Catch on missing old results * Expand timeout to 5 hours * Another timeout fix attempt * 1 more attempt at timeout fixes 2021-01-09 05:02:55 +03:00			`failOnRegression: 0`
Publish results for periodic tests to performance dashboard (#1159) 2021-01-15 01:41:25 +03:00
Add PGO support for OpenSSL (#3014) * Add PGO support for OpenSSL * Don't run TCP perf tests during PGO runs. * Use the build name in the branch. 2022-08-26 22:29:55 +03:00			`- stage: perf_winuser_openssl`
			`displayName: Performance Testing Windows (OpenSSL)`
			`dependsOn:`
			`- build_winuser_openssl`
			`jobs:`
			`- template: ./templates/run-performance.yml`
			`parameters:`
			`pool: MsQuic-Win-Perf`
			`platform: windows`
			`localTls: openssl`
			`remoteTls: openssl`
			`arch: x64`
Only run PGO weekly. Only use non-loopback results for PGO. (#3030) 2022-08-29 23:35:58 +03:00			`testTypes: Remote`
Add PGO support for OpenSSL (#3014) * Add PGO support for OpenSSL * Don't run TCP perf tests during PGO runs. * Use the build name in the branch. 2022-08-26 22:29:55 +03:00			`extraArgs: -PGO`
			`failOnRegression: 0`

Automate PGO for Shared EC and XDP (#3024) 2022-08-28 23:47:59 +03:00			`- stage: perf_winuser_xdp`
			`displayName: Performance Testing Windows (XDP)`
			`dependsOn:`
			`- build_winuser_xdp`
			`jobs:`
			`- template: ./templates/run-performance.yml`
			`parameters:`
			`pool: MsQuic-Win-Perf`
			`platform: windows`
			`localTls: schannel`
			`remoteTls: schannel`
			`arch: x64`
			`extraArtifactDir: '_Xdp'`
App Controlled Execution Config (#3034) 2022-10-01 00:00:02 +03:00			`extraTestArgs: -ExtraArtifactDir _Xdp -XDP`
Automate PGO for Shared EC and XDP (#3024) 2022-08-28 23:47:59 +03:00			`testTypes: Remote`
App Controlled Execution Config (#3034) 2022-10-01 00:00:02 +03:00			`extraArgs: -PGO`
Automate PGO for Shared EC and XDP (#3024) 2022-08-28 23:47:59 +03:00			`failOnRegression: 0`

Automate user mode PGO (#3007) 2022-08-23 02:09:24 +03:00			`- stage: make_pull_request`
			`displayName: Make Pull Request`
Publish results for periodic tests to performance dashboard (#1159) 2021-01-15 01:41:25 +03:00			`dependsOn:`
Automate user mode PGO (#3007) 2022-08-23 02:09:24 +03:00			`- perf_winuser_schannel`
Add PGO support for OpenSSL (#3014) * Add PGO support for OpenSSL * Don't run TCP perf tests during PGO runs. * Use the build name in the branch. 2022-08-26 22:29:55 +03:00			`- perf_winuser_openssl`
Automate PGO for Shared EC and XDP (#3024) 2022-08-28 23:47:59 +03:00			`- perf_winuser_xdp`
Publish results for periodic tests to performance dashboard (#1159) 2021-01-15 01:41:25 +03:00			`jobs:`
Automate user mode PGO (#3007) 2022-08-23 02:09:24 +03:00			`- template: ./templates/make-pgo-pr.yml`