Граф коммитов

7503 Коммитов

Автор SHA1 Сообщение Дата
Sahiti Chandramouli 40f3553c36 Merged PR 782791: Use GITHUB_USER env var to capture UserName for Codespaces
Use GITHUB_USER env var to capture UserName for Codespaces.
Added an Engine Based test to test the three cases - custom value, ADO, codespaces.
Added a smaller unit test to specifically check the functionality of GetUserName.

Related work items: #2169835
2024-05-02 21:34:19 +00:00
Marcelo Lynch 🧉 c63a66fafa Merged PR 782587: [Linux sandbox] Do not check accesses when the provided paths can't be normalized
[Linux sandbox] Do not check accesses when the provided paths can't be normalized
2024-05-01 21:05:42 +00:00
Marcelo Lynch 🧉 8d0ddf1f9f Merged PR 782414: [Linux sandbox / refactor] Handle null values and non-file paths in interposed functions
Two fixes:

1) The new SandboxEvent constructors take `std::string&` as parameters but the lib functions pass `char*`s. If a tool passes null for a `char*`, the runtime crashes because it won't allow that implicit construction. We need to handle this gracefully because the tools can pass whatever to the libc functions we interpose. The fix is to create a special `SandboxEvent::Invalid` in these cases that we then ignore

2) We shouldn't report paths that are non-files. Add a check for this in `ResolveEventPaths`, which will report that the path isn't a file so we can ignore it
2024-04-30 23:49:34 +00:00
Serge Mera 7b08c24046 Merged PR 782403: Refine logging ReceivedReportFromUnknownPid to avoid synthetic accesses
All occurrences of ReceivedReportFromUnknownPid from 1JS in the last week was about synthetic accesses (process requires ptrace, first allow write check in process). Let's not log in that case, we send these from native side before the process start event, and they are not real accesses in the end.

I'll check again in a week if that makes ReceivedReportFromUnknownPid reach 0, and in that case I'll turn it into a warning.
2024-04-30 22:52:25 +00:00
BuildXL-Pipelines d65c68fb9c Merge pull request 782350 from dev/BuildXL/updatelkg-0.1.0-20240426.5.1-2024-04-30T18-06-19 into main 2024-04-30 20:32:33 +00:00
Serge Mera ee8fe10deb Merged PR 782322: Revert the Lage builder to stop producing an error file
Revert the Lage builder to stop producing an error file. This change produced a DFA on office devmain (the lage graph builder is used directly as a tool in that codebase). Will roll forward again in a way that doesn't produce breaks.
2024-04-30 16:55:03 +00:00
Pasindu Gunasekara 🍣 23e97d3853 Merged PR 782200: Handle non-existent paths with getcap 2024-04-30 00:07:08 +00:00
BuildXL-Pipelines 79227c172b Merge pull request 782075 from dev/BuildXL/updatenotice-2024-04-29T16-08-11 into main 2024-04-29 21:43:27 +00:00
Sahiti Chandramouli daba9a9c41 Merged PR 782102: Disallow the use of phase:Evaluate for the users.
Disallow the use of phase:Evaluate for the users by throwing a command line argument error.
Customers are suggested to use the Schedule phase instead.

![Screenshot (20).png](https://dev.azure.com/mseng/9ed2c125-1cd5-4a17-886b-9d267f3a5fab/_apis/git/repositories/50d331c7-ea65-45eb-833f-0303c6c2387e/pullRequests/782102/attachments/Screenshot%20%2820%29.png)

Related work items: #2166157
2024-04-29 20:09:57 +00:00
Iman Narasamdya dd114c556b Merged PR 781966: Attempt to make Linux XUnit test more robust
The following changes seem to make XUnit tests in rolling pipeline more robust from timeout processes:
- Split unit tests into smaller pips.
- Use XUnit default synchronization context restriction
- Use XUnit default RunTestCaseAsync.

The following builds show this robustness:
https://dev.azure.com/mseng/Domino/_build/results?buildId=27965406&view=results
https://dev.azure.com/mseng/Domino/_build/results?buildId=27965405&view=results
https://dev.azure.com/mseng/Domino/_build/results?buildId=27965038&view=results
https://dev.azure.com/mseng/Domino/_build/results?buildId=27964520&view=results

Plus: some fix on UTs' attributes
2024-04-29 16:37:41 +00:00
BuildXL-Pipelines bf1263e2f5 Merge pull request 781984 from dev/BuildXL/updatelkg-0.1.0-20240426.5-2024-04-28T05-01-01 into main 2024-04-28 05:23:10 +00:00
Qi Wang cba37d61fc Merged PR 781947: Rename linux stages template yml
Rename linux stages template yml
2024-04-27 00:29:34 +00:00
Serge Mera ca49e9c958 Merged PR 781846: Add support for rush-build-graph-plugin
Add support for rush-build-graph-plugin

Related work items: #2160055
2024-04-26 23:11:13 +00:00
BuildXL-Pipelines 2f32fc98ae Merge pull request 781919 from dev/BuildXL/updatelkg-0.1.0-20240425.3-2024-04-26T21-57-26 into main 2024-04-26 22:17:11 +00:00
Sahiti Chandramouli d974ba0413 Merged PR 781201: Make ToolPath non-mandatory in Allowlist.
Remove the condition where customers need to pass this parameter in the AllowList entries.
Reused two unit tests which test this feature.
Had to define a comparer for comparing SerializableRegex objects since it was becoming an issue when using the MultiValueDictionary to extract elements.

Related work items: #2139864
2024-04-26 22:16:52 +00:00
Marcelo Lynch 🧉 2d51e866a5 Merged PR 781882: Revert "Merged PR 776212: Refactor Linux sandbox to use new Create/ReportAccess functions in BxlObserver"
Revert "Merged PR 776212: Refactor Linux sandbox to use new Create/ReportAccess functions in BxlObserver"

This reverts commit 57a1f151d8.
2024-04-26 20:53:36 +00:00
Qi Wang 7983e2242e Merged PR 781449: Add Linux PR Validation run on Ubuntu 22.04
Add a yml for Linux PR Validation run on Ubuntu 22.04 image. I make the Pool a parameter and move the stages into a template.
2024-04-26 20:11:24 +00:00
Iman Narasamdya 4d94c6f77f Merged PR 781712: Release notes for 0.1.0-20240419.10
Release notes for 0.1.0-20240419.10
2024-04-25 22:37:07 +00:00
Serge Mera 95c3714d18 Merged PR 781667: Implement TryGetFinalPathNameByPath on Linux and add tests
Linux implementation was missing. Existing tests were not actually exercising this because on Linux we don't send absent probes that later become present (we might hit this still when there is a race between 2 pips). Added lower-level tests to cover the reparse point resolver component itself.

Related work items: #2170566
2024-04-25 22:24:18 +00:00
Pasindu Gunasekara 🍣 a0125cc783 Merged PR 781483: Add support for clone3 to PTraceSandbox
- Observed on odsp web builds
2024-04-25 22:12:19 +00:00
Iman Narasamdya 8486f056ce Merged PR 781231: Only run compliance build in PR validation
This PR makes us enable compliance build only in Linux PR validation.

Ideally, we should only enable source analyses in the rolling pipeline. However, because our rolling pipeline contains CB builds, SDL source analyses are all disabled, in favor of the CB compliance build. Unfortunately, some analyses, like policheck, do not work in network isolation when building in CB.

SDL source analyses typically take 2.5-4 minutes, and should not be in the critical path of this Linux pipeline run.
2024-04-25 21:27:14 +00:00
Marcelo Lynch 🧉 196242c02a Merged PR 781391: [Linux sandbox] Remove audit library
We have turned off this by default a long time ago. Removing it as part of the sandbox cleanup
2024-04-24 20:15:07 +00:00
Marcelo Lynch 🧉 57a1f151d8 Merged PR 776212: Refactor Linux sandbox to use new Create/ReportAccess functions in BxlObserver
Replace all calls of `create_access_*` and `report_access_*` with the new `SandboxEvent` + `CreateAccess` abstractions
2024-04-24 18:19:48 +00:00
Michael Pysson 1124658d7d Merged PR 780952: Bug fix for disabling server mode by default in ADO builds
There was a bug in !777896 where that didn't apply to the light config. So in practice it didn't do anything. This brings the light config to parity with the real one as well as adds unit tests to ensure their infra defaults evaluate to the same thing.
2024-04-23 23:18:56 +00:00
Paul Ming 89a60c4fd1 Merged PR 781085: Update CB.QTest package for redacting JWTs in test case names in logging
Update CB.QTest package for redacting JWTs in test case names in logging

Using package from release https://mseng.visualstudio.com/Domino/_releaseProgress?_a=release-pipeline-progress&releaseId=377378

Related work items: #2156881
2024-04-23 21:48:47 +00:00
Marcelo Lynch 🧉 1e2099c8c3 Merged PR 781114: Use O_NOFOLLOW when normalizing paths passed to realpath to report probes on them
We want to report a probe on the nominal path, without resolving symlinks. Note that the probe is redundant in the case where the path does exist. Also fix a test which depended on the wrong behavior
2024-04-23 20:24:30 +00:00
BuildXL-Pipelines 956b80396b Merge pull request 780893 from dev/BuildXL/updatepackages-2024-04-22T20-44-55 into main 2024-04-23 16:29:22 +00:00
Iman Narasamdya a066593402 Merged PR 780908: New LKG 0.1.0-20240419.10
New LKG 0.1.0-20240419.10

[skip ci]
2024-04-22 21:54:40 +00:00
Pasindu Gunasekara 🍣 d22d0643b6 Merged PR 780840: Fix path in set-variable-pats.yml
- If we checkout multiple repos, then this task tries to resolve this path against $(Build.SourcesDirectory) instead of $(Build.SourcesDirectory)/BuildXL.Internal
2024-04-22 20:06:42 +00:00
Julian Bayardo 2a88876433 Merged PR 780655: Upgrade RocksDbSharp to 8.1.1-20240419.2 2024-04-22 18:00:12 +00:00
Semih Okur cc003dbbc1 Merged PR 780460: Update the message for ProblematicWorkers due to the synchronization
Update the message for ProblematicWorkers due to the synchronization
2024-04-20 01:54:09 +00:00
Michael Pysson 23456174de Merged PR 780713: Unreference secret variable groups
These pipelines no longer need this variable group
2024-04-20 00:08:35 +00:00
Semih Okur 73335a7874 Merged PR 780633: Fix cases where we silently fail some remote pips
In some timed-out builds, we see that the orchestrator times out by waiting for some remote pips. However, the pip build request has never been sent to the worker. It somehow got lost in RemoteWorker logic. I'm trying to find those cases where the pip build request is just not sent to the worker.

an example build: https://cloudbuild.microsoft.com/build/7fb02f46-7d47-ee25-c10b-4fd74bb0f483
2024-04-19 22:41:51 +00:00
Semih Okur 48499040af Merged PR 780664: Enable remote pip timeout feature as an option
Enable remote pip timeout feature as an option. I know that we have a problem in the past, so I want to experiment it in some test queues before enabling it by default.
2024-04-19 22:32:04 +00:00
Qi Wang a6501a637f Merged PR 778027: Catch consolenotconnected exception and exit buildxl
Catch the exception thrown from StandardConsole and exit the buildxl process
All exceptions are thrown after we adjust cursor position and write blank text for overwriting. Add a check before adjusting the cursor to make sure current console is overwritable.

Related work items: #2138734
2024-04-19 22:27:40 +00:00
Pasindu Gunasekara 🍣 503b6c16e3 Merged PR 780598: Remove PAT usage in maintenance pipeline 2024-04-19 17:25:27 +00:00
Qi Wang 4a39d74d9d Merged PR 780206: Use system.accesstoken for mseng git pat
use system access token
2024-04-19 00:57:45 +00:00
Marcelo Lynch 🧉 d577781b72 Merged PR 780182: Avoid NRE in PipExecutor.TryCheckProcessRunnableFromCacheAsync
Avoid NRE in PipExecutor.TryCheckProcessRunnableFromCacheAsync

Related work items: #2169564
2024-04-18 23:17:30 +00:00
CloudDev Build Account a0cb4027b1 New LKG 0.1.0-20240417.11
[skip ci]
2024-04-18 19:19:59 +00:00
Semih Okur 6072036d98 Merged PR 780205: Fix hanging when the scheduler is early-terminated with the internal error
When the scheduler is early-terminated due to an internal error, the workers that are released early can hinder the scheduler's shutdown, potentially causing the build to stall. Although the orchestrator receives results from these workers, the tasks assigned to the early-released workers cannot be completed if the scheduler on the orchestrator has already finished. Therefore, it is necessary to manually finalize the 'DrainCompletion' task sources for each worker.

Related work items: #2169589
2024-04-18 17:49:26 +00:00
Semih Okur 55cfaa43ba Merged PR 780257: Retry the failed pips which we failed to receive the error log
When we do not receive the error message for the failed pips due to several reasons (worker connection issue, etc.), we fail the pip. The failure might be related to the worker issues. That's why, we should retry the pip instead of failing the build. Those builds were tagged as ProblematicWorkerExit.DistributionPipFailedOnWorker

An example build: https://cloudbuild.microsoft.com/build/697e8d4a-2f1e-a3d2-fe66-7d7e25fcfd01
2024-04-18 17:43:28 +00:00
TSEBuild 07a0c039c2 Merge pull request 780209 from dev/BuildXL/updatenotice-2024-04-17T22-56-01 into main 2024-04-18 17:06:23 +00:00
Sahiti Chandramouli 551e54ec49 Merged PR 780244: Upgrade MSVC version for internal builds
Upgrade MSVC version for internal builds

Related work items: #2170171
2024-04-18 17:01:26 +00:00
Michael Pysson 5da5d46c6c Merged PR 780391: Remove agent pool image overrides
This is no longer necessary as the machine pool uses this image by default
2024-04-18 16:57:26 +00:00
Serge Mera 5b7e90d0ee Merged PR 780243: Deprecate /cacheLogToKusto
All clients using /logToKusto are already using /cacheLogToKusto. Deprecate the latter and make /logToKusto send telemetry for both bxl and the cache.

Related work items: #2166630
2024-04-18 15:56:28 +00:00
Sahiti Chandramouli 6a27cbca93 Merged PR 780198: Add new baseline file for Binskim violation
Add new baseline file, after resolving all the violations related to MSVC version.

Related work items: #2169057
2024-04-17 23:32:31 +00:00
Pasindu Gunasekara 🍣 643615767f Merged PR 780180: Use ADO library for GitHub secrets
- Moves the github deploykey out of the keyvault into a pipeline variable group

Related work items: #2169865
2024-04-17 22:00:57 +00:00
Sahiti Chandramouli 8051b1f861 Merged PR 780158: Changes to upgrade MSVC version and resolve c-style casts errors
Need to update MSVC version to 14.39.33519 to ensure that the runtime binaries are compiled with the /ZH:SHA256 flag.

If this is not done, it will keep picking up the old version which 14.29.30133

Before:
https://dev.azure.com/mseng/Domino/_build/results?buildId=27818778&view=logs&j=ac0a85a6-02a9-5058-229a-2b15404be380&t=795dfba3-3fa9-52fc-ce81-dba976734c4e&l=65

After:
https://dev.azure.com/mseng/Domino/_build/results?buildId=27824324&view=logs&j=ac0a85a6-02a9-5058-229a-2b15404be380&t=795dfba3-3fa9-52fc-ce81-dba976734c4e&l=65

This PR also includes some of the changes to resolve c-style casts errors, which have been caused due to the upgrade

Related work items: #2169518
2024-04-17 21:40:34 +00:00
Marcelo Lynch 🧉 3e82f17e7c Merged PR 780125: Use Build.RequestedFor as UserName in ADO build telemetry
Use Build.RequestedFor as UserName in ADO builds
2024-04-17 21:18:12 +00:00
Serge Mera 51ea0c743e Merged PR 780164: Updated Release-Notes.md
Updated Release-Notes.md
2024-04-17 20:57:07 +00:00