Граф коммитов

7601 Коммитов

Автор SHA1 Сообщение Дата
olkononenko fff7cf0bf4
Fix cachedump analyzer crash (#297) 2019-05-13 15:17:44 -07:00
dannyvv e94b88f7f4
Cleanup: Remove PipExecutionContext from InmemoryCache (#296) 2019-05-13 10:27:54 -07:00
Semih Okur a7a3bc2c0e
LogProcessStats now gets called in either successful or unsuccessful case (#291) 2019-05-13 09:59:54 -07:00
erickulcyk 5a68977027
Add priority field to transformer dsc files. This is part of the change to support mularchy and was missed in the previous change (#286) 2019-05-13 09:30:38 -07:00
Semih Okur 5615cf4fb0
Disable local cachemiss analysis in CloudBuild (#284) 2019-05-11 18:37:24 -07:00
CloudDev Build Account 4b6fdd2c5c New Public LKG 0.1.0-20190510.10 2019-05-11 20:46:58 +00:00
CloudDev Build Account fd40d9c707 New Internal LKG 0.1.0-20190510.8 2019-05-11 20:31:30 +00:00
CloudDev Build Account 1c7bd5ad6a New Internal LKG 0.1.0-20190510.10 2019-05-11 20:30:44 +00:00
Anirudh Santhiar 679d336bb5
Add an option to help support vsjit debugging with qtest (#288)
* Add an option to help support vsjit debugging with qtest

* Remove arguments that are not picked up from the build definition
2019-05-10 17:53:03 -07:00
Serge Mera de67ff1595
Proper handling of MSBuild projects which don't implement the target protocol (#293) 2019-05-10 15:26:34 -07:00
Huihui Nora Huang fc6a3670ac
Address comment from another PR (#294) 2019-05-10 15:13:51 -07:00
Aleksandar Milicevic 1acc262ee2
[macOS] Compile build tools to native (#285)
Additional tools compiled to native:

 - ResXPreprocessor
 - LogGen
 - TestProcess
 - OpNameGenerator
2019-05-10 14:28:19 -07:00
Huihui Nora Huang ed8e9626f9
Qtest untrack more (#290) 2019-05-10 11:42:14 -07:00
Serge Mera 4b2358816e
Stop using paths known to the graph as a safety net when deleting shared opaque outputs (#280) 2019-05-10 11:18:16 -07:00
Aleksandar Milicevic bee7ae7adc
[macOS] Fix a crash that happens when a process times out (#287)
Concretely:
  - in `UnSandboxedProcess`: when `m_processExecutor.WaitForExit()` ends up killing the underlying process because it exceeded its timeout, call `this.KillAsync()` to notify any subclasses that the process was killed.

AB#1528677
2019-05-10 10:41:52 -07:00
Kristijan Šimić a9b89b4452
Nuget Analyzer + Spec Generator Refactoring (#281)
* General Nuget package target framework support and spec generation reworked
2019-05-10 13:30:36 +02:00
Sergey Teplyakov a20df8073c
Preparational work for logging enhancements. (#276) 2019-05-09 09:43:20 -07:00
Huihui Nora Huang 9c58ae8805
Fix long path problem (#274) 2019-05-08 19:06:35 -07:00
Serge Mera 46f003a4a6
Ignore all predictions from malformed paths (#278) 2019-05-08 17:32:45 -07:00
Erik Mavrinac c1237c7726
Add documentation for the VSO-Hash algorithm (#275) 2019-05-08 14:28:03 -07:00
dannyvv ea4a18b427
Add multiple proto file support and a toggle for grpc to the proto/grpc sdk (#271) 2019-05-08 13:01:24 -07:00
dannyvv fecae174fb
Remove ChooseWorker dependency on Configuration (#273) 2019-05-08 12:52:17 -07:00
Huihui Nora Huang b09028c699
Separate the untrack argument to state it is Microsoft internal cloud service used only (#269)
Seperate the untrack argument and add comment
2019-05-08 11:16:31 -07:00
Serge Mera 5b82e8686b
Do not declare as input files predictions under output directories (#267) 2019-05-08 11:11:08 -07:00
Huihui Nora Huang 30ba5cd9d0
Untrack needed files for Qtest to upload test result (#268) 2019-05-08 08:56:10 -07:00
Huihui Nora Huang b0d384273f
Pass low privilege account and password to VM (#259)
1) Pass low privilege account and password to VM.
2) Enable propagation of privilege level from test sdk to transformer.execute.
2019-05-07 17:07:52 -07:00
Iman Narasamdya 27d4331cd6
Use FindFirstFile as a fallback in getting file attributes (#266)
Getting file attributes for probing file existence with GetFileAttributesW sometimes results in "access denied". This causes problem especially during file materialization. Because such a probe is interpreted as probing non-existent path, the materialization target is not deleted. However, cache, using .NET File.Exist, is able to determine that the file exists. Thus, cache refuses to materialize the file.

DominoMessage
| where PreciseTimeStamp >= ago(20d)
| where message contains "but cache decided it as"
| project PreciseTimeStamp-8h, RoleInstance, RelatedActivityId, message
This PR tries to address TryProbePathExistence to do the same as .NET File.Exist, i.e, call GetFileAttributesW first, and fall back to FindFirstFile.

One reason for fixing TryProbePathExistence is because it is used at many places in BuildXL codebase.
2019-05-07 16:11:52 -07:00
Huihui Nora Huang 99e5c2e541
Adding qTestContextInfo for qtest to upload test result to VSTS (#265)
* add qTestContextInfo flag

* change the qtest deployment path environmant variable name
2019-05-07 16:02:58 -07:00
Julián Bayardo 7ac7cf8c1d
Remove unspecified TRP warnings for projects without ProjectReferences (#256)
When an MSBuild project does not have any ProjectReferences, no warnings due to a missing Target Reference Protocol should be emitted.
2019-05-07 15:11:42 -07:00
Lance Collins 9b5ff34e1f
Start implementation of BuildXL VFS cas process. (#249)
* Start implementation of BuildXL VFS cas process. Currently just proxies to a backing content server. Next step is to actually add virtualization.

* PR feedback.

* Only VFS build on full framework.

* PR feedback.
2019-05-07 14:46:04 -07:00
Sergey Teplyakov 3c7e394ca7
Track build id via session's lifetime (#258)
* Track build id via session's lifetime

* Add test that build id survive service's restart

* Rename ExtractBuildId to TryExtractBuildId
2019-05-07 14:23:29 -07:00
dannyvv 563913e590
Don't use external feeds for internal builds (#264) 2019-05-07 14:20:29 -07:00
dannyvv 0a6c226e0f
Move some scheduler classes to their own file. (#263) 2019-05-07 14:05:41 -07:00
Semih Okur d1c8ec8d5e
Update RocksDbNative to 6.0.1 (#255) 2019-05-07 13:06:45 -07:00
dannyvv 7f7780ce5c
Minor code cleanup (#262) 2019-05-07 12:12:18 -07:00
Aleksandar Milicevic 500b128685
[macOS] Use 'dependsOnCurrentHostOSDirectories' for tool definitions (#260) 2019-05-07 09:14:19 -07:00
Aleksandar Milicevic beda61108b
[macOS] CoreRT native compilation for select projects targeting osx (#254)
SDKs for CoreRT native compilation on macOS.

For now, only AppHostPatcher is compiled to native (and that executable is subsequently used to patch binaries throughout the rest of the build).

Future PRs can enable compiling other executables to native.
2019-05-07 08:22:42 -07:00
Sergey Teplyakov 4704a0e6a6
Make key vault settings optional for LLS in order to use CSS. (#257)
* Make key vault settings optional for LLS in order to use CSS.

* Use nameof
2019-05-06 17:17:13 -07:00
Kevin Bazan Williams cccbac4420
Enable distributed copies on BuildXL builds on macOS (#253)
Enable distributed copies on BuildXL builds on macOS
2019-05-06 15:40:48 -07:00
Iman Narasamdya b40a6d837d
Hook up mechanism for running pip in VM (#251)
In this change we hook up the mechanism for running pip in VM.

Interaction with VM is via so-called VmCommandProxy, which is provided by CB team. Instead of calling the methods of VmCommandProxy, we launch VmCommandProxy executable with specific commands. In this way, we don't need to be bound by the .NET framework used by VmCommandProxy.

Currently, VM initialization requires username/password because it has to create a drive map from the VM back to the host. This will change soon. The changes in this PR will enable us to test running pip in VM in the CI/CBTest environment.
2019-05-06 11:44:01 -07:00
Semih Okur b14210f123
Increase WorkerAttachTimeout to 45min from 30min (#252) 2019-05-06 10:56:26 -07:00
CloudDev Build Account 7e10dddf6f New Public LKG 0.1.0-20190503.9 2019-05-04 21:06:06 +00:00
CloudDev Build Account babd8ae540 New Internal LKG 0.1.0-20190503.9 2019-05-04 20:30:53 +00:00
Serge Mera f1c59914db
Add missing double write policy on DScript side (#242) 2019-05-03 17:08:50 -07:00
erickulcyk 2833395ede
Add support for pip priority field and schedule according to pip priority as well as historic data. (#239)
Add priority field to pips, which allow some pips to be scheduled before others.  Change scheduling so pip priority field takes precedence and critical path/historic priority changes the priority within the same pip priority.
2019-05-03 16:39:39 -07:00
Sergey Teplyakov 5148433488
Telemetry improvements for EH client and FileSystemContentStore (#233)
* Trace retryable errors in EventHub client

* Trace lock acquisition duration in FileSystemContentStore.

* Remove unnecessary using.

* Repurposed ResultBase.Diagnostics field for success case

* Fix contract violation

* Removed local

* Tracing improvements
2019-05-03 15:46:37 -07:00
Semih Okur e5091ebdaa
ExecutionLog events are now processed asynchronously on master (#248) 2019-05-03 15:29:54 -07:00
Julián Bayardo 76ac3c9fb7
Avoid using and killing VBCSCompiler.exe (#245)
* Avoid using and killing VBCSCompiler.exe

* Remove unneeded property addition (already added earlier in the method)
2019-05-03 13:57:31 -07:00
CloudDev Build Account 015931e495 New Internal LKG 0.1.0-20190502.3 2019-05-03 20:30:51 +00:00
Aleksandar Milicevic 5f7dc9d914
Delete obsolete script (#247) 2019-05-03 09:28:31 -07:00