Microsoft Build Accelerator
Перейти к файлу
Iman Narasamdya dbbcb47695 Merged PR 523144: Improve cache miss analysis presentation
This is the first phase of giving more love to cache miss analysis: improving the analysis presentation.

The current presentation has the following issues:
- Analysis outputs are hard to understand, and look cryptic.
- Cache miss analysis relies on a buggy third-party algorithm that can spit out a lot of irrelevant outputs.
- Analysis of weak fingerprint do not respect order-independent entries.
- Etc.

The new presentation is still Json based and is similar to (but more refined than) the legacy cache miss analysis (which customers like).

Example of new presentation (for mismatched strong fingerprints):
```
{
    "StrongFingerprint": {
        "Old": "471383773F3C19EAC1F4EF4DDD496E2076428406",
        "New": "FA15D762D7BFE52570BDFC070917B4103E0EE713"
    },
    "Paths": {
        "Changed": {
            "b:\\out\\objects\\7\\0\\907noclwl174l942adk4eeeedjrh2a\\t_1\\fingerprints73945ac\\0\\obj\\readonly\\src_0": {
                "Old": "AccessType: DirectoryEnumeration | Hash: 3100D2E3F4",
                "New": "AccessType: DirectoryEnumeration | Hash: C675A28412",
                "Members": {
                    "Added": [
                        "src_3",
                        "src_4"
                    ]
                }
            }
        }
    }
}
```

The old presentation is preserved because some customer (namely Eric) relies on the old format.

Related work items: #1520132, #1567602, #1572558
2019-12-10 23:59:22 +00:00
.vscode Recommend the BuildXL extension when people look for extensions (#782) 2019-08-21 14:41:03 -07:00
Documentation Merged PR 523144: Improve cache miss analysis presentation 2019-12-10 23:59:22 +00:00
Examples [kext] handle check_vnode_clone (#1065) 2019-10-18 15:19:38 -07:00
Private Merged PR 523769: Update NodeJs to v12.13.1 2019-12-10 22:49:25 +00:00
Public Merged PR 523144: Improve cache miss analysis presentation 2019-12-10 23:59:22 +00:00
Shared Merged PR 523227: Reviving buddy build for BuildXL selfhost 2019-12-09 22:37:52 +00:00
cg Merged PR 523769: Update NodeJs to v12.13.1 2019-12-10 22:49:25 +00:00
third_party Initial sync 2019-03-28 15:35:49 -07:00
.editorconfig Improve cached graph log readability (#1217) 2019-11-19 09:30:43 -08:00
.gitattributes Initial commit for the sandbox client and server 2018-11-06 15:01:51 -08:00
.gitignore VS solution generator: support for multiple target frameworks (#853) 2019-09-10 13:10:51 -07:00
BuildCache.cmd Initial sync 2019-03-28 15:35:49 -07:00
BuildCacheDefault.json Initial sync 2019-03-28 15:35:49 -07:00
BuildCacheDefaultNetCore.json Initial sync 2019-03-28 15:35:49 -07:00
BuildCacheOverride.json Initial sync 2019-03-28 15:35:49 -07:00
CODEOWNERS Adding Code owners (#133) 2019-04-11 19:23:06 -07:00
CODE_OF_CONDUCT.md Add CODE_OF_CONDUCT.md document (#765) 2019-08-19 16:56:06 -07:00
CONTRIBUTING.md Documentation updates (#1071) 2019-10-22 16:49:55 -07:00
CreatePr.cmd Merged PR 521990: Update CreatePr Script to work with Azure DevOps again 2019-12-02 20:02:16 +00:00
LICENSE Restoring licence file 2019-04-09 16:12:01 -07:00
README.md Fix a typo in README.md 2019-11-27 22:10:53 +00:00
RunCheckInTests-Test.cmd Initial sync 2019-03-28 15:35:49 -07:00
RunCheckInTests.cmd Merged PR 523103: Curb RunCheckInTests /partB 2019-12-06 20:59:42 +00:00
RunCheckInTestsWithPAT.ps1 Nuget Credential Provider Auth Fix (#1087) 2019-10-30 11:34:42 -07:00
SECURITY.md Add Security.md document (#763) 2019-08-19 15:47:52 -07:00
SlimBuildForMacTests.cmd Initial sync 2019-03-28 15:35:49 -07:00
buddy.cmd Merged PR 523227: Reviving buddy build for BuildXL selfhost 2019-12-09 22:37:52 +00:00
bxl.cmd Initial sync 2019-03-28 15:35:49 -07:00
bxl.sh Release FileAccessMemory after starting the process (#1182) 2019-11-09 15:44:29 -08:00
clean.bat Initial sync 2019-03-28 15:35:49 -07:00
config.dsc Merged PR 523769: Update NodeJs to v12.13.1 2019-12-10 22:49:25 +00:00
config.microsoftInternal.dsc Merged PR 523769: Update NodeJs to v12.13.1 2019-12-10 22:49:25 +00:00
config.nuget.aspNetCore.dsc Upgraded ASP .NET IIS nuget to remove cg vulnerability (#985) 2019-10-02 15:48:17 -07:00
config.nuget.vssdk.dsc Initial sync 2019-03-28 15:35:49 -07:00
domino.cmd Initial sync 2019-03-28 15:35:49 -07:00
drop.cmd Optimizations for office mularchy builds: (#957) 2019-10-01 07:29:08 -07:00
dropout.cmd Initial sync 2019-03-28 15:35:49 -07:00
macos.mounts.dsc Initial sync 2019-03-28 15:35:49 -07:00

README.md

Microsoft Build Accelerator

BuildXL Icon

Introduction

Build Accelerator, BuildXL for short, is a build engine originally developed for large internal teams at Microsoft, and owned by the Tools for Software Engineers team, part of the Microsoft One Engineering System internal engineering group. Internally at Microsoft, BuildXL runs 30,000+ builds per day on monorepo codebases up to a half-terabyte in size with a half-million process executions per build, using distribution to thousands of data center machines and petabytes of source code, package, and build output caching. Thousands of developers use BuildXL on their desktops for faster builds even on mega-sized codebases.

BuildXL accelerates multiple build languages, including:

  • MSBuild (using new features under development in MSBuild 16 which will ship in future versions of Visual Studio 2019 and the .NET Core SDK)
  • CMake (under development)
  • Its own internal scripting language, DScript, an experimental TypeScript based format used as an intermediate language by a small number of teams inside Microsoft

BuildXL has a command-line interface. There are currently no plans to integrate it into Visual Studio. The project is open source in the spirit of transparency of our engineering system. You may find our technology useful if you face similar issues of scale. Note that BuildXL is not intended as a replacement for MSBuild or to indicate any future direction of build languages from Microsoft.

Documentation

The BuildXL documentation main page is here.

Examples and Demos

See the Examples/ folder for basic project examples. See the Demos page for information about various technical demos like using the process sandboxing code.

Building the Code

Build Status - Azure DevOps Pipelines

Build status

Command Line Build and Test

See the Developer Guide for instructions on compiling BuildXL.

Contributing

See CONTRIBUTING.