15 KiB
Contributing to Scalar
Thank you for taking the time to contribute!
- Contributor License Agreement
- Code of Conduct
- Building Scalar on Windows
- Building Scalar on Mac
- Design Reviews
- Platform Specific Code
- Tracing and Logging
- Error Handling
- Background Threads
- Coding Conventions
- Testing
Contributor License Agreement
This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.microsoft.com.
When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repositories using our CLA.
Code of Conduct
This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.
Building Scalar on Windows
If you'd like to build your own Scalar Windows installer:
- Install Visual Studio 2019 Community Edition or higher (https://www.visualstudio.com/downloads/).
- Include the following workloads:
- .NET Core cross-platform development
- Include the following additional components:
- .NET Core runtime
- Include the following workloads:
- Install the .NET Core 3.0 SDK (https://dotnet.microsoft.com/download/dotnet-core/3.0)
- Clone using
git clone https://github.com/microsoft/scalar scalar/src
. Thesrc
directory will be the "repo root" and some sibling directories are created in the build process. - Run
Scripts\BuildScalarForWindows.bat
- You can also build in Visual Studio by opening
Scalar.sln
(do not upgrade any projects) and building. However, the very first build will fail, and the second and subsequent builds will succeed. This is because the build requires a prebuild code generation step. For details, see the build script in the previous step.
Visual Studio 2019 will automatically prompt you to install these dependencies when you open the solution.
The installer can now be found at <repo root>\..\out\Scalar.Installer.Windows\dist\[Debug|Release]\Scalar\SetupScalar.0.2.173.2.exe
.
Be sure to also install the latest Git for Windows installer at <repo root>\..\out\Scalar.Installer.Windows\dist\[Debug|Release]\Git\Git-<version>.exe
.
Building Scalar on Mac
-
Install Visual Studio for Mac . (This will also install the
dotnet
CLI). -
If you still do not have the
dotnet
cli>= v3.0
installed, then manually install it. You can check what version you have withdotnet --version
. -
Clone using
git clone https://github.com/microsoft/scalar scalar/src
. Thesrc
directory will be the "repo root" and some sibling directories are created in the build process. -
Run the build and installation scripts:
cd Scripts/Mac ./BuildScalarForMac.sh ./CreateScalarDistribution.sh cd ../../../out/Scalar.Distribution.Mac/dist/(Debug|Release)/ ./InstallScalar.sh
Design Reviews
Architectural changes and new features should start with a design review. It's easier and wastes less time to incorporate feedback at this stage.
The design review process is as follows:
- Create a pull request that contains a design document in Markdown (.md) format for the proposed change. Assign the
design-doc
label to the pull request. - Use the pull request for design feedback and for iterating on the design.
- Once the design is approved, create a new issue with a description that includes the final design document. Include a link to the pull request that was used for discussion.
- Close (without merging!) the pull request used for the design discussion.
Platform Specific Code
-
Prefer cross-platform code to platform-specific code
Cross-platform code is more easily reused. Reusing code reduces the amount of code that must be written, tested, and maintained.
-
Platform specific code, and only platform specific code, should go in
ScalarPlatform
When platform specific code is required, it should be placed in
ScalarPlatform
or one of the platforms it contains.
Tracing and Logging
-
The "Error" logging level is reserved for non-retryable errors that result in I/O failures or the Scalar process shutting down
The expectation from our customers is that when Scalar logs an "Error" level message in its log file either:
- Scalar had to shut down unexpectedly
- Scalar encountered an issue severe enough that user-initiated I/O would fail.
-
Log full exception stacks
Full exception stacks (i.e.
Exception.ToString
) provide more details than the exception message alone (Exception.Message
). Full exception stacks make root-causing issues easier. -
Do not display full exception stacks to users
Exception call stacks are not usually actionable for the user. Users frequently (sometimes incorrectly) assume that Scalar has crashed when shown a full stack. The full stack should be included in Scalar logs, but should not be displayed as part of the error message provided to the user.
-
Include relevant details when logging exceptions
Sometimes an exception call stack alone is not enough to root cause failures in Scalar. When catching (or throwing) exceptions, log relevant details that will help diagnose the issue. As a general rule, the closer an exception is caught to where it's thrown, the more relevant details there will be to log.
Example:
catch (Exception e) { EventMetadata metadata = new EventMetadata(); metadata.Add("Area", "Upgrade"); metadata.Add(nameof(packageVersion), packageVersion); metadata.Add(nameof(packageName), packageName); metadata.Add("Exception", e.ToString()); context.Tracer.RelatedError(metadata, $"Failed to compare {packageName} version"); }
Error Handling
-
Fail fast: An error or exception that risks data loss or corruption should shut down Scalar immediately
Preventing data loss and repository corruption is critical. If an error or exception occurs that could lead to data loss, it's better to shut down Scalar than risk corruption.
-
Do not catch exceptions that are indicative of a programmer error (e.g.
ArgumentNullException
)Any exceptions that result from programmer error (e.g.
ArgumentNullException
) should be discovered as early in the development process as possible. Avoidcatch
statements that would hide these errors (e.g.catch(Exception)
).The only exception to this rule is for unhandled exceptions in background threads
-
Do not use exceptions for normal control flow
Prefer writing code that does not throw exceptions. The
TryXXX
pattern, for example, avoids the performance costs that come with using exceptions. Additionally, Scalar typically needs to know exactly where errors occur and handle the errors there. TheTryXXX
pattern helps ensure errors are handled in that fashion.Example: Handle errors where they occur (good):
bool TryDoWorkOnDisk(string fileContents, out string error) { if (!TryCreateReadConfig()) { error = "Failed to read config file"; return false; } if (!TryCreateTempFile(fileContents)) { error = "Failed to create temp file"; return false; } if (!TryRenameTempFile()) { error = "Failed to rename temp file"; if (!TryDeleteTempFile()) { error += ", and failed to cleanup temp file"; } return false; } error = null; return true; }
Example: Handle errors in
catch
without knowing where they came from (bad):bool TryDoWorkOnDisk(string fileContents, out string error) { try { CreateReadConfig(); CreateTempFile(fileContents); RenameTempFile(); } catch (Exception ex) when (ex is IOException || ex is UnauthorizedAccessException) { error = "Something went wrong doing work on disk"; try { if (TempFileExists()) { DeleteTempFile(); } } catch (Exception e) when (e is IOException || e is UnauthorizedAccessException) { error += ", and failed to cleanup temp file"; } return false; } error = null; return true; }
-
Provide the user with user-actionable messages whenever possible
Don't tell a user what went wrong. Help the user fix the problem.
Example:
"You can only specify --hydrate if the repository is mounted. Run 'scalar mount' and try again."
Background Threads
-
Avoid using the thread pool (and avoid using async)
HttpRequestor.SendRequest
makes a blocking call toHttpClient.SendAsync
. That blocking call consumes a thread from the managed thread pool. Until that design changes, the rest of Scalar must avoid using the thread pool unless absolutely necessary. If the thread pool is required, any long running tasks should be moved to a separate thread managed by Scalar itself (see GitMaintenanceQueue for an example). -
Catch all exceptions on long-running tasks and background threads
Wrap all code that runs in the background thread in a top-level
try/catch(Exception)
. Any exceptions caught by this handler should be logged, and then Scalar should be forced to terminate withEnvironment.Exit
. It's not safe to allow Scalar to continue to run after an unhandled exception stops a background thread or long-running task. Testing has shown thatEnvironment.Exit
consistently terminates the process regardless of how background threads are started (e.g. native thread,new Thread()
,Task.Factory.StartNew()
).An example of this pattern can be seen in
BackgroundFileSystemTaskRunner.ProcessBackgroundTasks
.
Coding Conventions
-
Most C# coding style guidelines are covered by StyleCop
Fix any StyleCop issues reported in changed code. When adding new projects to Scalar, be sure that StyleCop is analyzing them as part of the build.
-
Prefer explicit types to interfaces and implicitly typed variables
Avoid the use of
var
(C#),dynamic
(C#), andauto
(C++). Prefer concrete/explicit types to interfaces (e.g. preferList
toIList
).The Scalar codebase uses this approach because:
- Interfaces can hide the performance characteristics of their underlying type. For example, an
IDictionary
could be aSortedList
or aDictionary
(or several other data types). - Interfaces can hide the thread safety (or lack thereof) of their underlying type. For example, an
IDictionary
could be aDictionary
or aConcurrentDictionary
. - Explicit types make these performance and thread safety characteristics explicit when reviewing code.
- Scalar is not a public API and its components are always shipped together. Develoepers are free to make API changes to Scalar's public methods.
- Interfaces can hide the performance characteristics of their underlying type. For example, an
-
Method names start with a verb (e.g. "GetProjectedFolderEntryData" rather than "ProjectedFolderEntryData")
Starting with a verb in the name improves readability and helps ensure consistency with the rest of the Scalar codebase.
-
Aim to write self-commenting code. When necessary, comments should give background needed to understand the code.
Helpful (good) comment:
// Order the folders in descending order so that we walk the tree from bottom up. // Traversing the folders in this order: // 1. Ensures child folders are deleted before their parents // 2. Ensures that folders that have been deleted by git // (but are still in the projection) are found before their // parent folder is re-expanded (only applies on platforms // where EnumerationExpandsDirectories is true) foreach (PlaceholderListDatabase.PlaceholderData folderPlaceholder in placeholderFoldersListCopy.OrderByDescending(x => x.Path))
Obvious (bad) comment:
// Check if enumeration expands directories on the current platform if (ScalarPlatform.Instance.KernelDriver.EnumerationExpandsDirectories)
-
Add new interfaces when it makes sense for the product, not simply for unit testing
When a class needs to be mocked (or have a subset of its behavior mocked), prefer using virtual methods instead of adding a new interface. Scalar uses interfaces when multiple implementations of the interface exist in the product code.
-
Check for
null
using the equality (==
) and inequality (!=
) operators rather thanis
A corollary to this guideline is that equality/inequality operators that break
null
checks should not be added (see this post for an example). -
Use
nameof(...)
rather than hardcoded stringsUsing
nameof
ensures that when methods/variables are renamed the logging of those method/variable names will also be updated. However, hard coded strings are still appropriate when they are used for generating reports and changing the strings would break the reports.
Testing
-
Add new unit and functional tests when making changes
Comprehensive tests are essential for maintaining the health and quality of the product. For more details on writing tests see Authoring Tests.
-
Functional tests are black-box tests and should not build against any Scalar product code
Keeping the code separate helps ensure that bugs in the product code do not compromise the integrity of the functional tests.
C# Unit Tests
-
Add
ExceptionExpected
to unit tests that are expected to have exceptionsExample:
[TestCase] [Category(CategoryConstants.ExceptionExpected)] public void ParseFromLsTreeLine_NullRepoRoot()
Unit tests should be tagged with
ExceptionExpected
when either the test code or the product code will throw an exception.ExceptionExpected
tests are not executed when the debugger is attached, and this prevents developers from having to keep continuing the tests each time exceptions are caught by the debugger. -
Use a
mock
prefix for absolute file system paths and URLsThe unit tests should not touch the real file system nor should they reach out to any real URLs. Using
mock:\\
andmock://
ensures that any product code that was not properly mocked will not interact with the real file system or attempt to contact a real URL.