win32metadata/README.md

126 строки
7.5 KiB
Markdown
Исходник Обычный вид История

# Overview
2020-11-29 20:18:53 +03:00
Win32 APIs provide functionality that not all languages and frameworks support themselves. When developing for Windows, developers often call into Win32 APIs to access this functionality.
Historically, this has required manually [redefining the APIs](http://pinvoke.net/) to make them accessible, which is fragile and error-prone. Community projects like https://github.com/dotnet/pinvoke (.NET) and https://github.com/retep998/winapi-rs (Rust) have taken on the burden of providing strongly-typed and validated API signatures for their frameworks, but the projects are manually maintained, which is hard to sustain and makes it challenging to provide thorough API coverage.
This project aims to provide metadata for Win32 APIs such that idiomatic [projections](./docs/projections.md) and projects like the ones above can be generated for all languages and frameworks in a more automated way and with more complete API coverage.
2020-06-09 00:52:17 +03:00
To call Win32 APIs from the language of your choice based off of this metadata, use the following [language projections](./docs/projections.md):
* C# - https://github.com/microsoft/cswin32 (Microsoft)
* C++ - https://github.com/microsoft/cppwin32 (Microsoft)
* Rust - https://github.com/microsoft/windows-rs (Microsoft)
* D - https://github.com/rumbu13/windows-d (Community)
2021-03-18 05:15:40 +03:00
* Dart - https://github.com/timsneath/win32 (Community)
2021-04-28 21:02:59 +03:00
* Zig - https://github.com/marlersoft/zigwin32 (Community)
Note: Community projects are listed here to help with discovery but are not officially validated by Microsoft.
See the [roadmap](./docs/roadmap.md) and [FAQ](./docs/faq.md) for more details.
If you'd like to browse the metadata to see what we're emitting, download [Windows.Win32.winmd](https://github.com/microsoft/win32metadata/raw/master/scripts/BaselineWinmd/Windows.Win32.winmd) and [Windows.Win32.Interop.dll](https://github.com/microsoft/win32metadata/raw/master/scripts/BaselineWinmd/Windows.Win32.Interop.dll) into the same folder and load Windows.Win32.winmd in [ILSpy](https://github.com/icsharpcode/ILSpy/releases/latest).
2021-07-07 00:16:34 +03:00
We also publish the metadata via the [Microsoft.Windows.SDK.Win32Metadata](https://www.nuget.org/packages/Microsoft.Windows.SDK.Win32Metadata/) NuGet package.
![ILSpy with winmd](./images/ILSpyWithWinmd.png)
# Principles
Below are some principles that guide the metadata that we produce:
* Provide the broadest API coverage possible
* Keep the names of the original APIs, but express in metadata additional information that can make them easier to use.
* Convert non-specific types like `uint` that use constants into explicit enums to improve usability and discoverability. Keep enum member names consistent with the original constant names to preserve SEO.
* Express Win32 resources like `HANDLE` and `GDI` objects as strongly-typed structs. The definition of these structs include how to dispose of the resources (like `CloseHandle` or `DeleteObject`). It is up to language projections to make use of this information in a language-specific way. For example, a C# projection could use `SafeHandle` objects for `HANDLE` and `GDI` objects.
2020-11-26 03:46:38 +03:00
# Architecture
This project uses [ClangSharp](https://github.com/Microsoft/ClangSharp) to scrape Windows SDK headers into C# files. It uses libraries from the Windows SDK to figure out what the DLL imports are for each API function. The project is split into partitions that roughly translate into namespaces. ClangSharp creates a .cs file for each partition that it processes.
2020-11-26 03:46:38 +03:00
2020-11-29 20:18:53 +03:00
Once the C# files are written by ClangSharp, the emitter turns these files into a Windows Metadata (.winmd) file. Although this is an ECMA-335 binary, it is not directly loadable by the CLR.
2020-11-26 03:46:38 +03:00
The resulting .winmd is packaged as a NuGet package which can be used to create language projections for other languages such as C#, modern C++, and Rust.
# ClangSharp Overview
ClangSharp emits C# as it encounters types found in C/C++ headers. It will only emit types for headers included in its "traverse" list.
Example for Direct3DDxgi:
2020-11-26 03:46:38 +03:00
[generation/WinSDK/Partitions/Direct3DDxgi/main.cpp](generation/WinSDK/Partitions/Direct3DDxgi/main.cpp):
2020-11-26 03:46:38 +03:00
#include <winnt.h>
#include <winerror.h>
2020-11-26 03:46:38 +03:00
#include <dxgi.h>
#include <dxgi1_2.h>
#include <dxgi1_3.h>
#include <dxgi1_4.h>
2020-11-26 03:46:38 +03:00
#include <dxgi1_5.h>
#include <dxgi1_6.h>
#include <dxgidebug.h>
#include <dxgitype.h>
2020-11-26 03:46:38 +03:00
#include <dxgicommon.h>
#include <dxgiformat.h>
[generation/WinSDK/Partitions/Direct3DDxgi/settings.rsp](generation/WinSDK/Partitions/Direct3DDxgi/settings.rsp):
2020-11-26 03:46:38 +03:00
--traverse
<IncludeRoot>/shared/dxgitype.h
<IncludeRoot>/shared/dxgiformat.h
<IncludeRoot>/shared/dxgicommon.h
<IncludeRoot>/shared/dxgi.h
<IncludeRoot>/shared/dxgi1_2.h
<IncludeRoot>/shared/dxgi1_4.h
<IncludeRoot>/shared/dxgi1_6.h
<IncludeRoot>/um/dxgidebug.h
<IncludeRoot>/shared/dxgi1_3.h
<IncludeRoot>/shared/dxgi1_5.h
--namespace
Updating a lot of namespaces (#444) * Attempted to move winreg.h to System.Registry. Builds but only a few APIs moved. * Added CONTRIBUTING.md with details on namespaces. * Added overview bullets to CONTRIBUTING.md. * Added projections to CONTRIBUTING.md. * Fixed relative links. * Removed hardcoded registry remappings. * Refactored manual Registry definitions. * Refactored networking APIs. * Changed RRAS to Rras. * Updated the Namespaces section. * Added a script to identify missing header files. * Fixed whitespace. * Added a ToC to the Namespaces section. * Cleaned up old Registry mappings. * Removed hardcoded WinSock mappings. Validated the headers for all hardcoded mappings are already in the WinSock partition. Added transportsettingcommon.h which was missing. * Reordered parameters. * Removed redundant DNS mappings. * Removed redundant WFP mappings. * Removed redundant Windows Firewall mappings. * Renamed the WindowsFirewall partition. * Renamed the WindowsFilteringPlatform partition. * Removed redundant BITS mappings. * Removed redundant DHCP mappings. * Removed redundant IpHelper mappings. * Removed redundant MIB mappings. * Removed redundant IpHelper mappings. * Added missing headers to WindowsFilteringPlatform. * Removed duplicate entries from header.txt. * Fixed build break. Casing matters for --traverse. * Reverted casing changes. * Moved AD, LDAP, and RDC to Networking. * Renamed AllJoyn-DeviceAndDriverInstallation. * Renamed Direct*. * Renamed DisplayDevices-InteractionContext. * Renamed Intl-OtherDeviceTechnologies. * Renamed Packaging-Xps. * Renamed COM, COM+, IE, and OfflineFiles. * Renamed WindowsProgramming. * Renamed WinML. Removed redundant ML mappings. * Add missing AllJoyn headers. * Attempted to move winreg.h to System.Registry. Builds but only a few APIs moved. * Added CONTRIBUTING.md with details on namespaces. * Added overview bullets to CONTRIBUTING.md. * Added projections to CONTRIBUTING.md. * Fixed relative links. * Removed hardcoded registry remappings. * Refactored manual Registry definitions. * Refactored networking APIs. * Changed RRAS to Rras. * Updated the Namespaces section. * Added a script to identify missing header files. * Fixed whitespace. * Added a ToC to the Namespaces section. * Cleaned up old Registry mappings. * Removed hardcoded WinSock mappings. Validated the headers for all hardcoded mappings are already in the WinSock partition. Added transportsettingcommon.h which was missing. * Reordered parameters. * Removed redundant DNS mappings. * Removed redundant WFP mappings. * Removed redundant Windows Firewall mappings. * Renamed the WindowsFirewall partition. * Renamed the WindowsFilteringPlatform partition. * Removed redundant BITS mappings. * Removed redundant DHCP mappings. * Removed redundant IpHelper mappings. * Removed redundant MIB mappings. * Removed redundant IpHelper mappings. * Added missing headers to WindowsFilteringPlatform. * Removed duplicate entries from header.txt. * Fixed build break. Casing matters for --traverse. * Reverted casing changes. * Moved AD, LDAP, and RDC to Networking. * Renamed AllJoyn-DeviceAndDriverInstallation. * Renamed Direct*. * Renamed DisplayDevices-InteractionContext. * Renamed Intl-OtherDeviceTechnologies. * Renamed Packaging-Xps. * Renamed COM, COM+, IE, and OfflineFiles. * Renamed WindowsProgramming. * Renamed WinML. Removed redundant ML mappings. * Add missing AllJoyn headers. * Added missing AllJoyn interop header. * Update branch with master * Removing stray debug code Co-authored-by: Mike Battista <mbattist@microsoft.com> Co-authored-by: Steve Otteson <sotteson@microsoft.com>
2021-04-27 11:15:58 +03:00
Windows.Win32.Graphics.Dxgi
This means ClangSharp will emit types from the above list of headers when scraping for dxgi.lib. The compiler will see lots of other headers, like what windows.h brings in, but it will only emit types seen in the list above.
2020-11-26 03:46:38 +03:00
2020-11-29 20:18:53 +03:00
## ClangSharp and Remaps
2020-11-26 03:46:38 +03:00
2020-11-29 20:18:53 +03:00
ClangSharp emits C# code as it goes. For example, when it sees this type:
2020-11-26 03:46:38 +03:00
typedef struct tagRECT
{
LONG left;
LONG top;
LONG right;
LONG bottom;
} RECT, *PRECT, NEAR *NPRECT, FAR *LPRECT;
It starts emitting:
public partial struct tagRect
{
public int left;
2020-11-29 20:18:53 +03:00
It has no way of knowing a typedef is coming (RECT). But, we can feed data into ClangSharp that tells it to rename tagRECT to RECT:
[generation/WinSDK/scraper.settings.rsp](generation/WinSDK/scraper.settings.rsp)
2020-11-29 20:18:53 +03:00
2020-11-26 03:46:38 +03:00
tagRECT=RECT
Now when ClangSharp encounters tagRECT it will automatically change the name it uses to RECT.
# Winmd Emitter Overview
ClangSharp was designed to create C#-compilable code from Win32 headers. Because its goal is to create C#-compilable code while also preserving pointers, it can't always express things in the way we would like for metadata which is meant to be language-agnostic. For example, the CLR will not allow managed types such as "interface" or "delegate" to be on an unsafe struct (a struct that gets pointed to or includes pointers). This means ClangSharp emits COM objects as structs instead of interfaces, so that a COM object can exist on an unsafe struct.
2020-11-26 03:46:38 +03:00
2021-05-12 23:38:54 +03:00
The winmd emitter takes the C#-compilable source created by ClangSharp and emits it into a .winmd. A .winmd can define an interface, have a struct use it as a field type, and have a function parameter point at the struct. However, the CLR will not be able to load it because it's invalid to the CLR.
2020-11-26 03:46:38 +03:00
2020-11-29 20:18:53 +03:00
The emitter also looks at SAL attributes that ClangSharp outputs for parameters and adds metadata attributes for const, in/out, COM out pointers, etc. It will also mark fields and parameters via attributes as null-terminated strings while preserving the original pointer type. It is up to consumers of the fields and parameters to interpret the metadata and turn them into language-appropriate types such as a string.
2020-11-26 03:46:38 +03:00
2020-06-09 00:52:17 +03:00
# Contributing
See [CONTRIBUTING.md](./CONTRIBUTING.md).
2020-12-01 04:44:05 +03:00
# Trademarks
This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies.