2017-02-28 20:22:51 +03:00
|
|
|
Rust Quasi-Quoting
|
|
|
|
==================
|
|
|
|
|
2021-06-16 03:00:15 +03:00
|
|
|
[![Build Status](https://api.travis-ci.org/dtolnay/quote.svg?branch=master)](https://travis-ci.org/dtolnay/quote)
|
|
|
|
[![Latest Version](https://img.shields.io/crates/v/quote.svg)](https://crates.io/crates/quote)
|
|
|
|
[![Rust Documentation](https://img.shields.io/badge/api-rustdoc-blue.svg)](https://docs.rs/quote/)
|
2017-02-28 20:22:51 +03:00
|
|
|
|
2018-02-14 14:39:47 +03:00
|
|
|
This crate provides the [`quote!`] macro for turning Rust syntax tree data
|
|
|
|
structures into tokens of source code.
|
|
|
|
|
2019-10-09 13:52:29 +03:00
|
|
|
[`quote!`]: https://docs.rs/quote/1.0/quote/macro.quote.html
|
2018-02-14 14:39:47 +03:00
|
|
|
|
|
|
|
Procedural macros in Rust receive a stream of tokens as input, execute arbitrary
|
|
|
|
Rust code to determine how to manipulate those tokens, and produce a stream of
|
|
|
|
tokens to hand back to the compiler to compile into the caller's crate.
|
2019-10-09 13:52:29 +03:00
|
|
|
Quasi-quoting is a solution to one piece of that — producing tokens to
|
|
|
|
return to the compiler.
|
2018-02-14 14:39:47 +03:00
|
|
|
|
|
|
|
The idea of quasi-quoting is that we write *code* that we treat as *data*.
|
|
|
|
Within the `quote!` macro, we can write what looks like code to our text editor
|
|
|
|
or IDE. We get all the benefits of the editor's brace matching, syntax
|
|
|
|
highlighting, indentation, and maybe autocompletion. But rather than compiling
|
|
|
|
that as code into the current crate, we can treat it as data, pass it around,
|
|
|
|
mutate it, and eventually hand it back to the compiler as tokens to compile into
|
|
|
|
the macro caller's crate.
|
|
|
|
|
|
|
|
This crate is motivated by the procedural macro use case, but is a
|
|
|
|
general-purpose Rust quasi-quoting library and is not specific to procedural
|
|
|
|
macros.
|
|
|
|
|
2021-06-16 03:00:15 +03:00
|
|
|
*Version requirement: Quote supports any compiler version back to Rust's very
|
|
|
|
first support for procedural macros in Rust 1.15.0.*
|
|
|
|
|
|
|
|
[*Release notes*](https://github.com/dtolnay/quote/releases)
|
|
|
|
|
2017-02-28 20:22:51 +03:00
|
|
|
```toml
|
|
|
|
[dependencies]
|
2019-10-09 13:52:29 +03:00
|
|
|
quote = "1.0"
|
2017-02-28 20:22:51 +03:00
|
|
|
```
|
|
|
|
|
|
|
|
## Syntax
|
|
|
|
|
2018-02-14 14:39:47 +03:00
|
|
|
The quote crate provides a [`quote!`] macro within which you can write Rust code
|
2018-06-21 15:22:02 +03:00
|
|
|
that gets packaged into a [`TokenStream`] and can be treated as data. You should
|
2019-04-02 23:42:43 +03:00
|
|
|
think of `TokenStream` as representing a fragment of Rust source code.
|
2018-02-14 14:39:47 +03:00
|
|
|
|
2019-10-09 13:52:29 +03:00
|
|
|
[`TokenStream`]: https://docs.rs/proc-macro2/1.0/proc_macro2/struct.TokenStream.html
|
2017-02-28 20:22:51 +03:00
|
|
|
|
|
|
|
Within the `quote!` macro, interpolation is done with `#var`. Any type
|
2018-02-14 14:39:47 +03:00
|
|
|
implementing the [`quote::ToTokens`] trait can be interpolated. This includes
|
|
|
|
most Rust primitive types as well as most of the syntax tree types from [`syn`].
|
|
|
|
|
2019-10-09 13:52:29 +03:00
|
|
|
[`quote::ToTokens`]: https://docs.rs/quote/1.0/quote/trait.ToTokens.html
|
2018-02-14 14:39:47 +03:00
|
|
|
[`syn`]: https://github.com/dtolnay/syn
|
2017-02-28 20:22:51 +03:00
|
|
|
|
|
|
|
```rust
|
|
|
|
let tokens = quote! {
|
|
|
|
struct SerializeWith #generics #where_clause {
|
|
|
|
value: &'a #field_ty,
|
2019-04-02 23:42:43 +03:00
|
|
|
phantom: core::marker::PhantomData<#item_ty>,
|
2017-02-28 20:22:51 +03:00
|
|
|
}
|
|
|
|
|
|
|
|
impl #generics serde::Serialize for SerializeWith #generics #where_clause {
|
2019-01-08 06:40:00 +03:00
|
|
|
fn serialize<S>(&self, serializer: S) -> Result<S::Ok, S::Error>
|
2018-06-21 15:22:02 +03:00
|
|
|
where
|
|
|
|
S: serde::Serializer,
|
2017-02-28 20:22:51 +03:00
|
|
|
{
|
2019-01-08 06:40:00 +03:00
|
|
|
#path(self.value, serializer)
|
2017-02-28 20:22:51 +03:00
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
SerializeWith {
|
|
|
|
value: #value,
|
2019-04-02 23:42:43 +03:00
|
|
|
phantom: core::marker::PhantomData::<#item_ty>,
|
2017-02-28 20:22:51 +03:00
|
|
|
}
|
|
|
|
};
|
|
|
|
```
|
|
|
|
|
2018-02-14 14:39:47 +03:00
|
|
|
## Repetition
|
2017-02-28 20:22:51 +03:00
|
|
|
|
2018-02-14 14:39:47 +03:00
|
|
|
Repetition is done using `#(...)*` or `#(...),*` similar to `macro_rules!`. This
|
|
|
|
iterates through the elements of any variable interpolated within the repetition
|
|
|
|
and inserts a copy of the repetition body for each one. The variables in an
|
|
|
|
interpolation may be anything that implements `IntoIterator`, including `Vec` or
|
|
|
|
a pre-existing iterator.
|
2017-02-28 20:22:51 +03:00
|
|
|
|
2018-02-14 14:39:47 +03:00
|
|
|
- `#(#var)*` — no separators
|
|
|
|
- `#(#var),*` — the character before the asterisk is used as a separator
|
|
|
|
- `#( struct #var; )*` — the repetition can contain other things
|
|
|
|
- `#( #k => println!("{}", #v), )*` — even multiple interpolations
|
2017-02-28 20:22:51 +03:00
|
|
|
|
2018-02-14 14:39:47 +03:00
|
|
|
Note that there is a difference between `#(#var ,)*` and `#(#var),*`—the latter
|
|
|
|
does not produce a trailing comma. This matches the behavior of delimiters in
|
|
|
|
`macro_rules!`.
|
|
|
|
|
2019-04-02 23:42:43 +03:00
|
|
|
## Returning tokens to the compiler
|
|
|
|
|
|
|
|
The `quote!` macro evaluates to an expression of type
|
|
|
|
`proc_macro2::TokenStream`. Meanwhile Rust procedural macros are expected to
|
|
|
|
return the type `proc_macro::TokenStream`.
|
|
|
|
|
|
|
|
The difference between the two types is that `proc_macro` types are entirely
|
|
|
|
specific to procedural macros and cannot ever exist in code outside of a
|
|
|
|
procedural macro, while `proc_macro2` types may exist anywhere including tests
|
|
|
|
and non-macro code like main.rs and build.rs. This is why even the procedural
|
|
|
|
macro ecosystem is largely built around `proc_macro2`, because that ensures the
|
|
|
|
libraries are unit testable and accessible in non-macro contexts.
|
|
|
|
|
|
|
|
There is a [`From`]-conversion in both directions so returning the output of
|
|
|
|
`quote!` from a procedural macro usually looks like `tokens.into()` or
|
|
|
|
`proc_macro::TokenStream::from(tokens)`.
|
|
|
|
|
|
|
|
[`From`]: https://doc.rust-lang.org/std/convert/trait.From.html
|
|
|
|
|
|
|
|
## Examples
|
|
|
|
|
|
|
|
### Combining quoted fragments
|
|
|
|
|
|
|
|
Usually you don't end up constructing an entire final `TokenStream` in one
|
|
|
|
piece. Different parts may come from different helper functions. The tokens
|
|
|
|
produced by `quote!` themselves implement `ToTokens` and so can be interpolated
|
|
|
|
into later `quote!` invocations to build up a final result.
|
|
|
|
|
|
|
|
```rust
|
|
|
|
let type_definition = quote! {...};
|
|
|
|
let methods = quote! {...};
|
|
|
|
|
|
|
|
let tokens = quote! {
|
|
|
|
#type_definition
|
|
|
|
#methods
|
|
|
|
};
|
|
|
|
```
|
|
|
|
|
|
|
|
### Constructing identifiers
|
|
|
|
|
|
|
|
Suppose we have an identifier `ident` which came from somewhere in a macro
|
|
|
|
input and we need to modify it in some way for the macro output. Let's consider
|
|
|
|
prepending the identifier with an underscore.
|
|
|
|
|
|
|
|
Simply interpolating the identifier next to an underscore will not have the
|
|
|
|
behavior of concatenating them. The underscore and the identifier will continue
|
|
|
|
to be two separate tokens as if you had written `_ x`.
|
|
|
|
|
|
|
|
```rust
|
|
|
|
// incorrect
|
|
|
|
quote! {
|
|
|
|
let mut _#ident = 0;
|
|
|
|
}
|
|
|
|
```
|
|
|
|
|
2019-10-09 13:52:29 +03:00
|
|
|
The solution is to build a new identifier token with the correct value. As this
|
|
|
|
is such a common case, the `format_ident!` macro provides a convenient utility
|
|
|
|
for doing so correctly.
|
|
|
|
|
|
|
|
```rust
|
|
|
|
let varname = format_ident!("_{}", ident);
|
|
|
|
quote! {
|
|
|
|
let mut #varname = 0;
|
|
|
|
}
|
|
|
|
```
|
|
|
|
|
|
|
|
Alternatively, the APIs provided by Syn and proc-macro2 can be used to directly
|
|
|
|
build the identifier. This is roughly equivalent to the above, but will not
|
|
|
|
handle `ident` being a raw identifier.
|
2019-04-02 23:42:43 +03:00
|
|
|
|
|
|
|
```rust
|
|
|
|
let concatenated = format!("_{}", ident);
|
|
|
|
let varname = syn::Ident::new(&concatenated, ident.span());
|
|
|
|
quote! {
|
|
|
|
let mut #varname = 0;
|
|
|
|
}
|
|
|
|
```
|
|
|
|
|
|
|
|
### Making method calls
|
|
|
|
|
|
|
|
Let's say our macro requires some type specified in the macro input to have a
|
|
|
|
constructor called `new`. We have the type in a variable called `field_type` of
|
|
|
|
type `syn::Type` and want to invoke the constructor.
|
|
|
|
|
|
|
|
```rust
|
|
|
|
// incorrect
|
|
|
|
quote! {
|
|
|
|
let value = #field_type::new();
|
|
|
|
}
|
|
|
|
```
|
|
|
|
|
|
|
|
This works only sometimes. If `field_type` is `String`, the expanded code
|
|
|
|
contains `String::new()` which is fine. But if `field_type` is something like
|
|
|
|
`Vec<i32>` then the expanded code is `Vec<i32>::new()` which is invalid syntax.
|
|
|
|
Ordinarily in handwritten Rust we would write `Vec::<i32>::new()` but for macros
|
|
|
|
often the following is more convenient.
|
|
|
|
|
|
|
|
```rust
|
|
|
|
quote! {
|
|
|
|
let value = <#field_type>::new();
|
|
|
|
}
|
|
|
|
```
|
|
|
|
|
|
|
|
This expands to `<Vec<i32>>::new()` which behaves correctly.
|
|
|
|
|
|
|
|
A similar pattern is appropriate for trait methods.
|
|
|
|
|
|
|
|
```rust
|
|
|
|
quote! {
|
|
|
|
let value = <#field_type as core::default::Default>::default();
|
|
|
|
}
|
|
|
|
```
|
|
|
|
|
2018-02-14 14:39:47 +03:00
|
|
|
## Hygiene
|
|
|
|
|
|
|
|
Any interpolated tokens preserve the `Span` information provided by their
|
|
|
|
`ToTokens` implementation. Tokens that originate within a `quote!` invocation
|
2018-06-21 15:22:02 +03:00
|
|
|
are spanned with [`Span::call_site()`].
|
2018-02-14 14:39:47 +03:00
|
|
|
|
2019-10-09 13:52:29 +03:00
|
|
|
[`Span::call_site()`]: https://docs.rs/proc-macro2/1.0/proc_macro2/struct.Span.html#method.call_site
|
2018-02-14 14:39:47 +03:00
|
|
|
|
|
|
|
A different span can be provided explicitly through the [`quote_spanned!`]
|
|
|
|
macro.
|
|
|
|
|
2019-10-09 13:52:29 +03:00
|
|
|
[`quote_spanned!`]: https://docs.rs/quote/1.0/quote/macro.quote_spanned.html
|
2017-02-28 20:22:51 +03:00
|
|
|
|
2019-10-09 13:52:29 +03:00
|
|
|
<br>
|
2017-02-28 20:22:51 +03:00
|
|
|
|
2019-10-09 13:52:29 +03:00
|
|
|
#### License
|
2017-02-28 20:22:51 +03:00
|
|
|
|
2019-10-09 13:52:29 +03:00
|
|
|
<sup>
|
|
|
|
Licensed under either of <a href="LICENSE-APACHE">Apache License, Version
|
|
|
|
2.0</a> or <a href="LICENSE-MIT">MIT license</a> at your option.
|
|
|
|
</sup>
|
2017-02-28 20:22:51 +03:00
|
|
|
|
2019-10-09 13:52:29 +03:00
|
|
|
<br>
|
2017-02-28 20:22:51 +03:00
|
|
|
|
2019-10-09 13:52:29 +03:00
|
|
|
<sub>
|
2017-02-28 20:22:51 +03:00
|
|
|
Unless you explicitly state otherwise, any contribution intentionally submitted
|
|
|
|
for inclusion in this crate by you, as defined in the Apache-2.0 license, shall
|
|
|
|
be dual licensed as above, without any additional terms or conditions.
|
2019-10-09 13:52:29 +03:00
|
|
|
</sub>
|