mozilla
/
sccache
зеркало из https://github.com/mozilla/sccache.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
sccache/Cargo.lock

2534 строки
117 KiB
Plaintext
Исходник Обычный вид История

Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "adler32"
version = "1.0.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "aho-corasick"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.6.8"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"memchr 2.0.2 (registry+https://github.com/rust-lang/crates.io-index)",
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
]
[[package]]
name = "ansi_term"
Silence some warnings
2018-07-12 13:46:33 +03:00
version = "0.11.0"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Silence some warnings
2018-07-12 13:46:33 +03:00
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Silence some warnings
2018-07-12 13:46:33 +03:00
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
Implement scheduler auth for clients and servers, add job tokens
2018-08-06 18:12:46 +03:00
[[package]]
name = "arraydeque"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.4.3"
Implement scheduler auth for clients and servers, add job tokens
2018-08-06 18:12:46 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
[[package]]
name = "arrayvec"
version = "0.4.7"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"nodrop 0.1.12 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "ascii"
version = "0.7.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "ascii"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
version = "0.8.7"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Ignore CARGO_MAKEFLAGS when calculating Rust hash keys. Fixes #193 Since cargo gained jobserver support it now passes a CARGO_MAKEFLAGS environment variable which is different for every build (it contains file descriptor numbers or semaphore values). sccache uses all environment variables starting with `CARGO_` as inputs to the hash key for Rust compilation so this broke things. I think it was mostly only a problem on Windows, where the values were semaphores. On POSIX platforms the values are file descriptors, which are probably likely to be the same between runs of cargo. This change also adds a test for compiling a simple Rust crate with cargo and verifying that we get a cache hit. I pulled in the `assert_cli` crate to write that test, which worked nicely.
2017-10-25 21:09:27 +03:00
[[package]]
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
name = "assert_cmd"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.9.1"
Ignore CARGO_MAKEFLAGS when calculating Rust hash keys. Fixes #193 Since cargo gained jobserver support it now passes a CARGO_MAKEFLAGS environment variable which is different for every build (it contains file descriptor numbers or semaphore values). sccache uses all environment variables starting with `CARGO_` as inputs to the hash key for Rust compilation so this broke things. I think it was mostly only a problem on Windows, where the values were semaphores. On POSIX platforms the values are file descriptors, which are probably likely to be the same between runs of cargo. This change also adds a test for compiling a simple Rust crate with cargo and verifying that we get a cache hit. I pulled in the `assert_cli` crate to write that test, which worked nicely.
2017-10-25 21:09:27 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"escargot 0.3.1 (registry+https://github.com/rust-lang/crates.io-index)",
"predicates 0.9.0 (registry+https://github.com/rust-lang/crates.io-index)",
"predicates-core 0.9.0 (registry+https://github.com/rust-lang/crates.io-index)",
"predicates-tree 0.9.0 (registry+https://github.com/rust-lang/crates.io-index)",
Ignore CARGO_MAKEFLAGS when calculating Rust hash keys. Fixes #193 Since cargo gained jobserver support it now passes a CARGO_MAKEFLAGS environment variable which is different for every build (it contains file descriptor numbers or semaphore values). sccache uses all environment variables starting with `CARGO_` as inputs to the hash key for Rust compilation so this broke things. I think it was mostly only a problem on Windows, where the values were semaphores. On POSIX platforms the values are file descriptors, which are probably likely to be the same between runs of cargo. This change also adds a test for compiling a simple Rust crate with cargo and verifying that we get a cache hit. I pulled in the `assert_cli` crate to write that test, which worked nicely.
2017-10-25 21:09:27 +03:00
]
Update clap
2017-04-05 17:42:06 +03:00
[[package]]
name = "atty"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.2.11"
Update clap
2017-04-05 17:42:06 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"termion 1.5.1 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Update clap
2017-04-05 17:42:06 +03:00
]
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
[[package]]
name = "base64"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.9.2"
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"byteorder 1.2.6 (registry+https://github.com/rust-lang/crates.io-index)",
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
"safemem 0.2.0 (registry+https://github.com/rust-lang/crates.io-index)",
]
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
[[package]]
Update other deps
2018-01-07 18:58:55 +03:00
name = "bincode"
version = "0.8.0"
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"byteorder 1.2.6 (registry+https://github.com/rust-lang/crates.io-index)",
"num-traits 0.1.43 (registry+https://github.com/rust-lang/crates.io-index)",
"serde 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)",
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
]
Update iovec to fix a soundness hole on Windows Also update a few other dependencies that transitively needed fixing
2017-10-06 02:40:25 +03:00
[[package]]
Update ring
2018-01-07 18:33:04 +03:00
name = "bincode"
Update other deps
2018-01-07 18:58:55 +03:00
version = "0.9.2"
Update iovec to fix a soundness hole on Windows Also update a few other dependencies that transitively needed fixing
2017-10-06 02:40:25 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update ring
2018-01-07 18:33:04 +03:00
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"byteorder 1.2.6 (registry+https://github.com/rust-lang/crates.io-index)",
"serde 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
]
Update iovec to fix a soundness hole on Windows Also update a few other dependencies that transitively needed fixing
2017-10-06 02:40:25 +03:00
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
[[package]]
name = "bitflags"
Update ring
2018-01-07 18:33:04 +03:00
version = "0.9.1"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
[[package]]
name = "bitflags"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "1.0.4"
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Use a trait to represent compiler packagers
2018-07-18 23:21:06 +03:00
[[package]]
name = "boxfnonce"
version = "0.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "brotli-sys"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
version = "0.3.2"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"cc 1.0.23 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
]
[[package]]
name = "brotli2"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
version = "0.3.2"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"brotli-sys 0.3.2 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
]
[[package]]
name = "buf_redux"
version = "0.6.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"memchr 1.0.2 (registry+https://github.com/rust-lang/crates.io-index)",
"safemem 0.2.0 (registry+https://github.com/rust-lang/crates.io-index)",
]
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
[[package]]
name = "bufstream"
version = "0.1.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "build_const"
version = "0.2.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
[[package]]
name = "byteorder"
version = "0.4.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
[[package]]
name = "byteorder"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "1.2.6"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update to using the new tokio-io crate This is an abstraction of the Tokio stack now and doesn't have much impact on sccache itself but I figured it'd be good to update a few deps and pick up the recent version of things! Plus that and I'd like to start using the length_delimited module soon...
2017-03-09 21:00:18 +03:00
[[package]]
name = "bytes"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
version = "0.4.9"
Update to using the new tokio-io crate This is an abstraction of the Tokio stack now and doesn't have much impact on sccache itself but I figured it'd be good to update a few deps and pick up the recent version of things! Plus that and I'd like to start using the length_delimited module soon...
2017-03-09 21:00:18 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"byteorder 1.2.6 (registry+https://github.com/rust-lang/crates.io-index)",
cargo update
2018-02-01 18:29:23 +03:00
"iovec 0.1.2 (registry+https://github.com/rust-lang/crates.io-index)",
Update to using the new tokio-io crate This is an abstraction of the Tokio stack now and doesn't have much impact on sccache itself but I figured it'd be good to update a few deps and pick up the recent version of things! Plus that and I'd like to start using the length_delimited module soon...
2017-03-09 21:00:18 +03:00
]
Depend on tokio-serde-bincode from crates.io
2017-07-13 21:33:57 +03:00
[[package]]
name = "case"
version = "0.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
Ignore CARGO_MAKEFLAGS when calculating Rust hash keys. Fixes #193 Since cargo gained jobserver support it now passes a CARGO_MAKEFLAGS environment variable which is different for every build (it contains file descriptor numbers or semaphore values). sccache uses all environment variables starting with `CARGO_` as inputs to the hash key for Rust compilation so this broke things. I think it was mostly only a problem on Windows, where the values were semaphores. On POSIX platforms the values are file descriptors, which are probably likely to be the same between runs of cargo. This change also adds a test for compiling a simple Rust crate with cargo and verifying that we get a cache hit. I pulled in the `assert_cli` crate to write that test, which worked nicely.
2017-10-25 21:09:27 +03:00
[[package]]
name = "cc"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
version = "1.0.23"
Ignore CARGO_MAKEFLAGS when calculating Rust hash keys. Fixes #193 Since cargo gained jobserver support it now passes a CARGO_MAKEFLAGS environment variable which is different for every build (it contains file descriptor numbers or semaphore values). sccache uses all environment variables starting with `CARGO_` as inputs to the hash key for Rust compilation so this broke things. I think it was mostly only a problem on Windows, where the values were semaphores. On POSIX platforms the values are file descriptors, which are probably likely to be the same between runs of cargo. This change also adds a test for compiling a simple Rust crate with cargo and verifying that we get a cache hit. I pulled in the `assert_cli` crate to write that test, which worked nicely.
2017-10-25 21:09:27 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "cfg-if"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.5"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update ring
2018-01-07 18:33:04 +03:00
[[package]]
name = "chrono"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.4.6"
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"num-integer 0.1.39 (registry+https://github.com/rust-lang/crates.io-index)",
"num-traits 0.2.5 (registry+https://github.com/rust-lang/crates.io-index)",
"time 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)",
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
]
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "chunked_transfer"
version = "0.3.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "clap"
Silence some warnings
2018-07-12 13:46:33 +03:00
version = "2.32.0"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Silence some warnings
2018-07-12 13:46:33 +03:00
"ansi_term 0.11.0 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"atty 0.2.11 (registry+https://github.com/rust-lang/crates.io-index)",
"bitflags 1.0.4 (registry+https://github.com/rust-lang/crates.io-index)",
Silence some warnings
2018-07-12 13:46:33 +03:00
"strsim 0.7.0 (registry+https://github.com/rust-lang/crates.io-index)",
"textwrap 0.10.0 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"unicode-width 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
"vec_map 0.8.1 (registry+https://github.com/rust-lang/crates.io-index)",
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
]
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
[[package]]
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
name = "cloudabi"
version = "0.0.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"bitflags 1.0.4 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
]
[[package]]
name = "combine"
version = "3.5.1"
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"ascii 0.7.1 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"byteorder 1.2.6 (registry+https://github.com/rust-lang/crates.io-index)",
"either 1.5.0 (registry+https://github.com/rust-lang/crates.io-index)",
"memchr 2.0.2 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"unreachable 1.0.0 (registry+https://github.com/rust-lang/crates.io-index)",
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
]
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
[[package]]
name = "conhash"
version = "0.3.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
"rust-crypto 0.2.36 (registry+https://github.com/rust-lang/crates.io-index)",
]
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
[[package]]
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
name = "core-foundation"
version = "0.2.3"
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
"core-foundation-sys 0.2.3 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
]
[[package]]
name = "core-foundation-sys"
version = "0.2.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
]
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "crc"
version = "1.8.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"build_const 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)",
]
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
[[package]]
name = "crossbeam-deque"
version = "0.6.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"crossbeam-epoch 0.5.2 (registry+https://github.com/rust-lang/crates.io-index)",
"crossbeam-utils 0.5.0 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "crossbeam-epoch"
version = "0.5.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"arrayvec 0.4.7 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"cfg-if 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"crossbeam-utils 0.5.0 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"lazy_static 1.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"memoffset 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)",
"scopeguard 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "crossbeam-utils"
version = "0.5.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
daemonize the server process on unix
2016-10-26 23:22:52 +03:00
[[package]]
name = "daemonize"
version = "0.2.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Ignore CARGO_MAKEFLAGS when calculating Rust hash keys. Fixes #193 Since cargo gained jobserver support it now passes a CARGO_MAKEFLAGS environment variable which is different for every build (it contains file descriptor numbers or semaphore values). sccache uses all environment variables starting with `CARGO_` as inputs to the hash key for Rust compilation so this broke things. I think it was mostly only a problem on Windows, where the values were semaphores. On POSIX platforms the values are file descriptors, which are probably likely to be the same between runs of cargo. This change also adds a test for compiling a simple Rust crate with cargo and verifying that we get a cache hit. I pulled in the `assert_cli` crate to write that test, which worked nicely.
2017-10-25 21:09:27 +03:00
]
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "deflate"
version = "0.7.18"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"adler32 1.0.3 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"byteorder 1.2.6 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"gzip-header 0.1.2 (registry+https://github.com/rust-lang/crates.io-index)",
]
Depend on tokio-serde-bincode from crates.io
2017-07-13 21:33:57 +03:00
[[package]]
name = "derive-error"
version = "0.0.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"case 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
"quote 0.3.15 (registry+https://github.com/rust-lang/crates.io-index)",
"syn 0.11.11 (registry+https://github.com/rust-lang/crates.io-index)",
]
Ignore CARGO_MAKEFLAGS when calculating Rust hash keys. Fixes #193 Since cargo gained jobserver support it now passes a CARGO_MAKEFLAGS environment variable which is different for every build (it contains file descriptor numbers or semaphore values). sccache uses all environment variables starting with `CARGO_` as inputs to the hash key for Rust compilation so this broke things. I think it was mostly only a problem on Windows, where the values were semaphores. On POSIX platforms the values are file descriptors, which are probably likely to be the same between runs of cargo. This change also adds a test for compiling a simple Rust crate with cargo and verifying that we get a cache hit. I pulled in the `assert_cli` crate to write that test, which worked nicely.
2017-10-25 21:09:27 +03:00
[[package]]
name = "difference"
Update assert_cli and tweak some of the tests using it. Also silence a lint warning from error-chain.
2018-07-26 17:16:55 +03:00
version = "2.0.0"
Ignore CARGO_MAKEFLAGS when calculating Rust hash keys. Fixes #193 Since cargo gained jobserver support it now passes a CARGO_MAKEFLAGS environment variable which is different for every build (it contains file descriptor numbers or semaphore values). sccache uses all environment variables starting with `CARGO_` as inputs to the hash key for Rust compilation so this broke things. I think it was mostly only a problem on Windows, where the values were semaphores. On POSIX platforms the values are file descriptors, which are probably likely to be the same between runs of cargo. This change also adds a test for compiling a simple Rust crate with cargo and verifying that we get a cache hit. I pulled in the `assert_cli` crate to write that test, which worked nicely.
2017-10-25 21:09:27 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Replace `app_dirs` crate with `directories`. Fixes #233. The `app_dirs` crate has become unmaintained and is broken on macOS with Rust 1.25. The `directories` crate provides the same functionality and is maintained, so switch to using that instead.
2018-03-21 15:52:55 +03:00
[[package]]
name = "directories"
chore: Update directories to 1.0
2018-08-28 14:47:30 +03:00
version = "1.0.1"
Replace `app_dirs` crate with `directories`. Fixes #233. The `app_dirs` crate has become unmaintained and is broken on macOS with Rust 1.25. The `directories` crate provides the same functionality and is maintained, so switch to using that instead.
2018-03-21 15:52:55 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update directories to 1.0
2018-08-28 14:47:30 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Replace `app_dirs` crate with `directories`. Fixes #233. The `app_dirs` crate has become unmaintained and is broken on macOS with Rust 1.25. The `directories` crate provides the same functionality and is maintained, so switch to using that instead.
2018-03-21 15:52:55 +03:00
]
switch back to released version of which, switch to a rusoto branch with a bug fix
2016-08-08 22:06:06 +03:00
[[package]]
name = "dtoa"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.4.3"
switch back to released version of which, switch to a rusoto branch with a bug fix
2016-08-08 22:06:06 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
When hashing Rust compile arguments, sort -L and --cfg args as well as --extern
2017-04-03 17:21:13 +03:00
[[package]]
name = "either"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "1.5.0"
When hashing Rust compile arguments, sort -L and --cfg args as well as --extern
2017-04-03 17:21:13 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "encoding"
version = "0.2.33"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"encoding-index-japanese 1.20141219.5 (registry+https://github.com/rust-lang/crates.io-index)",
"encoding-index-korean 1.20141219.5 (registry+https://github.com/rust-lang/crates.io-index)",
"encoding-index-simpchinese 1.20141219.5 (registry+https://github.com/rust-lang/crates.io-index)",
"encoding-index-singlebyte 1.20141219.5 (registry+https://github.com/rust-lang/crates.io-index)",
"encoding-index-tradchinese 1.20141219.5 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "encoding-index-japanese"
version = "1.20141219.5"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"encoding_index_tests 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "encoding-index-korean"
version = "1.20141219.5"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"encoding_index_tests 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "encoding-index-simpchinese"
version = "1.20141219.5"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"encoding_index_tests 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "encoding-index-singlebyte"
version = "1.20141219.5"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"encoding_index_tests 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "encoding-index-tradchinese"
version = "1.20141219.5"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"encoding_index_tests 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "encoding_index_tests"
version = "0.1.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
[[package]]
name = "encoding_rs"
version = "0.7.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"cfg-if 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
]
[[package]]
name = "enum_primitive"
version = "0.1.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"num-traits 0.1.43 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "env_logger"
chore: Update log to 0.4 and env_logger to 0.5
2018-08-28 14:41:11 +03:00
version = "0.5.13"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update log to 0.4 and env_logger to 0.5
2018-08-28 14:41:11 +03:00
"atty 0.2.11 (registry+https://github.com/rust-lang/crates.io-index)",
"humantime 1.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
"regex 1.0.4 (registry+https://github.com/rust-lang/crates.io-index)",
"termcolor 1.0.2 (registry+https://github.com/rust-lang/crates.io-index)",
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
]
Ignore CARGO_MAKEFLAGS when calculating Rust hash keys. Fixes #193 Since cargo gained jobserver support it now passes a CARGO_MAKEFLAGS environment variable which is different for every build (it contains file descriptor numbers or semaphore values). sccache uses all environment variables starting with `CARGO_` as inputs to the hash key for Rust compilation so this broke things. I think it was mostly only a problem on Windows, where the values were semaphores. On POSIX platforms the values are file descriptors, which are probably likely to be the same between runs of cargo. This change also adds a test for compiling a simple Rust crate with cargo and verifying that we get a cache hit. I pulled in the `assert_cli` crate to write that test, which worked nicely.
2017-10-25 21:09:27 +03:00
[[package]]
name = "error-chain"
version = "0.11.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
Update assert_cli and tweak some of the tests using it. Also silence a lint warning from error-chain.
2018-07-26 17:16:55 +03:00
[[package]]
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
name = "escargot"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.3.1"
Update assert_cli and tweak some of the tests using it. Also silence a lint warning from error-chain.
2018-07-26 17:16:55 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"serde 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)",
"serde_json 1.0.26 (registry+https://github.com/rust-lang/crates.io-index)",
Ignore CARGO_MAKEFLAGS when calculating Rust hash keys. Fixes #193 Since cargo gained jobserver support it now passes a CARGO_MAKEFLAGS environment variable which is different for every build (it contains file descriptor numbers or semaphore values). sccache uses all environment variables starting with `CARGO_` as inputs to the hash key for Rust compilation so this broke things. I think it was mostly only a problem on Windows, where the values were semaphores. On POSIX platforms the values are file descriptors, which are probably likely to be the same between runs of cargo. This change also adds a test for compiling a simple Rust crate with cargo and verifying that we get a cache hit. I pulled in the `assert_cli` crate to write that test, which worked nicely.
2017-10-25 21:09:27 +03:00
]
turn Compiler into CompilerKind, make a Compiler struct to hold some more info about compilers
2016-05-18 21:30:11 +03:00
[[package]]
name = "filetime"
cargo update
2018-02-01 18:29:23 +03:00
version = "0.1.15"
turn Compiler into CompilerKind, make a Compiler struct to hold some more info about compilers
2016-05-18 21:30:11 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"cfg-if 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"redox_syscall 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)",
turn Compiler into CompilerKind, make a Compiler struct to hold some more info about compilers
2016-05-18 21:30:11 +03:00
]
Bits and pieces for distributed Rust
2018-04-12 04:25:15 +03:00
[[package]]
name = "filetime"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.2.1"
Bits and pieces for distributed Rust
2018-04-12 04:25:15 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"cfg-if 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"redox_syscall 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)",
Bits and pieces for distributed Rust
2018-04-12 04:25:15 +03:00
]
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
[[package]]
name = "flate2"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "1.0.2"
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"miniz_oxide_c_api 0.1.3 (registry+https://github.com/rust-lang/crates.io-index)",
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
]
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
[[package]]
name = "float-cmp"
version = "0.4.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"num-traits 0.2.5 (registry+https://github.com/rust-lang/crates.io-index)",
]
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
[[package]]
name = "foreign-types"
Update ring
2018-01-07 18:33:04 +03:00
version = "0.3.2"
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update ring
2018-01-07 18:33:04 +03:00
dependencies = [
"foreign-types-shared 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
]
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
Don't block sending compile result to client on cache write. Fixes #19. This change makes `get_cached_or_compile` return a `Future` for the cache write instead of blocking on it. The server then waits for the result on a thread. It also changes the server to record cache write timings, and display the average in the stats.
2016-11-03 00:15:14 +03:00
[[package]]
Update ring
2018-01-07 18:33:04 +03:00
name = "foreign-types-shared"
version = "0.1.1"
Don't block sending compile result to client on cache write. Fixes #19. This change makes `get_cached_or_compile` return a `Future` for the cache write instead of blocking on it. The server then waits for the result on a thread. It also changes the server to record cache write timings, and display the average in the stats.
2016-11-03 00:15:14 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
[[package]]
Update ring
2018-01-07 18:33:04 +03:00
name = "fuchsia-zircon"
version = "0.3.3"
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"bitflags 1.0.4 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"fuchsia-zircon-sys 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)",
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
]
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
[[package]]
Update ring
2018-01-07 18:33:04 +03:00
name = "fuchsia-zircon-sys"
version = "0.3.3"
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
use local-encoding crate for stdout conversion
2016-09-21 22:57:28 +03:00
[[package]]
Update ring
2018-01-07 18:33:04 +03:00
name = "futures"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
version = "0.1.23"
Update ring
2018-01-07 18:33:04 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
[[package]]
name = "futures-cpupool"
version = "0.1.8"
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"num_cpus 1.8.0 (registry+https://github.com/rust-lang/crates.io-index)",
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
]
Update ring
2018-01-07 18:33:04 +03:00
[[package]]
name = "gcc"
version = "0.3.54"
source = "registry+https://github.com/rust-lang/crates.io-index"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
[[package]]
name = "getopts"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.2.18"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
dependencies = [
"unicode-width 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
]
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "gzip-header"
version = "0.1.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"crc 1.8.1 (registry+https://github.com/rust-lang/crates.io-index)",
"enum_primitive 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
]
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
[[package]]
name = "httparse"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "1.3.2"
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
chore: Update log to 0.4 and env_logger to 0.5
2018-08-28 14:41:11 +03:00
[[package]]
name = "humantime"
version = "1.1.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"quick-error 1.2.2 (registry+https://github.com/rust-lang/crates.io-index)",
]
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
[[package]]
name = "hyper"
Feature flag toggle for distributed compilation, cleanups
2018-07-31 01:06:14 +03:00
version = "0.11.27"
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"base64 0.9.2 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"bytes 0.4.9 (registry+https://github.com/rust-lang/crates.io-index)",
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"futures-cpupool 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"httparse 1.3.2 (registry+https://github.com/rust-lang/crates.io-index)",
cargo update
2018-02-01 18:29:23 +03:00
"iovec 0.1.2 (registry+https://github.com/rust-lang/crates.io-index)",
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
"language-tags 0.2.2 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
"mime 0.3.9 (registry+https://github.com/rust-lang/crates.io-index)",
"net2 0.2.33 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"percent-encoding 1.0.1 (registry+https://github.com/rust-lang/crates.io-index)",
cargo update
2018-02-01 18:29:23 +03:00
"relay 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"time 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"tokio-core 0.1.17 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
Update to using the new tokio-io crate This is an abstraction of the Tokio stack now and doesn't have much impact on sccache itself but I figured it'd be good to update a few deps and pick up the recent version of things! Plus that and I'd like to start using the length_delimited module soon...
2017-03-09 21:00:18 +03:00
"tokio-proto 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
"tokio-service 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"unicase 2.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
Feature flag toggle for distributed compilation, cleanups
2018-07-31 01:06:14 +03:00
"want 0.0.4 (registry+https://github.com/rust-lang/crates.io-index)",
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
]
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
[[package]]
name = "hyper-tls"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.4"
Use hyper-tls from crates.io
2017-06-15 01:30:32 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
Feature flag toggle for distributed compilation, cleanups
2018-07-31 01:06:14 +03:00
"hyper 0.11.27 (registry+https://github.com/rust-lang/crates.io-index)",
cargo update
2018-02-01 18:29:23 +03:00
"native-tls 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"tokio-core 0.1.17 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
"tokio-service 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"tokio-tls 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
]
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
[[package]]
name = "idna"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.5"
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"matches 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"unicode-bidi 0.3.4 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"unicode-normalization 0.1.7 (registry+https://github.com/rust-lang/crates.io-index)",
Update to using the new tokio-io crate This is an abstraction of the Tokio stack now and doesn't have much impact on sccache itself but I figured it'd be good to update a few deps and pick up the recent version of things! Plus that and I'd like to start using the length_delimited module soon...
2017-03-09 21:00:18 +03:00
]
[[package]]
name = "iovec"
cargo update
2018-02-01 18:29:23 +03:00
version = "0.1.2"
Update to using the new tokio-io crate This is an abstraction of the Tokio stack now and doesn't have much impact on sccache itself but I figured it'd be good to update a few deps and pick up the recent version of things! Plus that and I'd like to start using the length_delimited module soon...
2017-03-09 21:00:18 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Update to using the new tokio-io crate This is an abstraction of the Tokio stack now and doesn't have much impact on sccache itself but I figured it'd be good to update a few deps and pick up the recent version of things! Plus that and I'd like to start using the length_delimited module soon...
2017-03-09 21:00:18 +03:00
"winapi 0.2.8 (registry+https://github.com/rust-lang/crates.io-index)",
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
]
When hashing Rust compile arguments, sort -L and --cfg args as well as --extern
2017-04-03 17:21:13 +03:00
[[package]]
name = "itertools"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.7.8"
When hashing Rust compile arguments, sort -L and --cfg args as well as --extern
2017-04-03 17:21:13 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"either 1.5.0 (registry+https://github.com/rust-lang/crates.io-index)",
When hashing Rust compile arguments, sort -L and --cfg args as well as --extern
2017-04-03 17:21:13 +03:00
]
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "itoa"
version = "0.4.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
Add jobserver support to sccache This commit alters the main sccache server to operate and orchestrate its own GNU make style jobserver. This is primarily intended for interoperation with rustc itself. The Rust compiler currently has a multithreaded mode where it will execute code generation and optimization on the LLVM side of things in parallel. This parallelism, however, can overload a machine quickly if not properly accounted for (e.g. if 10 rustcs all spawn 10 threads...). The usage of a GNU make style jobserver is intended to arbitrate and rate limit all these rustc instances to ensure that one build's maximal parallelism never exceeds a particular amount. Currently for Rust Cargo is the primary driver for setting up a jobserver. Cargo will create this and manage this per compilation, ensuring that any one `cargo build` invocation never exceeds a maximal parallelism. When sccache enters the picture, however, the story gets slightly more odd. The jobserver implementation on Unix relies on inheritance of file descriptors in spawned processes. With sccache, however, there's no inheritance as the actual rustc invocation is spawned by the server, not the client. In this case the env vars used to configure the jobsever are usually incorrect. To handle this problem this commit bakes a jobserver directly into sccache itself. The jobserver then overrides whatever jobserver the client has configured in its own env vars to ensure correct operation. The settings of each jobserver may be misconfigured (there's no way to configure sccache's jobserver right now), but hopefully that's not too much of a problem for the forseeable future. The implementation here was to provide a thin wrapper around the `jobserver` crate with a futures-based interface. This interface was then hooked into the mock command infrastructure to automatically acquire a jobserver token when spawning a process and automatically drop the token when the process exits. Additionally, all spawned processes will now automatically receive a configured jobserver. cc rust-lang/rust#42867, the original motivation for this commit
2017-09-27 19:14:51 +03:00
[[package]]
name = "jobserver"
update jobserver to 0.1.11 to pick up a fix for shutting down the worker thread
2018-03-16 20:39:18 +03:00
version = "0.1.11"
Add jobserver support to sccache This commit alters the main sccache server to operate and orchestrate its own GNU make style jobserver. This is primarily intended for interoperation with rustc itself. The Rust compiler currently has a multithreaded mode where it will execute code generation and optimization on the LLVM side of things in parallel. This parallelism, however, can overload a machine quickly if not properly accounted for (e.g. if 10 rustcs all spawn 10 threads...). The usage of a GNU make style jobserver is intended to arbitrate and rate limit all these rustc instances to ensure that one build's maximal parallelism never exceeds a particular amount. Currently for Rust Cargo is the primary driver for setting up a jobserver. Cargo will create this and manage this per compilation, ensuring that any one `cargo build` invocation never exceeds a maximal parallelism. When sccache enters the picture, however, the story gets slightly more odd. The jobserver implementation on Unix relies on inheritance of file descriptors in spawned processes. With sccache, however, there's no inheritance as the actual rustc invocation is spawned by the server, not the client. In this case the env vars used to configure the jobsever are usually incorrect. To handle this problem this commit bakes a jobserver directly into sccache itself. The jobserver then overrides whatever jobserver the client has configured in its own env vars to ensure correct operation. The settings of each jobserver may be misconfigured (there's no way to configure sccache's jobserver right now), but hopefully that's not too much of a problem for the forseeable future. The implementation here was to provide a thin wrapper around the `jobserver` crate with a futures-based interface. This interface was then hooked into the mock command infrastructure to automatically acquire a jobserver token when spawning a process and automatically drop the token when the process exits. Additionally, all spawned processes will now automatically receive a configured jobserver. cc rust-lang/rust#42867, the original motivation for this commit
2017-09-27 19:14:51 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
"rand 0.4.3 (registry+https://github.com/rust-lang/crates.io-index)",
Add jobserver support to sccache This commit alters the main sccache server to operate and orchestrate its own GNU make style jobserver. This is primarily intended for interoperation with rustc itself. The Rust compiler currently has a multithreaded mode where it will execute code generation and optimization on the LLVM side of things in parallel. This parallelism, however, can overload a machine quickly if not properly accounted for (e.g. if 10 rustcs all spawn 10 threads...). The usage of a GNU make style jobserver is intended to arbitrate and rate limit all these rustc instances to ensure that one build's maximal parallelism never exceeds a particular amount. Currently for Rust Cargo is the primary driver for setting up a jobserver. Cargo will create this and manage this per compilation, ensuring that any one `cargo build` invocation never exceeds a maximal parallelism. When sccache enters the picture, however, the story gets slightly more odd. The jobserver implementation on Unix relies on inheritance of file descriptors in spawned processes. With sccache, however, there's no inheritance as the actual rustc invocation is spawned by the server, not the client. In this case the env vars used to configure the jobsever are usually incorrect. To handle this problem this commit bakes a jobserver directly into sccache itself. The jobserver then overrides whatever jobserver the client has configured in its own env vars to ensure correct operation. The settings of each jobserver may be misconfigured (there's no way to configure sccache's jobserver right now), but hopefully that's not too much of a problem for the forseeable future. The implementation here was to provide a thin wrapper around the `jobserver` crate with a futures-based interface. This interface was then hooked into the mock command infrastructure to automatically acquire a jobserver token when spawning a process and automatically drop the token when the process exits. Additionally, all spawned processes will now automatically receive a configured jobserver. cc rust-lang/rust#42867, the original motivation for this commit
2017-09-27 19:14:51 +03:00
]
Implement GCS backend
2017-05-06 03:02:48 +03:00
[[package]]
name = "jsonwebtoken"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
version = "5.0.0"
Implement GCS backend
2017-05-06 03:02:48 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"base64 0.9.2 (registry+https://github.com/rust-lang/crates.io-index)",
"chrono 0.4.6 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"ring 0.13.2 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"serde 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)",
"serde_derive 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)",
"serde_json 1.0.26 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"untrusted 0.6.2 (registry+https://github.com/rust-lang/crates.io-index)",
Implement GCS backend
2017-05-06 03:02:48 +03:00
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "kernel32-sys"
version = "0.2.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Update to a released rusoto, and 'cargo update' while we're at it
2016-07-15 18:06:16 +03:00
"winapi 0.2.8 (registry+https://github.com/rust-lang/crates.io-index)",
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
"winapi-build 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
]
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
[[package]]
name = "language-tags"
version = "0.2.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
[[package]]
name = "lazy_static"
Update ring
2018-01-07 18:33:04 +03:00
version = "0.2.11"
source = "registry+https://github.com/rust-lang/crates.io-index"
[[package]]
name = "lazy_static"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "1.1.0"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
dependencies = [
"version_check 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
]
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
[[package]]
name = "lazycell"
Update ring
2018-01-07 18:33:04 +03:00
version = "0.6.0"
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "libc"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.2.43"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "libflate"
version = "0.1.16"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"adler32 1.0.3 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"byteorder 1.2.6 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"crc 1.8.1 (registry+https://github.com/rust-lang/crates.io-index)",
]
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
[[package]]
name = "libmount"
version = "0.1.11"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"nix 0.11.0 (registry+https://github.com/rust-lang/crates.io-index)",
"quick-error 1.2.2 (registry+https://github.com/rust-lang/crates.io-index)",
]
Make DiskCache limit the size of the on-disk cache by using LruDiskCache. Fixes #29
2016-11-29 03:59:42 +03:00
[[package]]
name = "linked-hash-map"
version = "0.2.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
use local-encoding crate for stdout conversion
2016-09-21 22:57:28 +03:00
[[package]]
name = "local-encoding"
version = "0.2.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"kernel32-sys 0.2.2 (registry+https://github.com/rust-lang/crates.io-index)",
"skeptic 0.4.0 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi 0.2.8 (registry+https://github.com/rust-lang/crates.io-index)",
]
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
[[package]]
name = "lock_api"
version = "0.1.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"owning_ref 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)",
"scopeguard 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)",
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "log"
Update ring
2018-01-07 18:33:04 +03:00
version = "0.3.9"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Make DiskCache limit the size of the on-disk cache by using LruDiskCache. Fixes #29
2016-11-29 03:59:42 +03:00
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
Make DiskCache limit the size of the on-disk cache by using LruDiskCache. Fixes #29
2016-11-29 03:59:42 +03:00
]
Update iovec to fix a soundness hole on Windows Also update a few other dependencies that transitively needed fixing
2017-10-06 02:40:25 +03:00
[[package]]
Update ring
2018-01-07 18:33:04 +03:00
name = "log"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.4.4"
Update iovec to fix a soundness hole on Windows Also update a few other dependencies that transitively needed fixing
2017-10-06 02:40:25 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"cfg-if 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
Update iovec to fix a soundness hole on Windows Also update a few other dependencies that transitively needed fixing
2017-10-06 02:40:25 +03:00
]
[[package]]
Update ring
2018-01-07 18:33:04 +03:00
name = "lru-disk-cache"
Bump lru-disk-cache to 0.2.0 so we can publish it to crates.io because we made an API change
2018-01-30 19:54:20 +03:00
version = "0.2.0"
Update iovec to fix a soundness hole on Windows Also update a few other dependencies that transitively needed fixing
2017-10-06 02:40:25 +03:00
dependencies = [
cargo update
2018-02-01 18:29:23 +03:00
"filetime 0.1.15 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"linked-hash-map 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)",
"log 0.3.9 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"tempdir 0.3.7 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"walkdir 1.0.7 (registry+https://github.com/rust-lang/crates.io-index)",
Update iovec to fix a soundness hole on Windows Also update a few other dependencies that transitively needed fixing
2017-10-06 02:40:25 +03:00
]
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
[[package]]
name = "matches"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.8"
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
[[package]]
name = "memcached-rs"
version = "0.1.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"bufstream 0.1.3 (registry+https://github.com/rust-lang/crates.io-index)",
"byteorder 0.4.2 (registry+https://github.com/rust-lang/crates.io-index)",
"conhash 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)",
"log 0.3.9 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"rand 0.3.22 (registry+https://github.com/rust-lang/crates.io-index)",
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
"semver 0.2.3 (registry+https://github.com/rust-lang/crates.io-index)",
"unix_socket 0.5.0 (registry+https://github.com/rust-lang/crates.io-index)",
]
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "memchr"
version = "1.0.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "memchr"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "2.0.2"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
]
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
[[package]]
name = "memoffset"
version = "0.2.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "mime"
version = "0.2.6"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"log 0.3.9 (registry+https://github.com/rust-lang/crates.io-index)",
]
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
[[package]]
name = "mime"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.3.9"
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Update ring
2018-01-07 18:33:04 +03:00
"unicase 2.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
]
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "mime_guess"
version = "1.8.6"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"mime 0.2.6 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"phf 0.7.23 (registry+https://github.com/rust-lang/crates.io-index)",
"phf_codegen 0.7.23 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"unicase 1.4.2 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "mime_guess"
version = "2.0.0-alpha.6"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"mime 0.3.9 (registry+https://github.com/rust-lang/crates.io-index)",
"phf 0.7.23 (registry+https://github.com/rust-lang/crates.io-index)",
"phf_codegen 0.7.23 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"unicase 1.4.2 (registry+https://github.com/rust-lang/crates.io-index)",
]
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
[[package]]
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
name = "miniz_oxide"
version = "0.1.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"adler32 1.0.3 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
]
[[package]]
name = "miniz_oxide_c_api"
version = "0.1.3"
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"cc 1.0.23 (registry+https://github.com/rust-lang/crates.io-index)",
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"crc 1.8.1 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"miniz_oxide 0.1.3 (registry+https://github.com/rust-lang/crates.io-index)",
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "mio"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
version = "0.6.15"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Update ring
2018-01-07 18:33:04 +03:00
"fuchsia-zircon 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)",
"fuchsia-zircon-sys 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)",
cargo update
2018-02-01 18:29:23 +03:00
"iovec 0.1.2 (registry+https://github.com/rust-lang/crates.io-index)",
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
"kernel32-sys 0.2.2 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"lazycell 0.6.0 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
Update to using the new tokio-io crate This is an abstraction of the Tokio stack now and doesn't have much impact on sccache itself but I figured it'd be good to update a few deps and pick up the recent version of things! Plus that and I'd like to start using the length_delimited module soon...
2017-03-09 21:00:18 +03:00
"miow 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"net2 0.2.33 (registry+https://github.com/rust-lang/crates.io-index)",
"slab 0.4.1 (registry+https://github.com/rust-lang/crates.io-index)",
Update to a released rusoto, and 'cargo update' while we're at it
2016-07-15 18:06:16 +03:00
"winapi 0.2.8 (registry+https://github.com/rust-lang/crates.io-index)",
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
]
Integrate process spawning with tokio-process This commit replaces all process spawning with the futures-powered versions in the `tokio-process` crate. Most functions were already ready to return futures, but a few minor updates were made to ensure that functions could return futures. Additionally, some `&CpuPool` arguments have shown up to allow executing work on a thread pool, such as filesystem operations. A number of compilers write data to tempdirs and such before running a compiler, and these are all executed on thread pools rather than the main thread. My main takeaway from this commit is that translating synchronous to asynchronous code isn't always easy. The "easy" version ends up being relatively wasteful in terms of clones for low-level performance, but probably shouldn't matter much in the context of spawning processes. Other than that though I found that there was a translation for all patterns found didn't actually hit any bugs (yet at least) from the translation.
2017-02-01 03:19:35 +03:00
[[package]]
name = "mio-named-pipes"
Update ring
2018-01-07 18:33:04 +03:00
version = "0.1.6"
Integrate process spawning with tokio-process This commit replaces all process spawning with the futures-powered versions in the `tokio-process` crate. Most functions were already ready to return futures, but a few minor updates were made to ensure that functions could return futures. Additionally, some `&CpuPool` arguments have shown up to allow executing work on a thread pool, such as filesystem operations. A number of compilers write data to tempdirs and such before running a compiler, and these are all executed on thread pools rather than the main thread. My main takeaway from this commit is that translating synchronous to asynchronous code isn't always easy. The "easy" version ends up being relatively wasteful in terms of clones for low-level performance, but probably shouldn't matter much in the context of spawning processes. Other than that though I found that there was a translation for all patterns found didn't actually hit any bugs (yet at least) from the translation.
2017-02-01 03:19:35 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"mio 0.6.15 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"miow 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate process spawning with tokio-process This commit replaces all process spawning with the futures-powered versions in the `tokio-process` crate. Most functions were already ready to return futures, but a few minor updates were made to ensure that functions could return futures. Additionally, some `&CpuPool` arguments have shown up to allow executing work on a thread pool, such as filesystem operations. A number of compilers write data to tempdirs and such before running a compiler, and these are all executed on thread pools rather than the main thread. My main takeaway from this commit is that translating synchronous to asynchronous code isn't always easy. The "easy" version ends up being relatively wasteful in terms of clones for low-level performance, but probably shouldn't matter much in the context of spawning processes. Other than that though I found that there was a translation for all patterns found didn't actually hit any bugs (yet at least) from the translation.
2017-02-01 03:19:35 +03:00
]
[[package]]
name = "mio-uds"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.6.6"
Integrate process spawning with tokio-process This commit replaces all process spawning with the futures-powered versions in the `tokio-process` crate. Most functions were already ready to return futures, but a few minor updates were made to ensure that functions could return futures. Additionally, some `&CpuPool` arguments have shown up to allow executing work on a thread pool, such as filesystem operations. A number of compilers write data to tempdirs and such before running a compiler, and these are all executed on thread pools rather than the main thread. My main takeaway from this commit is that translating synchronous to asynchronous code isn't always easy. The "easy" version ends up being relatively wasteful in terms of clones for low-level performance, but probably shouldn't matter much in the context of spawning processes. Other than that though I found that there was a translation for all patterns found didn't actually hit any bugs (yet at least) from the translation.
2017-02-01 03:19:35 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"iovec 0.1.2 (registry+https://github.com/rust-lang/crates.io-index)",
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"mio 0.6.15 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate process spawning with tokio-process This commit replaces all process spawning with the futures-powered versions in the `tokio-process` crate. Most functions were already ready to return futures, but a few minor updates were made to ensure that functions could return futures. Additionally, some `&CpuPool` arguments have shown up to allow executing work on a thread pool, such as filesystem operations. A number of compilers write data to tempdirs and such before running a compiler, and these are all executed on thread pools rather than the main thread. My main takeaway from this commit is that translating synchronous to asynchronous code isn't always easy. The "easy" version ends up being relatively wasteful in terms of clones for low-level performance, but probably shouldn't matter much in the context of spawning processes. Other than that though I found that there was a translation for all patterns found didn't actually hit any bugs (yet at least) from the translation.
2017-02-01 03:19:35 +03:00
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "miow"
Update to using the new tokio-io crate This is an abstraction of the Tokio stack now and doesn't have much impact on sccache itself but I figured it'd be good to update a few deps and pick up the recent version of things! Plus that and I'd like to start using the length_delimited module soon...
2017-03-09 21:00:18 +03:00
version = "0.2.1"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"kernel32-sys 0.2.2 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"net2 0.2.33 (registry+https://github.com/rust-lang/crates.io-index)",
Update to a released rusoto, and 'cargo update' while we're at it
2016-07-15 18:06:16 +03:00
"winapi 0.2.8 (registry+https://github.com/rust-lang/crates.io-index)",
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
"ws2_32-sys 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)",
]
Update ring
2018-01-07 18:33:04 +03:00
[[package]]
name = "miow"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.3.3"
Update ring
2018-01-07 18:33:04 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"socket2 0.3.8 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
]
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
[[package]]
name = "msdos_time"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.6"
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"time 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
]
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "multipart"
version = "0.13.6"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"buf_redux 0.6.3 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"httparse 1.3.2 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"log 0.3.9 (registry+https://github.com/rust-lang/crates.io-index)",
"mime 0.2.6 (registry+https://github.com/rust-lang/crates.io-index)",
"mime_guess 1.8.6 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"rand 0.3.22 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"safemem 0.2.0 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"tempdir 0.3.7 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"twoway 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
]
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
[[package]]
name = "native-tls"
cargo update
2018-02-01 18:29:23 +03:00
version = "0.1.5"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
cargo update
2018-02-01 18:29:23 +03:00
"lazy_static 0.2.11 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"openssl 0.9.24 (registry+https://github.com/rust-lang/crates.io-index)",
"schannel 0.1.13 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"security-framework 0.1.16 (registry+https://github.com/rust-lang/crates.io-index)",
"security-framework-sys 0.1.16 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"tempdir 0.3.7 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "net2"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.2.33"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"cfg-if 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
]
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
[[package]]
name = "nix"
version = "0.11.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"bitflags 1.0.4 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"cc 1.0.23 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"cfg-if 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"void 1.0.2 (registry+https://github.com/rust-lang/crates.io-index)",
]
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
[[package]]
name = "nodrop"
version = "0.1.12"
source = "registry+https://github.com/rust-lang/crates.io-index"
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
[[package]]
name = "nom"
version = "1.2.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
[[package]]
name = "normalize-line-endings"
version = "0.2.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
drop format_size code in favor of number_prefix crate
2016-05-12 22:46:22 +03:00
[[package]]
name = "num-integer"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.39"
drop format_size code in favor of number_prefix crate
2016-05-12 22:46:22 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"num-traits 0.2.5 (registry+https://github.com/rust-lang/crates.io-index)",
drop format_size code in favor of number_prefix crate
2016-05-12 22:46:22 +03:00
]
[[package]]
name = "num-traits"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.43"
drop format_size code in favor of number_prefix crate
2016-05-12 22:46:22 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
dependencies = [
"num-traits 0.2.5 (registry+https://github.com/rust-lang/crates.io-index)",
]
drop format_size code in favor of number_prefix crate
2016-05-12 22:46:22 +03:00
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
[[package]]
name = "num-traits"
version = "0.2.5"
source = "registry+https://github.com/rust-lang/crates.io-index"
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
[[package]]
name = "num_cpus"
Update ring
2018-01-07 18:33:04 +03:00
version = "1.8.0"
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
]
drop format_size code in favor of number_prefix crate
2016-05-12 22:46:22 +03:00
[[package]]
name = "number_prefix"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.2.8"
drop format_size code in favor of number_prefix crate
2016-05-12 22:46:22 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"num-traits 0.2.5 (registry+https://github.com/rust-lang/crates.io-index)",
drop format_size code in favor of number_prefix crate
2016-05-12 22:46:22 +03:00
]
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
[[package]]
name = "openssl"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.9.24"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
"bitflags 0.9.1 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"foreign-types 0.3.2 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"lazy_static 1.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"openssl-sys 0.9.35 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
]
[[package]]
name = "openssl-sys"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.9.35"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"cc 1.0.23 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"pkg-config 0.3.14 (registry+https://github.com/rust-lang/crates.io-index)",
"vcpkg 0.2.6 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "owning_ref"
version = "0.3.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"stable_deref_trait 1.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "parking_lot"
version = "0.6.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"lock_api 0.1.3 (registry+https://github.com/rust-lang/crates.io-index)",
"parking_lot_core 0.3.0 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "parking_lot_core"
version = "0.3.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"rand 0.5.5 (registry+https://github.com/rust-lang/crates.io-index)",
"smallvec 0.6.5 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
]
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
[[package]]
name = "percent-encoding"
Update ring
2018-01-07 18:33:04 +03:00
version = "1.0.1"
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "phf"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.7.23"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"phf_shared 0.7.23 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
]
[[package]]
name = "phf_codegen"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.7.23"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"phf_generator 0.7.23 (registry+https://github.com/rust-lang/crates.io-index)",
"phf_shared 0.7.23 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
]
[[package]]
name = "phf_generator"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.7.23"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"phf_shared 0.7.23 (registry+https://github.com/rust-lang/crates.io-index)",
"rand 0.5.5 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
]
[[package]]
name = "phf_shared"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.7.23"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"siphasher 0.2.3 (registry+https://github.com/rust-lang/crates.io-index)",
"unicase 1.4.2 (registry+https://github.com/rust-lang/crates.io-index)",
]
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
[[package]]
name = "pkg-config"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.3.14"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
[[package]]
name = "podio"
cargo update
2018-02-01 18:29:23 +03:00
version = "0.1.6"
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
[[package]]
name = "predicates"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.9.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
dependencies = [
"difference 2.0.0 (registry+https://github.com/rust-lang/crates.io-index)",
"float-cmp 0.4.0 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"normalize-line-endings 0.2.2 (registry+https://github.com/rust-lang/crates.io-index)",
"predicates-core 0.9.0 (registry+https://github.com/rust-lang/crates.io-index)",
"regex 1.0.4 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "predicates-core"
version = "0.9.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
[[package]]
name = "predicates-tree"
version = "0.9.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"predicates-core 0.9.0 (registry+https://github.com/rust-lang/crates.io-index)",
"treeline 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "proc-macro2"
version = "0.4.15"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"unicode-xid 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
]
use local-encoding crate for stdout conversion
2016-09-21 22:57:28 +03:00
[[package]]
name = "pulldown-cmark"
version = "0.0.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"getopts 0.2.18 (registry+https://github.com/rust-lang/crates.io-index)",
use local-encoding crate for stdout conversion
2016-09-21 22:57:28 +03:00
]
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
[[package]]
name = "quick-error"
version = "1.2.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
[[package]]
name = "quote"
version = "0.3.15"
source = "registry+https://github.com/rust-lang/crates.io-index"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
[[package]]
name = "quote"
version = "0.6.8"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"proc-macro2 0.4.15 (registry+https://github.com/rust-lang/crates.io-index)",
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "rand"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.3.22"
Update ring
2018-01-07 18:33:04 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"fuchsia-zircon 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"rand 0.4.3 (registry+https://github.com/rust-lang/crates.io-index)",
cargo update
2018-02-01 18:29:23 +03:00
]
[[package]]
name = "rand"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.4.3"
cargo update
2018-02-01 18:29:23 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"fuchsia-zircon 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
]
[[package]]
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
name = "rand"
version = "0.5.5"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"cloudabi 0.0.3 (registry+https://github.com/rust-lang/crates.io-index)",
"fuchsia-zircon 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"rand_core 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
]
Switch from SHA-1 to SHA-512 Local benchmarking showed that the implementation of SHA-512 in the *ring* crate is 3x faster than the implementation of SHA-1 in the `sha1` crate. I've also noticed that 80%+ of sccache's runtime on a fully cached build is spent hashing. With this change I noticed a decrease from 108s to 92s when building a fully cached LLVM from the network. Not a huge win but if the network were faster could perhaps add up! Closes #108
2017-04-21 07:09:15 +03:00
[[package]]
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
name = "rand_core"
version = "0.2.1"
Switch from SHA-1 to SHA-512 Local benchmarking showed that the implementation of SHA-512 in the *ring* crate is 3x faster than the implementation of SHA-1 in the `sha1` crate. I've also noticed that 80%+ of sccache's runtime on a fully cached build is spent hashing. With this change I noticed a decrease from 108s to 92s when building a fully cached LLVM from the network. Not a huge win but if the network were faster could perhaps add up! Closes #108
2017-04-21 07:09:15 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Add a Redis cache variant This cache module uses a Redis instance. To make sccache use this, set SCCACHE_REDIS to redis://[:<passwd>@]<hostname>[:port][/<db>]. The maximum and current cache size is retrieved from the INFO and CONFIG GET redis command.
2017-02-16 22:56:41 +03:00
[[package]]
name = "redis"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
version = "0.9.0"
Add a Redis cache variant This cache module uses a Redis instance. To make sccache use this, set SCCACHE_REDIS to redis://[:<passwd>@]<hostname>[:port][/<db>]. The maximum and current cache size is retrieved from the INFO and CONFIG GET redis command.
2017-02-16 22:56:41 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"bytes 0.4.9 (registry+https://github.com/rust-lang/crates.io-index)",
"combine 3.5.1 (registry+https://github.com/rust-lang/crates.io-index)",
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
"sha1 0.6.0 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-codec 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-executor 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-tcp 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"url 1.7.1 (registry+https://github.com/rust-lang/crates.io-index)",
Add a Redis cache variant This cache module uses a Redis instance. To make sccache use this, set SCCACHE_REDIS to redis://[:<passwd>@]<hostname>[:port][/<db>]. The maximum and current cache size is retrieved from the INFO and CONFIG GET redis command.
2017-02-16 22:56:41 +03:00
]
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
[[package]]
name = "redox_syscall"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.40"
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update ring
2018-01-07 18:33:04 +03:00
[[package]]
name = "redox_termios"
version = "0.1.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"redox_syscall 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
]
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
[[package]]
name = "regex"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "1.0.4"
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"aho-corasick 0.6.8 (registry+https://github.com/rust-lang/crates.io-index)",
"memchr 2.0.2 (registry+https://github.com/rust-lang/crates.io-index)",
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
"regex-syntax 0.6.2 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"thread_local 0.3.6 (registry+https://github.com/rust-lang/crates.io-index)",
"utf8-ranges 1.0.1 (registry+https://github.com/rust-lang/crates.io-index)",
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
]
[[package]]
name = "regex-syntax"
version = "0.6.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"ucd-util 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
]
Update ring
2018-01-07 18:33:04 +03:00
[[package]]
name = "relay"
cargo update
2018-02-01 18:29:23 +03:00
version = "0.1.1"
Update ring
2018-01-07 18:33:04 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
cargo update
2018-02-01 18:29:23 +03:00
]
[[package]]
name = "remove_dir_all"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.5.1"
cargo update
2018-02-01 18:29:23 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
]
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "reqwest"
Feature flag toggle for distributed compilation, cleanups
2018-07-31 01:06:14 +03:00
version = "0.8.6"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"bytes 0.4.9 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"encoding_rs 0.7.2 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
Feature flag toggle for distributed compilation, cleanups
2018-07-31 01:06:14 +03:00
"hyper 0.11.27 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"hyper-tls 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"libflate 0.1.16 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"mime_guess 2.0.0-alpha.6 (registry+https://github.com/rust-lang/crates.io-index)",
"native-tls 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"serde 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)",
"serde_json 1.0.26 (registry+https://github.com/rust-lang/crates.io-index)",
"serde_urlencoded 0.5.3 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"tokio-core 0.1.17 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"tokio-tls 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"url 1.7.1 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"uuid 0.6.5 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "retry"
version = "0.4.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"rand 0.3.22 (registry+https://github.com/rust-lang/crates.io-index)",
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
]
Switch from SHA-1 to SHA-512 Local benchmarking showed that the implementation of SHA-512 in the *ring* crate is 3x faster than the implementation of SHA-1 in the `sha1` crate. I've also noticed that 80%+ of sccache's runtime on a fully cached build is spent hashing. With this change I noticed a decrease from 108s to 92s when building a fully cached LLVM from the network. Not a huge win but if the network were faster could perhaps add up! Closes #108
2017-04-21 07:09:15 +03:00
[[package]]
name = "ring"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
version = "0.13.2"
Switch from SHA-1 to SHA-512 Local benchmarking showed that the implementation of SHA-512 in the *ring* crate is 3x faster than the implementation of SHA-1 in the `sha1` crate. I've also noticed that 80%+ of sccache's runtime on a fully cached build is spent hashing. With this change I noticed a decrease from 108s to 92s when building a fully cached LLVM from the network. Not a huge win but if the network were faster could perhaps add up! Closes #108
2017-04-21 07:09:15 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"cc 1.0.23 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"lazy_static 1.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"untrusted 0.6.2 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
]
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "rouille"
version = "2.1.0"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
source = "git+https://github.com/tomaka/rouille.git?rev=7b6b2eb#7b6b2eb6cd9df8b9fd0dbb1f057a8cb9d568282c"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"base64 0.9.2 (registry+https://github.com/rust-lang/crates.io-index)",
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"brotli2 0.3.2 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"chrono 0.4.6 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"deflate 0.7.18 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"filetime 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"multipart 0.13.6 (registry+https://github.com/rust-lang/crates.io-index)",
"num_cpus 1.8.0 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"rand 0.4.3 (registry+https://github.com/rust-lang/crates.io-index)",
"serde 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)",
"serde_derive 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)",
"serde_json 1.0.26 (registry+https://github.com/rust-lang/crates.io-index)",
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"sha1 0.6.0 (registry+https://github.com/rust-lang/crates.io-index)",
"term 0.5.1 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"threadpool 1.7.1 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"time 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)",
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"tiny_http 0.6.0 (registry+https://github.com/rust-lang/crates.io-index)",
"url 1.7.1 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
]
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
[[package]]
drop rusoto, import some simple s3 code and use that
2016-08-12 21:03:37 +03:00
name = "rust-crypto"
version = "0.2.36"
source = "registry+https://github.com/rust-lang/crates.io-index"
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
dependencies = [
Update ring
2018-01-07 18:33:04 +03:00
"gcc 0.3.54 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"rand 0.3.22 (registry+https://github.com/rust-lang/crates.io-index)",
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
"rustc-serialize 0.3.24 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"time 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)",
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
]
drop format_size code in favor of number_prefix crate
2016-05-12 22:46:22 +03:00
[[package]]
name = "rustc-serialize"
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
version = "0.3.24"
drop format_size code in favor of number_prefix crate
2016-05-12 22:46:22 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
[[package]]
name = "ryu"
version = "0.2.6"
source = "registry+https://github.com/rust-lang/crates.io-index"
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
[[package]]
name = "safemem"
version = "0.2.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
[[package]]
name = "same-file"
version = "0.1.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"kernel32-sys 0.2.2 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi 0.2.8 (registry+https://github.com/rust-lang/crates.io-index)",
]
Rebuild Cargo.lock with cargo 0.23
2017-12-05 16:32:33 +03:00
[[package]]
name = "sccache"
(cargo-release) start next development iteration 0.2.8-alpha.0
2018-07-12 14:33:52 +03:00
version = "0.2.8-alpha.0"
Rebuild Cargo.lock with cargo 0.23
2017-12-05 16:32:33 +03:00
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"arraydeque 0.4.3 (registry+https://github.com/rust-lang/crates.io-index)",
"assert_cmd 0.9.1 (registry+https://github.com/rust-lang/crates.io-index)",
"atty 0.2.11 (registry+https://github.com/rust-lang/crates.io-index)",
"base64 0.9.2 (registry+https://github.com/rust-lang/crates.io-index)",
Update other deps
2018-01-07 18:58:55 +03:00
"bincode 0.9.2 (registry+https://github.com/rust-lang/crates.io-index)",
Use a trait to represent compiler packagers
2018-07-18 23:21:06 +03:00
"boxfnonce 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"byteorder 1.2.6 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"bytes 0.4.9 (registry+https://github.com/rust-lang/crates.io-index)",
"cc 1.0.23 (registry+https://github.com/rust-lang/crates.io-index)",
Update chrono to 0.4
2018-08-28 14:37:42 +03:00
"chrono 0.4.6 (registry+https://github.com/rust-lang/crates.io-index)",
Silence some warnings
2018-07-12 13:46:33 +03:00
"clap 2.32.0 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update crossbeam-utils to 0.5
2018-08-28 14:55:46 +03:00
"crossbeam-utils 0.5.0 (registry+https://github.com/rust-lang/crates.io-index)",
Rebuild Cargo.lock with cargo 0.23
2017-12-05 16:32:33 +03:00
"daemonize 0.2.3 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update directories to 1.0
2018-08-28 14:47:30 +03:00
"directories 1.0.1 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update log to 0.4 and env_logger to 0.5
2018-08-28 14:41:11 +03:00
"env_logger 0.5.13 (registry+https://github.com/rust-lang/crates.io-index)",
Rebuild Cargo.lock with cargo 0.23
2017-12-05 16:32:33 +03:00
"error-chain 0.11.0 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update filetime to 0.2
2018-08-28 14:56:27 +03:00
"filetime 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"flate2 1.0.2 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"futures-cpupool 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
Feature flag toggle for distributed compilation, cleanups
2018-07-31 01:06:14 +03:00
"hyper 0.11.27 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"itertools 0.7.8 (registry+https://github.com/rust-lang/crates.io-index)",
update jobserver to 0.1.11 to pick up a fix for shutting down the worker thread
2018-03-16 20:39:18 +03:00
"jobserver 0.1.11 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"jsonwebtoken 5.0.0 (registry+https://github.com/rust-lang/crates.io-index)",
Rebuild Cargo.lock with cargo 0.23
2017-12-05 16:32:33 +03:00
"kernel32-sys 0.2.2 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"lazy_static 1.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Move all into single crate
2018-08-04 16:36:35 +03:00
"libmount 0.1.11 (registry+https://github.com/rust-lang/crates.io-index)",
Rebuild Cargo.lock with cargo 0.23
2017-12-05 16:32:33 +03:00
"local-encoding 0.2.0 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update log to 0.4 and env_logger to 0.5
2018-08-28 14:41:11 +03:00
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
Bump lru-disk-cache to 0.2.0 so we can publish it to crates.io because we made an API change
2018-01-30 19:54:20 +03:00
"lru-disk-cache 0.2.0",
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
"memcached-rs 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"mio-named-pipes 0.1.6 (registry+https://github.com/rust-lang/crates.io-index)",
cargo update
2018-02-01 18:29:23 +03:00
"native-tls 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
Move all into single crate
2018-08-04 16:36:35 +03:00
"nix 0.11.0 (registry+https://github.com/rust-lang/crates.io-index)",
Add jobserver support to sccache This commit alters the main sccache server to operate and orchestrate its own GNU make style jobserver. This is primarily intended for interoperation with rustc itself. The Rust compiler currently has a multithreaded mode where it will execute code generation and optimization on the LLVM side of things in parallel. This parallelism, however, can overload a machine quickly if not properly accounted for (e.g. if 10 rustcs all spawn 10 threads...). The usage of a GNU make style jobserver is intended to arbitrate and rate limit all these rustc instances to ensure that one build's maximal parallelism never exceeds a particular amount. Currently for Rust Cargo is the primary driver for setting up a jobserver. Cargo will create this and manage this per compilation, ensuring that any one `cargo build` invocation never exceeds a maximal parallelism. When sccache enters the picture, however, the story gets slightly more odd. The jobserver implementation on Unix relies on inheritance of file descriptors in spawned processes. With sccache, however, there's no inheritance as the actual rustc invocation is spawned by the server, not the client. In this case the env vars used to configure the jobsever are usually incorrect. To handle this problem this commit bakes a jobserver directly into sccache itself. The jobserver then overrides whatever jobserver the client has configured in its own env vars to ensure correct operation. The settings of each jobserver may be misconfigured (there's no way to configure sccache's jobserver right now), but hopefully that's not too much of a problem for the forseeable future. The implementation here was to provide a thin wrapper around the `jobserver` crate with a futures-based interface. This interface was then hooked into the mock command infrastructure to automatically acquire a jobserver token when spawning a process and automatically drop the token when the process exits. Additionally, all spawned processes will now automatically receive a configured jobserver. cc rust-lang/rust#42867, the original motivation for this commit
2017-09-27 19:14:51 +03:00
"num_cpus 1.8.0 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"number_prefix 0.2.8 (registry+https://github.com/rust-lang/crates.io-index)",
"openssl 0.9.24 (registry+https://github.com/rust-lang/crates.io-index)",
"predicates 0.9.0 (registry+https://github.com/rust-lang/crates.io-index)",
"rand 0.4.3 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"redis 0.9.0 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update regex to 1
2018-08-28 15:02:13 +03:00
"regex 1.0.4 (registry+https://github.com/rust-lang/crates.io-index)",
Move all into single crate
2018-08-04 16:36:35 +03:00
"reqwest 0.8.6 (registry+https://github.com/rust-lang/crates.io-index)",
Rebuild Cargo.lock with cargo 0.23
2017-12-05 16:32:33 +03:00
"retry 0.4.0 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"ring 0.13.2 (registry+https://github.com/rust-lang/crates.io-index)",
Move all into single crate
2018-08-04 16:36:35 +03:00
"rouille 2.1.0 (git+https://github.com/tomaka/rouille.git?rev=7b6b2eb)",
Rebuild Cargo.lock with cargo 0.23
2017-12-05 16:32:33 +03:00
"rust-crypto 0.2.36 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"serde 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)",
"serde_derive 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)",
"serde_json 1.0.26 (registry+https://github.com/rust-lang/crates.io-index)",
Always request color output from rustc. Fixes #99 This change makes sccache run rustc with `--color=always`, removing any other --color option from the compiler options so that it's not included in the cache key. A `color_mode` method is added to the `CompilerHasher` trait, and the value is sent back to the client in the `CompileFinished` method, so the client can determine whether specific --color options were passed without having to do its own commandline parsing. The client uses the new `strip-ansi-escapes` crate to remove escape codes from the compiler output in situations where color output is not desired: * When `--color=never` was passed on the compiler commandline. * When `--color=auto` is in effect (the default) but the output is not a terminal. The existing cargo tests were lightly modified to run compile once with `--color=never` and once with `--color=always` to validate that cache hits are not affected by color options.
2018-02-02 15:11:11 +03:00
"strip-ansi-escapes 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"tar 0.4.16 (registry+https://github.com/rust-lang/crates.io-index)",
"tempdir 0.3.7 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update tempfile to 3
2018-08-28 15:20:49 +03:00
"tempfile 3.0.3 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"time 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"tokio-core 0.1.17 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"tokio-process 0.1.6 (registry+https://github.com/rust-lang/crates.io-index)",
Rebuild Cargo.lock with cargo 0.23
2017-12-05 16:32:33 +03:00
"tokio-proto 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-serde-bincode 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-service 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"tokio-tls 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update tokio_uds to 0.2
2018-08-28 15:22:37 +03:00
"tokio-uds 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)",
Allow configuration of caches with a config file
2018-06-04 20:28:39 +03:00
"toml 0.4.6 (registry+https://github.com/rust-lang/crates.io-index)",
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"url 1.7.1 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"uuid 0.6.5 (registry+https://github.com/rust-lang/crates.io-index)",
"which 1.0.5 (registry+https://github.com/rust-lang/crates.io-index)",
Rebuild Cargo.lock with cargo 0.23
2017-12-05 16:32:33 +03:00
"winapi 0.2.8 (registry+https://github.com/rust-lang/crates.io-index)",
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"zip 0.4.2 (registry+https://github.com/rust-lang/crates.io-index)",
Rebuild Cargo.lock with cargo 0.23
2017-12-05 16:32:33 +03:00
]
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
[[package]]
name = "schannel"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.13"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"lazy_static 1.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
]
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
[[package]]
name = "scoped-tls"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.2"
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
[[package]]
name = "scopeguard"
Update ring
2018-01-07 18:33:04 +03:00
version = "0.3.3"
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
[[package]]
name = "security-framework"
Update ring
2018-01-07 18:33:04 +03:00
version = "0.1.16"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"core-foundation 0.2.3 (registry+https://github.com/rust-lang/crates.io-index)",
"core-foundation-sys 0.2.3 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"security-framework-sys 0.1.16 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
]
[[package]]
name = "security-framework-sys"
Update ring
2018-01-07 18:33:04 +03:00
version = "0.1.16"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"core-foundation-sys 0.2.3 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
]
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
[[package]]
name = "semver"
version = "0.2.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"nom 1.2.4 (registry+https://github.com/rust-lang/crates.io-index)",
]
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
[[package]]
name = "serde"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "1.0.75"
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"serde_derive 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)",
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
]
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
[[package]]
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
name = "serde_derive"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "1.0.75"
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"proc-macro2 0.4.15 (registry+https://github.com/rust-lang/crates.io-index)",
"quote 0.6.8 (registry+https://github.com/rust-lang/crates.io-index)",
"syn 0.14.9 (registry+https://github.com/rust-lang/crates.io-index)",
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
]
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
[[package]]
name = "serde_json"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "1.0.26"
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"itoa 0.4.2 (registry+https://github.com/rust-lang/crates.io-index)",
"ryu 0.2.6 (registry+https://github.com/rust-lang/crates.io-index)",
"serde 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)",
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
]
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "serde_urlencoded"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.5.3"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"dtoa 0.4.3 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"itoa 0.4.2 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"serde 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)",
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"url 1.7.1 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
]
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
[[package]]
name = "sha1"
version = "0.6.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "siphasher"
version = "0.2.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
use local-encoding crate for stdout conversion
2016-09-21 22:57:28 +03:00
[[package]]
name = "skeptic"
version = "0.4.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"pulldown-cmark 0.0.3 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"tempdir 0.3.7 (registry+https://github.com/rust-lang/crates.io-index)",
use local-encoding crate for stdout conversion
2016-09-21 22:57:28 +03:00
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "slab"
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
version = "0.3.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
Update iovec to fix a soundness hole on Windows Also update a few other dependencies that transitively needed fixing
2017-10-06 02:40:25 +03:00
[[package]]
name = "slab"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.4.1"
Update iovec to fix a soundness hole on Windows Also update a few other dependencies that transitively needed fixing
2017-10-06 02:40:25 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
[[package]]
name = "smallvec"
version = "0.2.1"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
[[package]]
name = "smallvec"
version = "0.6.5"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"unreachable 1.0.0 (registry+https://github.com/rust-lang/crates.io-index)",
]
Update ring
2018-01-07 18:33:04 +03:00
[[package]]
name = "socket2"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.3.8"
Update ring
2018-01-07 18:33:04 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"cfg-if 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"redox_syscall 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
]
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
[[package]]
name = "stable_deref_trait"
version = "1.1.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
Always request color output from rustc. Fixes #99 This change makes sccache run rustc with `--color=always`, removing any other --color option from the compiler options so that it's not included in the cache key. A `color_mode` method is added to the `CompilerHasher` trait, and the value is sent back to the client in the `CompileFinished` method, so the client can determine whether specific --color options were passed without having to do its own commandline parsing. The client uses the new `strip-ansi-escapes` crate to remove escape codes from the compiler output in situations where color output is not desired: * When `--color=never` was passed on the compiler commandline. * When `--color=auto` is in effect (the default) but the output is not a terminal. The existing cargo tests were lightly modified to run compile once with `--color=never` and once with `--color=always` to validate that cache hits are not affected by color options.
2018-02-02 15:11:11 +03:00
[[package]]
name = "strip-ansi-escapes"
version = "0.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"vte 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)",
Always request color output from rustc. Fixes #99 This change makes sccache run rustc with `--color=always`, removing any other --color option from the compiler options so that it's not included in the cache key. A `color_mode` method is added to the `CompilerHasher` trait, and the value is sent back to the client in the `CompileFinished` method, so the client can determine whether specific --color options were passed without having to do its own commandline parsing. The client uses the new `strip-ansi-escapes` crate to remove escape codes from the compiler output in situations where color output is not desired: * When `--color=never` was passed on the compiler commandline. * When `--color=auto` is in effect (the default) but the output is not a terminal. The existing cargo tests were lightly modified to run compile once with `--color=never` and once with `--color=always` to validate that cache hits are not affected by color options.
2018-02-02 15:11:11 +03:00
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "strsim"
Silence some warnings
2018-07-12 13:46:33 +03:00
version = "0.7.0"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
[[package]]
name = "syn"
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
version = "0.11.11"
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"quote 0.3.15 (registry+https://github.com/rust-lang/crates.io-index)",
"synom 0.11.3 (registry+https://github.com/rust-lang/crates.io-index)",
"unicode-xid 0.0.4 (registry+https://github.com/rust-lang/crates.io-index)",
]
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
[[package]]
name = "syn"
version = "0.14.9"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"proc-macro2 0.4.15 (registry+https://github.com/rust-lang/crates.io-index)",
"quote 0.6.8 (registry+https://github.com/rust-lang/crates.io-index)",
"unicode-xid 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
]
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
[[package]]
name = "synom"
version = "0.11.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"unicode-xid 0.0.4 (registry+https://github.com/rust-lang/crates.io-index)",
]
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
[[package]]
name = "take"
version = "0.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
Bits and pieces for distributed Rust
2018-04-12 04:25:15 +03:00
[[package]]
name = "tar"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.4.16"
Bits and pieces for distributed Rust
2018-04-12 04:25:15 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"filetime 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)",
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"redox_syscall 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)",
"xattr 0.2.2 (registry+https://github.com/rust-lang/crates.io-index)",
Bits and pieces for distributed Rust
2018-04-12 04:25:15 +03:00
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "tempdir"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.3.7"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"rand 0.4.3 (registry+https://github.com/rust-lang/crates.io-index)",
"remove_dir_all 0.5.1 (registry+https://github.com/rust-lang/crates.io-index)",
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
]
Atomically create compiler outputs from cache entries. Fixes #122. I was seeing intermittent rustc panics when compiling with sccache. It turns out that rustc will wind up looking for rlibs in the output dir and sometimes it finds the ones that we're in the middle of writing out from cache and it panics trying to read the half-written file. This change makes us write the cache entry to a tempfile and atomically rename it to the final name.
2017-05-17 23:38:12 +03:00
[[package]]
name = "tempfile"
chore: Update tempfile to 3
2018-08-28 15:20:49 +03:00
version = "3.0.3"
Atomically create compiler outputs from cache entries. Fixes #122. I was seeing intermittent rustc panics when compiling with sccache. It turns out that rustc will wind up looking for rlibs in the output dir and sometimes it finds the ones that we're in the middle of writing out from cache and it panics trying to read the half-written file. This change makes us write the cache entry to a tempfile and atomically rename it to the final name.
2017-05-17 23:38:12 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update tempfile to 3
2018-08-28 15:20:49 +03:00
"rand 0.5.5 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"redox_syscall 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update tempfile to 3
2018-08-28 15:20:49 +03:00
"remove_dir_all 0.5.1 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Atomically create compiler outputs from cache entries. Fixes #122. I was seeing intermittent rustc panics when compiling with sccache. It turns out that rustc will wind up looking for rlibs in the output dir and sometimes it finds the ones that we're in the middle of writing out from cache and it panics trying to read the half-written file. This change makes us write the cache entry to a tempfile and atomically rename it to the final name.
2017-05-17 23:38:12 +03:00
]
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "term"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
version = "0.5.1"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"byteorder 1.2.6 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
]
chore: Update log to 0.4 and env_logger to 0.5
2018-08-28 14:41:11 +03:00
[[package]]
name = "termcolor"
version = "1.0.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"wincolor 1.0.1 (registry+https://github.com/rust-lang/crates.io-index)",
]
Update to a released rusoto, and 'cargo update' while we're at it
2016-07-15 18:06:16 +03:00
[[package]]
Update ring
2018-01-07 18:33:04 +03:00
name = "termion"
version = "1.5.1"
Update to a released rusoto, and 'cargo update' while we're at it
2016-07-15 18:06:16 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"redox_syscall 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"redox_termios 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
Update ring
2018-01-07 18:33:04 +03:00
name = "textwrap"
Silence some warnings
2018-07-12 13:46:33 +03:00
version = "0.10.0"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"unicode-width 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
]
[[package]]
name = "thread_local"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.3.6"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"lazy_static 1.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
]
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "threadpool"
version = "1.7.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"num_cpus 1.8.0 (registry+https://github.com/rust-lang/crates.io-index)",
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "time"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.40"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"redox_syscall 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
]
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "tiny_http"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
version = "0.6.0"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"ascii 0.8.7 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"chrono 0.4.6 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"chunked_transfer 0.3.1 (registry+https://github.com/rust-lang/crates.io-index)",
"encoding 0.2.33 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"url 1.7.1 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
]
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
[[package]]
name = "tokio"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.8"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
"mio 0.6.15 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"tokio-codec 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-current-thread 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"tokio-executor 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-fs 0.1.3 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"tokio-reactor 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"tokio-tcp 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-threadpool 0.1.6 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"tokio-timer 0.2.6 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"tokio-udp 0.1.2 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"tokio-uds 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
]
[[package]]
name = "tokio-codec"
version = "0.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"bytes 0.4.9 (registry+https://github.com/rust-lang/crates.io-index)",
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
]
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
[[package]]
name = "tokio-core"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
version = "0.1.17"
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"bytes 0.4.9 (registry+https://github.com/rust-lang/crates.io-index)",
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
cargo update
2018-02-01 18:29:23 +03:00
"iovec 0.1.2 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"mio 0.6.15 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"scoped-tls 0.1.2 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"tokio-executor 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"tokio-reactor 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-timer 0.2.6 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "tokio-current-thread"
version = "0.1.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-executor 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
Update to using the new tokio-io crate This is an abstraction of the Tokio stack now and doesn't have much impact on sccache itself but I figured it'd be good to update a few deps and pick up the recent version of things! Plus that and I'd like to start using the length_delimited module soon...
2017-03-09 21:00:18 +03:00
]
[[package]]
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
name = "tokio-executor"
Update ring
2018-01-07 18:33:04 +03:00
version = "0.1.4"
Update to using the new tokio-io crate This is an abstraction of the Tokio stack now and doesn't have much impact on sccache itself but I figured it'd be good to update a few deps and pick up the recent version of things! Plus that and I'd like to start using the length_delimited module soon...
2017-03-09 21:00:18 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "tokio-fs"
version = "0.1.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-threadpool 0.1.6 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "tokio-io"
version = "0.1.8"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"bytes 0.4.9 (registry+https://github.com/rust-lang/crates.io-index)",
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
]
Integrate process spawning with tokio-process This commit replaces all process spawning with the futures-powered versions in the `tokio-process` crate. Most functions were already ready to return futures, but a few minor updates were made to ensure that functions could return futures. Additionally, some `&CpuPool` arguments have shown up to allow executing work on a thread pool, such as filesystem operations. A number of compilers write data to tempdirs and such before running a compiler, and these are all executed on thread pools rather than the main thread. My main takeaway from this commit is that translating synchronous to asynchronous code isn't always easy. The "easy" version ends up being relatively wasteful in terms of clones for low-level performance, but probably shouldn't matter much in the context of spawning processes. Other than that though I found that there was a translation for all patterns found didn't actually hit any bugs (yet at least) from the translation.
2017-02-01 03:19:35 +03:00
[[package]]
name = "tokio-process"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.6"
Integrate process spawning with tokio-process This commit replaces all process spawning with the futures-powered versions in the `tokio-process` crate. Most functions were already ready to return futures, but a few minor updates were made to ensure that functions could return futures. Additionally, some `&CpuPool` arguments have shown up to allow executing work on a thread pool, such as filesystem operations. A number of compilers write data to tempdirs and such before running a compiler, and these are all executed on thread pools rather than the main thread. My main takeaway from this commit is that translating synchronous to asynchronous code isn't always easy. The "easy" version ends up being relatively wasteful in terms of clones for low-level performance, but probably shouldn't matter much in the context of spawning processes. Other than that though I found that there was a translation for all patterns found didn't actually hit any bugs (yet at least) from the translation.
2017-02-01 03:19:35 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"mio 0.6.15 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"mio-named-pipes 0.1.6 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"tokio-core 0.1.17 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"tokio-signal 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate process spawning with tokio-process This commit replaces all process spawning with the futures-powered versions in the `tokio-process` crate. Most functions were already ready to return futures, but a few minor updates were made to ensure that functions could return futures. Additionally, some `&CpuPool` arguments have shown up to allow executing work on a thread pool, such as filesystem operations. A number of compilers write data to tempdirs and such before running a compiler, and these are all executed on thread pools rather than the main thread. My main takeaway from this commit is that translating synchronous to asynchronous code isn't always easy. The "easy" version ends up being relatively wasteful in terms of clones for low-level performance, but probably shouldn't matter much in the context of spawning processes. Other than that though I found that there was a translation for all patterns found didn't actually hit any bugs (yet at least) from the translation.
2017-02-01 03:19:35 +03:00
]
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
[[package]]
name = "tokio-proto"
Update to using the new tokio-io crate This is an abstraction of the Tokio stack now and doesn't have much impact on sccache itself but I figured it'd be good to update a few deps and pick up the recent version of things! Plus that and I'd like to start using the length_delimited module soon...
2017-03-09 21:00:18 +03:00
version = "0.1.1"
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"log 0.3.9 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"net2 0.2.33 (registry+https://github.com/rust-lang/crates.io-index)",
"rand 0.3.22 (registry+https://github.com/rust-lang/crates.io-index)",
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
"slab 0.3.0 (registry+https://github.com/rust-lang/crates.io-index)",
"smallvec 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)",
"take 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"tokio-core 0.1.17 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
"tokio-service 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
]
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
[[package]]
name = "tokio-reactor"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.5"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"crossbeam-utils 0.5.0 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"lazy_static 1.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"mio 0.6.15 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"num_cpus 1.8.0 (registry+https://github.com/rust-lang/crates.io-index)",
"parking_lot 0.6.4 (registry+https://github.com/rust-lang/crates.io-index)",
"slab 0.4.1 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"tokio-executor 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
]
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
[[package]]
name = "tokio-serde"
version = "0.1.0"
Depend on tokio-serde-bincode from crates.io
2017-07-13 21:33:57 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"bytes 0.4.9 (registry+https://github.com/rust-lang/crates.io-index)",
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
]
[[package]]
name = "tokio-serde-bincode"
Depend on tokio-serde-bincode from crates.io
2017-07-13 21:33:57 +03:00
version = "0.1.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
dependencies = [
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
"bincode 0.8.0 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"bytes 0.4.9 (registry+https://github.com/rust-lang/crates.io-index)",
Depend on tokio-serde-bincode from crates.io
2017-07-13 21:33:57 +03:00
"derive-error 0.0.3 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"serde 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)",
Depend on tokio-serde-bincode from crates.io
2017-07-13 21:33:57 +03:00
"tokio-serde 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
]
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
[[package]]
name = "tokio-service"
version = "0.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
]
Integrate process spawning with tokio-process This commit replaces all process spawning with the futures-powered versions in the `tokio-process` crate. Most functions were already ready to return futures, but a few minor updates were made to ensure that functions could return futures. Additionally, some `&CpuPool` arguments have shown up to allow executing work on a thread pool, such as filesystem operations. A number of compilers write data to tempdirs and such before running a compiler, and these are all executed on thread pools rather than the main thread. My main takeaway from this commit is that translating synchronous to asynchronous code isn't always easy. The "easy" version ends up being relatively wasteful in terms of clones for low-level performance, but probably shouldn't matter much in the context of spawning processes. Other than that though I found that there was a translation for all patterns found didn't actually hit any bugs (yet at least) from the translation.
2017-02-01 03:19:35 +03:00
[[package]]
name = "tokio-signal"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.5"
Integrate process spawning with tokio-process This commit replaces all process spawning with the futures-powered versions in the `tokio-process` crate. Most functions were already ready to return futures, but a few minor updates were made to ensure that functions could return futures. Additionally, some `&CpuPool` arguments have shown up to allow executing work on a thread pool, such as filesystem operations. A number of compilers write data to tempdirs and such before running a compiler, and these are all executed on thread pools rather than the main thread. My main takeaway from this commit is that translating synchronous to asynchronous code isn't always easy. The "easy" version ends up being relatively wasteful in terms of clones for low-level performance, but probably shouldn't matter much in the context of spawning processes. Other than that though I found that there was a translation for all patterns found didn't actually hit any bugs (yet at least) from the translation.
2017-02-01 03:19:35 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"mio 0.6.15 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"mio-uds 0.6.6 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"tokio-core 0.1.17 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate process spawning with tokio-process This commit replaces all process spawning with the futures-powered versions in the `tokio-process` crate. Most functions were already ready to return futures, but a few minor updates were made to ensure that functions could return futures. Additionally, some `&CpuPool` arguments have shown up to allow executing work on a thread pool, such as filesystem operations. A number of compilers write data to tempdirs and such before running a compiler, and these are all executed on thread pools rather than the main thread. My main takeaway from this commit is that translating synchronous to asynchronous code isn't always easy. The "easy" version ends up being relatively wasteful in terms of clones for low-level performance, but probably shouldn't matter much in the context of spawning processes. Other than that though I found that there was a translation for all patterns found didn't actually hit any bugs (yet at least) from the translation.
2017-02-01 03:19:35 +03:00
]
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
[[package]]
name = "tokio-tcp"
version = "0.1.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"bytes 0.4.9 (registry+https://github.com/rust-lang/crates.io-index)",
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
"iovec 0.1.2 (registry+https://github.com/rust-lang/crates.io-index)",
"mio 0.6.15 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"tokio-reactor 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
]
[[package]]
name = "tokio-threadpool"
version = "0.1.6"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"crossbeam-deque 0.6.1 (registry+https://github.com/rust-lang/crates.io-index)",
"crossbeam-utils 0.5.0 (registry+https://github.com/rust-lang/crates.io-index)",
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"num_cpus 1.8.0 (registry+https://github.com/rust-lang/crates.io-index)",
"rand 0.5.5 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-executor 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "tokio-timer"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.2.6"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"crossbeam-utils 0.5.0 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"slab 0.4.1 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"tokio-executor 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
]
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
[[package]]
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
name = "tokio-tls"
Update ring
2018-01-07 18:33:04 +03:00
version = "0.1.4"
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
cargo update
2018-02-01 18:29:23 +03:00
"native-tls 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"tokio-core 0.1.17 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
]
[[package]]
name = "tokio-udp"
version = "0.1.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"bytes 0.4.9 (registry+https://github.com/rust-lang/crates.io-index)",
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"mio 0.6.15 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-codec 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"tokio-reactor 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
]
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
[[package]]
name = "tokio-uds"
version = "0.2.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"bytes 0.4.9 (registry+https://github.com/rust-lang/crates.io-index)",
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
"iovec 0.1.2 (registry+https://github.com/rust-lang/crates.io-index)",
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
"mio 0.6.15 (registry+https://github.com/rust-lang/crates.io-index)",
"mio-uds 0.6.6 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
"tokio-reactor 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
]
Allow configuration of caches with a config file
2018-06-04 20:28:39 +03:00
[[package]]
name = "toml"
version = "0.4.6"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"serde 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)",
Allow configuration of caches with a config file
2018-06-04 20:28:39 +03:00
]
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
[[package]]
name = "treeline"
version = "0.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
Feature flag toggle for distributed compilation, cleanups
2018-07-31 01:06:14 +03:00
[[package]]
name = "try-lock"
version = "0.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "twoway"
version = "0.1.8"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"memchr 2.0.2 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
]
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
[[package]]
name = "ucd-util"
version = "0.1.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "unicase"
version = "1.4.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"version_check 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
]
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
[[package]]
name = "unicase"
Update ring
2018-01-07 18:33:04 +03:00
version = "2.1.0"
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"version_check 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)",
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
]
[[package]]
name = "unicode-bidi"
Update ring
2018-01-07 18:33:04 +03:00
version = "0.3.4"
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"matches 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
Implement S3Cache Unlike sccache1, you need to specify both bucket and region, like: SCCACHE_BUCKET=sccache SCCACHE_REGION=us-east-1 Pretty limited testing, no automated tests currently.
2016-06-03 22:09:38 +03:00
]
[[package]]
name = "unicode-normalization"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.7"
Update clap
2017-04-05 17:42:06 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "unicode-width"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.5"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
[[package]]
name = "unicode-xid"
version = "0.0.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
[[package]]
name = "unicode-xid"
version = "0.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
[[package]]
name = "unix_socket"
version = "0.5.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"cfg-if 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
]
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
[[package]]
name = "unreachable"
Update ring
2018-01-07 18:33:04 +03:00
version = "1.0.0"
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"void 1.0.2 (registry+https://github.com/rust-lang/crates.io-index)",
]
Switch from SHA-1 to SHA-512 Local benchmarking showed that the implementation of SHA-512 in the *ring* crate is 3x faster than the implementation of SHA-1 in the `sha1` crate. I've also noticed that 80%+ of sccache's runtime on a fully cached build is spent hashing. With this change I noticed a decrease from 108s to 92s when building a fully cached LLVM from the network. Not a huge win but if the network were faster could perhaps add up! Closes #108
2017-04-21 07:09:15 +03:00
[[package]]
name = "untrusted"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
version = "0.6.2"
Switch from SHA-1 to SHA-512 Local benchmarking showed that the implementation of SHA-512 in the *ring* crate is 3x faster than the implementation of SHA-1 in the `sha1` crate. I've also noticed that 80%+ of sccache's runtime on a fully cached build is spent hashing. With this change I noticed a decrease from 108s to 92s when building a fully cached LLVM from the network. Not a huge win but if the network were faster could perhaps add up! Closes #108
2017-04-21 07:09:15 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
[[package]]
name = "url"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
version = "1.7.1"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"idna 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
"matches 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
"percent-encoding 1.0.1 (registry+https://github.com/rust-lang/crates.io-index)",
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "utf8-ranges"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "1.0.1"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Always request color output from rustc. Fixes #99 This change makes sccache run rustc with `--color=always`, removing any other --color option from the compiler options so that it's not included in the cache key. A `color_mode` method is added to the `CompilerHasher` trait, and the value is sent back to the client in the `CompileFinished` method, so the client can determine whether specific --color options were passed without having to do its own commandline parsing. The client uses the new `strip-ansi-escapes` crate to remove escape codes from the compiler output in situations where color output is not desired: * When `--color=never` was passed on the compiler commandline. * When `--color=auto` is in effect (the default) but the output is not a terminal. The existing cargo tests were lightly modified to run compile once with `--color=never` and once with `--color=always` to validate that cache hits are not affected by color options.
2018-02-02 15:11:11 +03:00
[[package]]
name = "utf8parse"
version = "0.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
Use a named unix socket or named pipe to let the background server notify the client that it started successfully
2017-01-27 22:39:47 +03:00
[[package]]
name = "uuid"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.6.5"
Use a named unix socket or named pipe to let the background server notify the client that it started successfully
2017-01-27 22:39:47 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"cfg-if 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)",
"rand 0.4.3 (registry+https://github.com/rust-lang/crates.io-index)",
Use a named unix socket or named pipe to let the background server notify the client that it started successfully
2017-01-27 22:39:47 +03:00
]
Update ring
2018-01-07 18:33:04 +03:00
[[package]]
name = "vcpkg"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.2.6"
Update ring
2018-01-07 18:33:04 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "vec_map"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.8.1"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update ring
2018-01-07 18:33:04 +03:00
[[package]]
name = "version_check"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.1.4"
Update ring
2018-01-07 18:33:04 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Make DiskCache limit the size of the on-disk cache by using LruDiskCache. Fixes #29
2016-11-29 03:59:42 +03:00
[[package]]
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
name = "void"
Make DiskCache limit the size of the on-disk cache by using LruDiskCache. Fixes #29
2016-11-29 03:59:42 +03:00
version = "1.0.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
Always request color output from rustc. Fixes #99 This change makes sccache run rustc with `--color=always`, removing any other --color option from the compiler options so that it's not included in the cache key. A `color_mode` method is added to the `CompilerHasher` trait, and the value is sent back to the client in the `CompileFinished` method, so the client can determine whether specific --color options were passed without having to do its own commandline parsing. The client uses the new `strip-ansi-escapes` crate to remove escape codes from the compiler output in situations where color output is not desired: * When `--color=never` was passed on the compiler commandline. * When `--color=auto` is in effect (the default) but the output is not a terminal. The existing cargo tests were lightly modified to run compile once with `--color=never` and once with `--color=always` to validate that cache hits are not affected by color options.
2018-02-02 15:11:11 +03:00
[[package]]
name = "vte"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.3.3"
Always request color output from rustc. Fixes #99 This change makes sccache run rustc with `--color=always`, removing any other --color option from the compiler options so that it's not included in the cache key. A `color_mode` method is added to the `CompilerHasher` trait, and the value is sent back to the client in the `CompileFinished` method, so the client can determine whether specific --color options were passed without having to do its own commandline parsing. The client uses the new `strip-ansi-escapes` crate to remove escape codes from the compiler output in situations where color output is not desired: * When `--color=never` was passed on the compiler commandline. * When `--color=auto` is in effect (the default) but the output is not a terminal. The existing cargo tests were lightly modified to run compile once with `--color=never` and once with `--color=always` to validate that cache hits are not affected by color options.
2018-02-02 15:11:11 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"utf8parse 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
]
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
[[package]]
name = "walkdir"
version = "1.0.7"
source = "registry+https://github.com/rust-lang/crates.io-index"
Make DiskCache limit the size of the on-disk cache by using LruDiskCache. Fixes #29
2016-11-29 03:59:42 +03:00
dependencies = [
"kernel32-sys 0.2.2 (registry+https://github.com/rust-lang/crates.io-index)",
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
"same-file 0.1.3 (registry+https://github.com/rust-lang/crates.io-index)",
Make DiskCache limit the size of the on-disk cache by using LruDiskCache. Fixes #29
2016-11-29 03:59:42 +03:00
"winapi 0.2.8 (registry+https://github.com/rust-lang/crates.io-index)",
]
Feature flag toggle for distributed compilation, cleanups
2018-07-31 01:06:14 +03:00
[[package]]
name = "want"
version = "0.0.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)",
Feature flag toggle for distributed compilation, cleanups
2018-07-31 01:06:14 +03:00
"try-lock 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)",
]
Started using which crate (#14)
2016-07-14 13:38:26 +03:00
[[package]]
name = "which"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "1.0.5"
switch back to released version of which, switch to a rusoto branch with a bug fix
2016-08-08 22:06:06 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Started using which crate (#14)
2016-07-14 13:38:26 +03:00
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Started using which crate (#14)
2016-07-14 13:38:26 +03:00
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "winapi"
Update to a released rusoto, and 'cargo update' while we're at it
2016-07-15 18:06:16 +03:00
version = "0.2.8"
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update ring
2018-01-07 18:33:04 +03:00
[[package]]
name = "winapi"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.3.5"
Update ring
2018-01-07 18:33:04 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
cargo update
2018-02-01 18:29:23 +03:00
"winapi-i686-pc-windows-gnu 0.4.0 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi-x86_64-pc-windows-gnu 0.4.0 (registry+https://github.com/rust-lang/crates.io-index)",
Update ring
2018-01-07 18:33:04 +03:00
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "winapi-build"
version = "0.1.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
Update ring
2018-01-07 18:33:04 +03:00
[[package]]
name = "winapi-i686-pc-windows-gnu"
cargo update
2018-02-01 18:29:23 +03:00
version = "0.4.0"
Update ring
2018-01-07 18:33:04 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
chore: Update log to 0.4 and env_logger to 0.5
2018-08-28 14:41:11 +03:00
[[package]]
name = "winapi-util"
version = "0.1.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
]
Update ring
2018-01-07 18:33:04 +03:00
[[package]]
name = "winapi-x86_64-pc-windows-gnu"
cargo update
2018-02-01 18:29:23 +03:00
version = "0.4.0"
Update ring
2018-01-07 18:33:04 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
chore: Update log to 0.4 and env_logger to 0.5
2018-08-28 14:41:11 +03:00
[[package]]
name = "wincolor"
version = "1.0.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
"winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)",
"winapi-util 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
]
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
[[package]]
name = "ws2_32-sys"
version = "0.2.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
Update to a released rusoto, and 'cargo update' while we're at it
2016-07-15 18:06:16 +03:00
"winapi 0.2.8 (registry+https://github.com/rust-lang/crates.io-index)",
Commit Cargo.lock
2016-05-12 22:03:37 +03:00
"winapi-build 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)",
]
Bits and pieces for distributed Rust
2018-04-12 04:25:15 +03:00
[[package]]
name = "xattr"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
version = "0.2.2"
Bits and pieces for distributed Rust
2018-04-12 04:25:15 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)",
Bits and pieces for distributed Rust
2018-04-12 04:25:15 +03:00
]
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
[[package]]
name = "zip"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
version = "0.4.2"
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
source = "registry+https://github.com/rust-lang/crates.io-index"
dependencies = [
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"flate2 1.0.2 (registry+https://github.com/rust-lang/crates.io-index)",
"msdos_time 0.1.6 (registry+https://github.com/rust-lang/crates.io-index)",
cargo update
2018-02-01 18:29:23 +03:00
"podio 0.1.6 (registry+https://github.com/rust-lang/crates.io-index)",
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"time 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)",
Implement fetching/storing to cache, interfaces for doing so, implement a disk cache
2016-05-21 21:14:26 +03:00
]
make connecting to server a little more lenient when starting the server
2016-10-26 01:14:21 +03:00
[metadata]
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum adler32 1.0.3 (registry+https://github.com/rust-lang/crates.io-index)" = "7e522997b529f05601e05166c07ed17789691f562762c7f3b987263d2dedee5c"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum aho-corasick 0.6.8 (registry+https://github.com/rust-lang/crates.io-index)" = "68f56c7353e5a9547cbd76ed90f7bb5ffc3ba09d4ea9bd1d8c06c8b1142eeb5a"
Silence some warnings
2018-07-12 13:46:33 +03:00
"checksum ansi_term 0.11.0 (registry+https://github.com/rust-lang/crates.io-index)" = "ee49baf6cb617b853aa8d93bf420db2383fab46d314482ca2803b40d5fde979b"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum arraydeque 0.4.3 (registry+https://github.com/rust-lang/crates.io-index)" = "e300327073b806ffc81fccb228b2d4131ac7ef1b1a015f7b0c399c7f886cacc6"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum arrayvec 0.4.7 (registry+https://github.com/rust-lang/crates.io-index)" = "a1e964f9e24d588183fcb43503abda40d288c8657dfc27311516ce2f05675aef"
"checksum ascii 0.7.1 (registry+https://github.com/rust-lang/crates.io-index)" = "3ae7d751998c189c1d4468cf0a39bb2eae052a9c58d50ebb3b9591ee3813ad50"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"checksum ascii 0.8.7 (registry+https://github.com/rust-lang/crates.io-index)" = "97be891acc47ca214468e09425d02cef3af2c94d0d82081cd02061f996802f14"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum assert_cmd 0.9.1 (registry+https://github.com/rust-lang/crates.io-index)" = "c5b60c276f334145cf2cec09c5bb6f63523f078c0c850909f66bca8f933cf809"
"checksum atty 0.2.11 (registry+https://github.com/rust-lang/crates.io-index)" = "9a7d5b8723950951411ee34d271d99dddcc2035a16ab25310ea2c8cfd4369652"
"checksum base64 0.9.2 (registry+https://github.com/rust-lang/crates.io-index)" = "85415d2594767338a74a30c1d370b2f3262ec1b4ed2d7bba5b3faf4de40467d9"
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
"checksum bincode 0.8.0 (registry+https://github.com/rust-lang/crates.io-index)" = "e103c8b299b28a9c6990458b7013dc4a8356a9b854c51b9883241f5866fac36e"
Update other deps
2018-01-07 18:58:55 +03:00
"checksum bincode 0.9.2 (registry+https://github.com/rust-lang/crates.io-index)" = "9a6301db0b49fb63551bc15b5ae348147101cdf323242b93ec7546d5002ff1af"
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
"checksum bitflags 0.9.1 (registry+https://github.com/rust-lang/crates.io-index)" = "4efd02e230a02e18f92fc2735f44597385ed02ad8f831e7c1c1156ee5e1ab3a5"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum bitflags 1.0.4 (registry+https://github.com/rust-lang/crates.io-index)" = "228047a76f468627ca71776ecdebd732a3423081fcf5125585bcd7c49886ce12"
Use a trait to represent compiler packagers
2018-07-18 23:21:06 +03:00
"checksum boxfnonce 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)" = "cbec60c560f322d8e3cd403f91d8908cfd965fff53ba97154bd1b9d90149d98e"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"checksum brotli-sys 0.3.2 (registry+https://github.com/rust-lang/crates.io-index)" = "4445dea95f4c2b41cde57cc9fee236ae4dbae88d8fcbdb4750fc1bb5d86aaecd"
"checksum brotli2 0.3.2 (registry+https://github.com/rust-lang/crates.io-index)" = "0cb036c3eade309815c15ddbacec5b22c4d1f3983a774ab2eac2e3e9ea85568e"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum buf_redux 0.6.3 (registry+https://github.com/rust-lang/crates.io-index)" = "b9279646319ff816b05fb5897883ece50d7d854d12b59992683d4f8a71b0f949"
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
"checksum bufstream 0.1.3 (registry+https://github.com/rust-lang/crates.io-index)" = "f2f382711e76b9de6c744cc00d0497baba02fb00a787f088c879f01d09468e32"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum build_const 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)" = "39092a32794787acd8525ee150305ff051b0aa6cc2abaf193924f5ab05425f39"
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
"checksum byteorder 0.4.2 (registry+https://github.com/rust-lang/crates.io-index)" = "96c8b41881888cc08af32d47ac4edd52bc7fa27fef774be47a92443756451304"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum byteorder 1.2.6 (registry+https://github.com/rust-lang/crates.io-index)" = "90492c5858dd7d2e78691cfb89f90d273a2800fc11d98f60786e5d87e2f83781"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum bytes 0.4.9 (registry+https://github.com/rust-lang/crates.io-index)" = "e178b8e0e239e844b083d5a0d4a156b2654e67f9f80144d48398fcd736a24fb8"
Depend on tokio-serde-bincode from crates.io
2017-07-13 21:33:57 +03:00
"checksum case 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)" = "e88b166b48e29667f5443df64df3c61dc07dc2b1a0b0d231800e07f09a33ecc1"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum cc 1.0.23 (registry+https://github.com/rust-lang/crates.io-index)" = "c37f0efaa4b9b001fa6f02d4b644dee4af97d3414df07c51e3e4f015f3a3e131"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum cfg-if 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)" = "0c4e7bb64a8ebb0d856483e1e682ea3422f883c5f5615a90d51a2c82fe87fdd3"
"checksum chrono 0.4.6 (registry+https://github.com/rust-lang/crates.io-index)" = "45912881121cb26fad7c38c17ba7daa18764771836b34fab7d3fbd93ed633878"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum chunked_transfer 0.3.1 (registry+https://github.com/rust-lang/crates.io-index)" = "498d20a7aaf62625b9bf26e637cf7736417cde1d0c99f1d04d1170229a85cf87"
Silence some warnings
2018-07-12 13:46:33 +03:00
"checksum clap 2.32.0 (registry+https://github.com/rust-lang/crates.io-index)" = "b957d88f4b6a63b9d70d5f454ac8011819c6efa7727858f458ab71c756ce2d3e"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum cloudabi 0.0.3 (registry+https://github.com/rust-lang/crates.io-index)" = "ddfc5b9aa5d4507acaf872de71051dfd0e309860e88966e1051e462a077aac4f"
"checksum combine 3.5.1 (registry+https://github.com/rust-lang/crates.io-index)" = "7e67be864b6450c26fdb9242dee53a46fb9648d0b1a65521a6a1947b54fa011e"
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
"checksum conhash 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)" = "f45d5b02557fc2358078db5b1e1c7d801145bcd08428403121d4f108342ec5fe"
Integrate the Tokio branch of Hyper This commit pulls in Hyper from its master branch which contains the asynchronous/Tokio integration. All instances of HTTP, namely when interacting with S3, are now all powered by async Hyper and work with futures rather than synchronous requests on thread pools.
2017-02-02 03:30:26 +03:00
"checksum core-foundation 0.2.3 (registry+https://github.com/rust-lang/crates.io-index)" = "25bfd746d203017f7d5cbd31ee5d8e17f94b6521c7af77ece6c9e4b2d4b16c67"
"checksum core-foundation-sys 0.2.3 (registry+https://github.com/rust-lang/crates.io-index)" = "065a5d7ffdcbc8fa145d6f0746f3555025b9097a9e9cda59f7467abae670c78d"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum crc 1.8.1 (registry+https://github.com/rust-lang/crates.io-index)" = "d663548de7f5cca343f1e0a48d14dcfb0e9eb4e079ec58883b7251539fa10aeb"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum crossbeam-deque 0.6.1 (registry+https://github.com/rust-lang/crates.io-index)" = "3486aefc4c0487b9cb52372c97df0a48b8c249514af1ee99703bf70d2f2ceda1"
"checksum crossbeam-epoch 0.5.2 (registry+https://github.com/rust-lang/crates.io-index)" = "30fecfcac6abfef8771151f8be4abc9e4edc112c2bcb233314cafde2680536e9"
"checksum crossbeam-utils 0.5.0 (registry+https://github.com/rust-lang/crates.io-index)" = "677d453a17e8bd2b913fa38e8b9cf04bcdbb5be790aa294f2389661d72036015"
daemonize the server process on unix
2016-10-26 23:22:52 +03:00
"checksum daemonize 0.2.3 (registry+https://github.com/rust-lang/crates.io-index)" = "0239832c1b4ca406d5ec73728cf4c7336d25cf85dd32db9e047e9e706ee0e935"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum deflate 0.7.18 (registry+https://github.com/rust-lang/crates.io-index)" = "32c8120d981901a9970a3a1c97cf8b630e0fa8c3ca31e75b6fd6fd5f9f427b31"
Depend on tokio-serde-bincode from crates.io
2017-07-13 21:33:57 +03:00
"checksum derive-error 0.0.3 (registry+https://github.com/rust-lang/crates.io-index)" = "629f1bb3abce791912ca85a24676fff54464f7deb122906adabc90fb96e876d3"
Update assert_cli and tweak some of the tests using it. Also silence a lint warning from error-chain.
2018-07-26 17:16:55 +03:00
"checksum difference 2.0.0 (registry+https://github.com/rust-lang/crates.io-index)" = "524cbf6897b527295dff137cec09ecf3a05f4fddffd7dfcd1585403449e74198"
chore: Update directories to 1.0
2018-08-28 14:47:30 +03:00
"checksum directories 1.0.1 (registry+https://github.com/rust-lang/crates.io-index)" = "b106a38a9bf6c763c6c2e2c3332ab7635da453a68a6babca776386b3b287d338"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum dtoa 0.4.3 (registry+https://github.com/rust-lang/crates.io-index)" = "6d301140eb411af13d3115f9a562c85cc6b541ade9dfa314132244aaee7489dd"
"checksum either 1.5.0 (registry+https://github.com/rust-lang/crates.io-index)" = "3be565ca5c557d7f59e7cfcf1844f9e3033650c929c6566f511e8005f205c1d0"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum encoding 0.2.33 (registry+https://github.com/rust-lang/crates.io-index)" = "6b0d943856b990d12d3b55b359144ff341533e516d94098b1d3fc1ac666d36ec"
"checksum encoding-index-japanese 1.20141219.5 (registry+https://github.com/rust-lang/crates.io-index)" = "04e8b2ff42e9a05335dbf8b5c6f7567e5591d0d916ccef4e0b1710d32a0d0c91"
"checksum encoding-index-korean 1.20141219.5 (registry+https://github.com/rust-lang/crates.io-index)" = "4dc33fb8e6bcba213fe2f14275f0963fd16f0a02c878e3095ecfdf5bee529d81"
"checksum encoding-index-simpchinese 1.20141219.5 (registry+https://github.com/rust-lang/crates.io-index)" = "d87a7194909b9118fc707194baa434a4e3b0fb6a5a757c73c3adb07aa25031f7"
"checksum encoding-index-singlebyte 1.20141219.5 (registry+https://github.com/rust-lang/crates.io-index)" = "3351d5acffb224af9ca265f435b859c7c01537c0849754d3db3fdf2bfe2ae84a"
"checksum encoding-index-tradchinese 1.20141219.5 (registry+https://github.com/rust-lang/crates.io-index)" = "fd0e20d5688ce3cab59eb3ef3a2083a5c77bf496cb798dc6fcdb75f323890c18"
"checksum encoding_index_tests 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)" = "a246d82be1c9d791c5dfde9a2bd045fc3cbba3fa2b11ad558f27d01712f00569"
"checksum encoding_rs 0.7.2 (registry+https://github.com/rust-lang/crates.io-index)" = "98fd0f24d1fb71a4a6b9330c8ca04cbd4e7cc5d846b54ca74ff376bc7c9f798d"
"checksum enum_primitive 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)" = "be4551092f4d519593039259a9ed8daedf0da12e5109c5280338073eaeb81180"
chore: Update log to 0.4 and env_logger to 0.5
2018-08-28 14:41:11 +03:00
"checksum env_logger 0.5.13 (registry+https://github.com/rust-lang/crates.io-index)" = "15b0a4d2e39f8420210be8b27eeda28029729e2fd4291019455016c348240c38"
Ignore CARGO_MAKEFLAGS when calculating Rust hash keys. Fixes #193 Since cargo gained jobserver support it now passes a CARGO_MAKEFLAGS environment variable which is different for every build (it contains file descriptor numbers or semaphore values). sccache uses all environment variables starting with `CARGO_` as inputs to the hash key for Rust compilation so this broke things. I think it was mostly only a problem on Windows, where the values were semaphores. On POSIX platforms the values are file descriptors, which are probably likely to be the same between runs of cargo. This change also adds a test for compiling a simple Rust crate with cargo and verifying that we get a cache hit. I pulled in the `assert_cli` crate to write that test, which worked nicely.
2017-10-25 21:09:27 +03:00
"checksum error-chain 0.11.0 (registry+https://github.com/rust-lang/crates.io-index)" = "ff511d5dc435d703f4971bc399647c9bc38e20cb41452e3b9feb4765419ed3f3"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum escargot 0.3.1 (registry+https://github.com/rust-lang/crates.io-index)" = "19db1f7e74438642a5018cdf263bb1325b2e792f02dd0a3ca6d6c0f0d7b1d5a5"
cargo update
2018-02-01 18:29:23 +03:00
"checksum filetime 0.1.15 (registry+https://github.com/rust-lang/crates.io-index)" = "714653f3e34871534de23771ac7b26e999651a0a228f47beb324dfdf1dd4b10f"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum filetime 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)" = "da4b9849e77b13195302c174324b5ba73eec9b236b24c221a61000daefb95c5f"
"checksum flate2 1.0.2 (registry+https://github.com/rust-lang/crates.io-index)" = "37847f133aae7acf82bb9577ccd8bda241df836787642654286e79679826a54b"
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
"checksum float-cmp 0.4.0 (registry+https://github.com/rust-lang/crates.io-index)" = "134a8fa843d80a51a5b77d36d42bc2def9edcb0262c914861d08129fd1926600"
Update ring
2018-01-07 18:33:04 +03:00
"checksum foreign-types 0.3.2 (registry+https://github.com/rust-lang/crates.io-index)" = "f6f339eb8adc052cd2ca78910fda869aefa38d22d5cb648e6485e4d3fc06f3b1"
"checksum foreign-types-shared 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)" = "00b0228411908ca8685dba7fc2cdd70ec9990a6e753e89b6ac91a84c40fbaf4b"
"checksum fuchsia-zircon 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)" = "2e9763c69ebaae630ba35f74888db465e49e259ba1bc0eda7d06f4a067615d82"
"checksum fuchsia-zircon-sys 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)" = "3dcaa9ae7725d12cdb85b3ad99a434db70b468c09ded17e012d86b5c1010f7a7"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum futures 0.1.23 (registry+https://github.com/rust-lang/crates.io-index)" = "884dbe32a6ae4cd7da5c6db9b78114449df9953b8d490c9d7e1b51720b922c62"
Update ring
2018-01-07 18:33:04 +03:00
"checksum futures-cpupool 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)" = "ab90cde24b3319636588d0c35fe03b1333857621051837ed769faefb4c2162e4"
"checksum gcc 0.3.54 (registry+https://github.com/rust-lang/crates.io-index)" = "5e33ec290da0d127825013597dbdfc28bee4964690c7ce1166cbc2a7bd08b1bb"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum getopts 0.2.18 (registry+https://github.com/rust-lang/crates.io-index)" = "0a7292d30132fb5424b354f5dc02512a86e4c516fe544bb7a25e7f266951b797"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum gzip-header 0.1.2 (registry+https://github.com/rust-lang/crates.io-index)" = "0a9fcfe1c9ee125342355b2467bc29b9dfcb2124fcae27edb9cee6f4cc5ecd40"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum httparse 1.3.2 (registry+https://github.com/rust-lang/crates.io-index)" = "7b6288d7db100340ca12873fd4d08ad1b8f206a9457798dfb17c018a33fee540"
chore: Update log to 0.4 and env_logger to 0.5
2018-08-28 14:41:11 +03:00
"checksum humantime 1.1.1 (registry+https://github.com/rust-lang/crates.io-index)" = "0484fda3e7007f2a4a0d9c3a703ca38c71c54c55602ce4660c419fd32e188c9e"
Feature flag toggle for distributed compilation, cleanups
2018-07-31 01:06:14 +03:00
"checksum hyper 0.11.27 (registry+https://github.com/rust-lang/crates.io-index)" = "34a590ca09d341e94cddf8e5af0bbccde205d5fbc2fa3c09dd67c7f85cea59d7"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum hyper-tls 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)" = "ffb1bd5e518d3065840ab315dbbf44e4420e5f7d80e2cb93fa6ffffc50522378"
"checksum idna 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)" = "38f09e0f0b1fb55fdee1f17470ad800da77af5186a1a76c026b679358b7e844e"
cargo update
2018-02-01 18:29:23 +03:00
"checksum iovec 0.1.2 (registry+https://github.com/rust-lang/crates.io-index)" = "dbe6e417e7d0975db6512b90796e8ce223145ac4e33c377e4a42882a0e88bb08"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum itertools 0.7.8 (registry+https://github.com/rust-lang/crates.io-index)" = "f58856976b776fedd95533137617a02fb25719f40e7d9b01c7043cd65474f450"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum itoa 0.4.2 (registry+https://github.com/rust-lang/crates.io-index)" = "5adb58558dcd1d786b5f0bd15f3226ee23486e24b7b58304b60f64dc68e62606"
update jobserver to 0.1.11 to pick up a fix for shutting down the worker thread
2018-03-16 20:39:18 +03:00
"checksum jobserver 0.1.11 (registry+https://github.com/rust-lang/crates.io-index)" = "60af5f849e1981434e4a31d3d782c4774ae9b434ce55b101a96ecfd09147e8be"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum jsonwebtoken 5.0.0 (registry+https://github.com/rust-lang/crates.io-index)" = "3970fe7ab3ca69c22824dc98c3180f5a29fe74e627b7c74a60d6ae946e90f591"
make connecting to server a little more lenient when starting the server
2016-10-26 01:14:21 +03:00
"checksum kernel32-sys 0.2.2 (registry+https://github.com/rust-lang/crates.io-index)" = "7507624b29483431c0ba2d82aece8ca6cdba9382bff4ddd0f7490560c056098d"
"checksum language-tags 0.2.2 (registry+https://github.com/rust-lang/crates.io-index)" = "a91d884b6667cd606bb5a69aa0c99ba811a115fc68915e7056ec08a46e93199a"
Update ring
2018-01-07 18:33:04 +03:00
"checksum lazy_static 0.2.11 (registry+https://github.com/rust-lang/crates.io-index)" = "76f033c7ad61445c5b347c7382dd1237847eb1bce590fe50365dcb33d546be73"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum lazy_static 1.1.0 (registry+https://github.com/rust-lang/crates.io-index)" = "ca488b89a5657b0a2ecd45b95609b3e848cf1755da332a0da46e2b2b1cb371a7"
Update ring
2018-01-07 18:33:04 +03:00
"checksum lazycell 0.6.0 (registry+https://github.com/rust-lang/crates.io-index)" = "a6f08839bc70ef4a3fe1d566d5350f519c5912ea86be0df1740a7d247c7fc0ef"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum libc 0.2.43 (registry+https://github.com/rust-lang/crates.io-index)" = "76e3a3ef172f1a0b9a9ff0dd1491ae5e6c948b94479a3021819ba7d860c8645d"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum libflate 0.1.16 (registry+https://github.com/rust-lang/crates.io-index)" = "7d4b4c7aff5bac19b956f693d0ea0eade8066deb092186ae954fa6ba14daab98"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"checksum libmount 0.1.11 (registry+https://github.com/rust-lang/crates.io-index)" = "d9d45f88f32c57ebf3688ada41414dc700aab97ad58e26cbcda6af50da53559a"
Make DiskCache limit the size of the on-disk cache by using LruDiskCache. Fixes #29
2016-11-29 03:59:42 +03:00
"checksum linked-hash-map 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)" = "bda158e0dabeb97ee8a401f4d17e479d6b891a14de0bba79d5cc2d4d325b5e48"
make connecting to server a little more lenient when starting the server
2016-10-26 01:14:21 +03:00
"checksum local-encoding 0.2.0 (registry+https://github.com/rust-lang/crates.io-index)" = "e1ceb20f39ff7ae42f3ff9795f3986b1daad821caaa1e1732a0944103a5a1a66"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum lock_api 0.1.3 (registry+https://github.com/rust-lang/crates.io-index)" = "949826a5ccf18c1b3a7c3d57692778d21768b79e46eb9dd07bfc4c2160036c54"
Update ring
2018-01-07 18:33:04 +03:00
"checksum log 0.3.9 (registry+https://github.com/rust-lang/crates.io-index)" = "e19e8d5c34a3e0e2223db8e060f9e8264aeeb5c5fc64a4ee9965c062211c024b"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum log 0.4.4 (registry+https://github.com/rust-lang/crates.io-index)" = "cba860f648db8e6f269df990180c2217f333472b4a6e901e97446858487971e2"
"checksum matches 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)" = "7ffc5c5338469d4d3ea17d269fa8ea3512ad247247c30bd2df69e68309ed0a08"
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
"checksum memcached-rs 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)" = "92bb8680fa02c632e8fdf462f1fa6a244aef0af380877dd150c56d117d748671"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum memchr 1.0.2 (registry+https://github.com/rust-lang/crates.io-index)" = "148fab2e51b4f1cfc66da2a7c32981d1d3c083a803978268bb11fe4b86925e7a"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum memchr 2.0.2 (registry+https://github.com/rust-lang/crates.io-index)" = "a3b4142ab8738a78c51896f704f83c11df047ff1bda9a92a661aa6361552d93d"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum memoffset 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)" = "0f9dc261e2b62d7a622bf416ea3c5245cdd5d9a7fcc428c0d06804dfce1775b3"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum mime 0.2.6 (registry+https://github.com/rust-lang/crates.io-index)" = "ba626b8a6de5da682e1caa06bdb42a335aee5a84db8e5046a3e8ab17ba0a3ae0"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum mime 0.3.9 (registry+https://github.com/rust-lang/crates.io-index)" = "4b082692d3f6cf41b453af73839ce3dfc212c4411cbb2441dff80a716e38bd79"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum mime_guess 1.8.6 (registry+https://github.com/rust-lang/crates.io-index)" = "2d4c0961143b8efdcfa29c3ae63281601b446a4a668165454b6c90f8024954c5"
"checksum mime_guess 2.0.0-alpha.6 (registry+https://github.com/rust-lang/crates.io-index)" = "30de2e4613efcba1ec63d8133f344076952090c122992a903359be5a4f99c3ed"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"checksum miniz_oxide 0.1.3 (registry+https://github.com/rust-lang/crates.io-index)" = "9ba430291c9d6cedae28bcd2d49d1c32fc57d60cd49086646c5dd5673a870eb5"
"checksum miniz_oxide_c_api 0.1.3 (registry+https://github.com/rust-lang/crates.io-index)" = "5a5b8234d6103ebfba71e29786da4608540f862de5ce980a1c94f86a40ca0d51"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum mio 0.6.15 (registry+https://github.com/rust-lang/crates.io-index)" = "4fcfcb32d63961fb6f367bfd5d21e4600b92cd310f71f9dca25acae196eb1560"
Update ring
2018-01-07 18:33:04 +03:00
"checksum mio-named-pipes 0.1.6 (registry+https://github.com/rust-lang/crates.io-index)" = "f5e374eff525ce1c5b7687c4cef63943e7686524a387933ad27ca7ec43779cb3"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum mio-uds 0.6.6 (registry+https://github.com/rust-lang/crates.io-index)" = "84c7b5caa3a118a6e34dbac36504503b1e8dc5835e833306b9d6af0e05929f79"
Update to using the new tokio-io crate This is an abstraction of the Tokio stack now and doesn't have much impact on sccache itself but I figured it'd be good to update a few deps and pick up the recent version of things! Plus that and I'd like to start using the length_delimited module soon...
2017-03-09 21:00:18 +03:00
"checksum miow 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)" = "8c1f2f3b1cf331de6896aabf6e9d55dca90356cc9960cca7eaaf408a355ae919"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum miow 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)" = "396aa0f2003d7df8395cb93e09871561ccc3e785f0acb369170e8cc74ddf9226"
"checksum msdos_time 0.1.6 (registry+https://github.com/rust-lang/crates.io-index)" = "aad9dfe950c057b1bfe9c1f2aa51583a8468ef2a5baba2ebbe06d775efeb7729"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum multipart 0.13.6 (registry+https://github.com/rust-lang/crates.io-index)" = "92f54eb45230c3aa20864ccf0c277eeaeadcf5e437e91731db498dbf7fbe0ec6"
cargo update
2018-02-01 18:29:23 +03:00
"checksum native-tls 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)" = "f74dbadc8b43df7864539cedb7bc91345e532fdd913cfdc23ad94f4d2d40fbc0"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum net2 0.2.33 (registry+https://github.com/rust-lang/crates.io-index)" = "42550d9fb7b6684a6d404d9fa7250c2eb2646df731d1c06afc06dcee9e1bcf88"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"checksum nix 0.11.0 (registry+https://github.com/rust-lang/crates.io-index)" = "d37e713a259ff641624b6cb20e3b12b2952313ba36b6823c0f16e6cfd9e5de17"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum nodrop 0.1.12 (registry+https://github.com/rust-lang/crates.io-index)" = "9a2228dca57108069a5262f2ed8bd2e82496d2e074a06d1ccc7ce1687b6ae0a2"
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
"checksum nom 1.2.4 (registry+https://github.com/rust-lang/crates.io-index)" = "a5b8c256fd9471521bcb84c3cdba98921497f1a331cbc15b8030fc63b82050ce"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum normalize-line-endings 0.2.2 (registry+https://github.com/rust-lang/crates.io-index)" = "2e0a1a39eab95caf4f5556da9289b9e68f0aafac901b2ce80daaf020d3b733a8"
"checksum num-integer 0.1.39 (registry+https://github.com/rust-lang/crates.io-index)" = "e83d528d2677f0518c570baf2b7abdcf0cd2d248860b68507bdcb3e91d4c0cea"
"checksum num-traits 0.1.43 (registry+https://github.com/rust-lang/crates.io-index)" = "92e5113e9fd4cc14ded8e499429f396a20f98c772a47cc8622a736e1ec843c31"
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
"checksum num-traits 0.2.5 (registry+https://github.com/rust-lang/crates.io-index)" = "630de1ef5cc79d0cdd78b7e33b81f083cbfe90de0f4b2b2f07f905867c70e9fe"
Update ring
2018-01-07 18:33:04 +03:00
"checksum num_cpus 1.8.0 (registry+https://github.com/rust-lang/crates.io-index)" = "c51a3322e4bca9d212ad9a158a02abc6934d005490c054a2778df73a70aa0a30"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum number_prefix 0.2.8 (registry+https://github.com/rust-lang/crates.io-index)" = "dbf9993e59c894e3c08aa1c2712914e9e6bf1fcbfc6bef283e2183df345a4fee"
"checksum openssl 0.9.24 (registry+https://github.com/rust-lang/crates.io-index)" = "a3605c298474a3aa69de92d21139fb5e2a81688d308262359d85cdd0d12a7985"
"checksum openssl-sys 0.9.35 (registry+https://github.com/rust-lang/crates.io-index)" = "912f301a749394e1025d9dcddef6106ddee9252620e6d0a0e5f8d0681de9b129"
"checksum owning_ref 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)" = "cdf84f41639e037b484f93433aa3897863b561ed65c6e59c7073d7c561710f37"
"checksum parking_lot 0.6.4 (registry+https://github.com/rust-lang/crates.io-index)" = "f0802bff09003b291ba756dc7e79313e51cc31667e94afbe847def490424cde5"
"checksum parking_lot_core 0.3.0 (registry+https://github.com/rust-lang/crates.io-index)" = "06a2b6aae052309c2fd2161ef58f5067bc17bb758377a0de9d4b279d603fdd8a"
Update ring
2018-01-07 18:33:04 +03:00
"checksum percent-encoding 1.0.1 (registry+https://github.com/rust-lang/crates.io-index)" = "31010dd2e1ac33d5b46a5b413495239882813e0369f8ed8a5e266f173602f831"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum phf 0.7.23 (registry+https://github.com/rust-lang/crates.io-index)" = "cec29da322b242f4c3098852c77a0ca261c9c01b806cae85a5572a1eb94db9a6"
"checksum phf_codegen 0.7.23 (registry+https://github.com/rust-lang/crates.io-index)" = "7d187f00cd98d5afbcd8898f6cf181743a449162aeb329dcd2f3849009e605ad"
"checksum phf_generator 0.7.23 (registry+https://github.com/rust-lang/crates.io-index)" = "03dc191feb9b08b0dc1330d6549b795b9d81aec19efe6b4a45aec8d4caee0c4b"
"checksum phf_shared 0.7.23 (registry+https://github.com/rust-lang/crates.io-index)" = "b539898d22d4273ded07f64a05737649dc69095d92cb87c7097ec68e3f150b93"
"checksum pkg-config 0.3.14 (registry+https://github.com/rust-lang/crates.io-index)" = "676e8eb2b1b4c9043511a9b7bea0915320d7e502b0a079fb03f9635a5252b18c"
cargo update
2018-02-01 18:29:23 +03:00
"checksum podio 0.1.6 (registry+https://github.com/rust-lang/crates.io-index)" = "780fb4b6698bbf9cf2444ea5d22411cef2953f0824b98f33cf454ec5615645bd"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum predicates 0.9.0 (registry+https://github.com/rust-lang/crates.io-index)" = "799dc506006c16c25b28476046abfc20a95f71de59e95ebb8ee302e029a30173"
"checksum predicates-core 0.9.0 (registry+https://github.com/rust-lang/crates.io-index)" = "85f80bc390d1c02a4cdaa63f27f05c3c426679eb65433d8dd65d392147e4e5c5"
"checksum predicates-tree 0.9.0 (registry+https://github.com/rust-lang/crates.io-index)" = "2e86df9b81bdcb0a5141aca9d2b9c5e0c558ef6626d3ae2c12912f5c9df740bd"
"checksum proc-macro2 0.4.15 (registry+https://github.com/rust-lang/crates.io-index)" = "295af93acfb1d5be29c16ca5b3f82d863836efd9cb0c14fd83811eb9a110e452"
make connecting to server a little more lenient when starting the server
2016-10-26 01:14:21 +03:00
"checksum pulldown-cmark 0.0.3 (registry+https://github.com/rust-lang/crates.io-index)" = "8361e81576d2e02643b04950e487ec172b687180da65c731c03cf336784e6c07"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"checksum quick-error 1.2.2 (registry+https://github.com/rust-lang/crates.io-index)" = "9274b940887ce9addde99c4eee6b5c44cc494b182b97e73dc8ffdcb3397fd3f0"
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
"checksum quote 0.3.15 (registry+https://github.com/rust-lang/crates.io-index)" = "7a6e920b65c65f10b2ae65c831a81a073a89edd28c7cce89475bff467ab4167a"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum quote 0.6.8 (registry+https://github.com/rust-lang/crates.io-index)" = "dd636425967c33af890042c483632d33fa7a18f19ad1d7ea72e8998c6ef8dea5"
"checksum rand 0.3.22 (registry+https://github.com/rust-lang/crates.io-index)" = "15a732abf9d20f0ad8eeb6f909bf6868722d9a06e1e50802b6a70351f40b4eb1"
"checksum rand 0.4.3 (registry+https://github.com/rust-lang/crates.io-index)" = "8356f47b32624fef5b3301c1be97e5944ecdd595409cc5da11d05f211db6cfbd"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum rand 0.5.5 (registry+https://github.com/rust-lang/crates.io-index)" = "e464cd887e869cddcae8792a4ee31d23c7edd516700695608f5b98c67ee0131c"
"checksum rand_core 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)" = "edecf0f94da5551fc9b492093e30b041a891657db7940ee221f9d2f66e82eef2"
"checksum redis 0.9.0 (registry+https://github.com/rust-lang/crates.io-index)" = "2dde3e551c6f072b3c1feab259e2d85e5795dfb4a4e0dd1510f3a1269f3befcf"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum redox_syscall 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)" = "c214e91d3ecf43e9a4e41e578973adeb14b474f2bee858742d127af75a0112b1"
Update ring
2018-01-07 18:33:04 +03:00
"checksum redox_termios 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)" = "7e891cfe48e9100a70a3b6eb652fef28920c117d366339687bd5576160db0f76"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum regex 1.0.4 (registry+https://github.com/rust-lang/crates.io-index)" = "67d0301b0c6804eca7e3c275119d0b01ff3b7ab9258a65709e608a66312a1025"
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
"checksum regex-syntax 0.6.2 (registry+https://github.com/rust-lang/crates.io-index)" = "747ba3b235651f6e2f67dfa8bcdcd073ddb7c243cb21c442fc12395dfcac212d"
cargo update
2018-02-01 18:29:23 +03:00
"checksum relay 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)" = "1576e382688d7e9deecea24417e350d3062d97e32e45d70b1cde65994ff1489a"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum remove_dir_all 0.5.1 (registry+https://github.com/rust-lang/crates.io-index)" = "3488ba1b9a2084d38645c4c08276a1752dcbf2c7130d74f1569681ad5d2799c5"
Feature flag toggle for distributed compilation, cleanups
2018-07-31 01:06:14 +03:00
"checksum reqwest 0.8.6 (registry+https://github.com/rust-lang/crates.io-index)" = "2abe46f8e00792693a2488e296c593d1f4ea39bb1178cfce081d6793657575e4"
make connecting to server a little more lenient when starting the server
2016-10-26 01:14:21 +03:00
"checksum retry 0.4.0 (registry+https://github.com/rust-lang/crates.io-index)" = "29460f6011a25fc70b22010e796bd98330baccaa0005cba6f90b858a510dec0d"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum ring 0.13.2 (registry+https://github.com/rust-lang/crates.io-index)" = "dbe642b9dd1ba0038d78c4a3999d1ee56178b4d415c1e1fbaba83b06dce012f0"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"checksum rouille 2.1.0 (git+https://github.com/tomaka/rouille.git?rev=7b6b2eb)" = "<none>"
make connecting to server a little more lenient when starting the server
2016-10-26 01:14:21 +03:00
"checksum rust-crypto 0.2.36 (registry+https://github.com/rust-lang/crates.io-index)" = "f76d05d3993fd5f4af9434e8e436db163a12a9d40e1a58a726f27a01dfd12a2a"
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
"checksum rustc-serialize 0.3.24 (registry+https://github.com/rust-lang/crates.io-index)" = "dcf128d1287d2ea9d80910b5f1120d0b8eede3fbf1abe91c40d39ea7d51e6fda"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum ryu 0.2.6 (registry+https://github.com/rust-lang/crates.io-index)" = "7153dd96dade874ab973e098cb62fcdbb89a03682e46b144fd09550998d4a4a7"
Update dependencies Notably bring in hyper from crates.io
2017-06-14 18:20:12 +03:00
"checksum safemem 0.2.0 (registry+https://github.com/rust-lang/crates.io-index)" = "e27a8b19b835f7aea908818e871f5cc3a5a186550c30773be987e155e8163d8f"
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
"checksum same-file 0.1.3 (registry+https://github.com/rust-lang/crates.io-index)" = "d931a44fdaa43b8637009e7632a02adc4f2b2e0733c08caa4cf00e8da4a117a7"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum schannel 0.1.13 (registry+https://github.com/rust-lang/crates.io-index)" = "dc1fabf2a7b6483a141426e1afd09ad543520a77ac49bd03c286e7696ccfd77f"
"checksum scoped-tls 0.1.2 (registry+https://github.com/rust-lang/crates.io-index)" = "332ffa32bf586782a3efaeb58f127980944bbc8c4d6913a86107ac2a5ab24b28"
Update ring
2018-01-07 18:33:04 +03:00
"checksum scopeguard 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)" = "94258f53601af11e6a49f722422f6e3425c52b06245a5cf9bc09908b174f5e27"
"checksum security-framework 0.1.16 (registry+https://github.com/rust-lang/crates.io-index)" = "dfa44ee9c54ce5eecc9de7d5acbad112ee58755239381f687e564004ba4a2332"
"checksum security-framework-sys 0.1.16 (registry+https://github.com/rust-lang/crates.io-index)" = "5421621e836278a0b139268f36eee0dc7e389b784dc3f79d8f11aabadf41bead"
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
"checksum semver 0.2.3 (registry+https://github.com/rust-lang/crates.io-index)" = "2d5b7638a1f03815d94e88cb3b3c08e87f0db4d683ef499d1836aaf70a45623f"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum serde 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)" = "22d340507cea0b7e6632900a176101fea959c7065d93ba555072da90aaaafc87"
"checksum serde_derive 1.0.75 (registry+https://github.com/rust-lang/crates.io-index)" = "234fc8b737737b148ccd625175fc6390f5e4dacfdaa543cb93a3430d984a9119"
"checksum serde_json 1.0.26 (registry+https://github.com/rust-lang/crates.io-index)" = "44dd2cfde475037451fa99b7e5df77aa3cfd1536575fa8e7a538ab36dcde49ae"
"checksum serde_urlencoded 0.5.3 (registry+https://github.com/rust-lang/crates.io-index)" = "aaed41d9fb1e2f587201b863356590c90c1157495d811430a0c0325fe8169650"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"checksum sha1 0.6.0 (registry+https://github.com/rust-lang/crates.io-index)" = "2579985fda508104f7587689507983eadd6a6e84dd35d6d115361f530916fa0d"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum siphasher 0.2.3 (registry+https://github.com/rust-lang/crates.io-index)" = "0b8de496cf83d4ed58b6be86c3a275b8602f6ffe98d3024a869e124147a9a3ac"
make connecting to server a little more lenient when starting the server
2016-10-26 01:14:21 +03:00
"checksum skeptic 0.4.0 (registry+https://github.com/rust-lang/crates.io-index)" = "24ebf8a06f5f8bae61ae5bbc7af7aac4ef6907ae975130faba1199e5fe82256a"
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
"checksum slab 0.3.0 (registry+https://github.com/rust-lang/crates.io-index)" = "17b4fcaed89ab08ef143da37bc52adbcc04d4a69014f4c1208d6b51f0c47bc23"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum slab 0.4.1 (registry+https://github.com/rust-lang/crates.io-index)" = "5f9776d6b986f77b35c6cf846c11ad986ff128fe0b2b63a3628e3755e8d3102d"
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
"checksum smallvec 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)" = "4c8cbcd6df1e117c2210e13ab5109635ad68a929fcbb8964dc965b76cb5ee013"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum smallvec 0.6.5 (registry+https://github.com/rust-lang/crates.io-index)" = "153ffa32fd170e9944f7e0838edf824a754ec4c1fc64746fcc9fe1f8fa602e5d"
"checksum socket2 0.3.8 (registry+https://github.com/rust-lang/crates.io-index)" = "c4d11a52082057d87cb5caa31ad812f4504b97ab44732cd8359df2e9ff9f48e7"
"checksum stable_deref_trait 1.1.1 (registry+https://github.com/rust-lang/crates.io-index)" = "dba1a27d3efae4351c8051072d619e3ade2820635c3958d826bfea39d59b54c8"
Always request color output from rustc. Fixes #99 This change makes sccache run rustc with `--color=always`, removing any other --color option from the compiler options so that it's not included in the cache key. A `color_mode` method is added to the `CompilerHasher` trait, and the value is sent back to the client in the `CompileFinished` method, so the client can determine whether specific --color options were passed without having to do its own commandline parsing. The client uses the new `strip-ansi-escapes` crate to remove escape codes from the compiler output in situations where color output is not desired: * When `--color=never` was passed on the compiler commandline. * When `--color=auto` is in effect (the default) but the output is not a terminal. The existing cargo tests were lightly modified to run compile once with `--color=never` and once with `--color=always` to validate that cache hits are not affected by color options.
2018-02-02 15:11:11 +03:00
"checksum strip-ansi-escapes 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)" = "9d63676e2abafa709460982ddc02a3bb586b6d15a49b75c212e06edd3933acee"
Silence some warnings
2018-07-12 13:46:33 +03:00
"checksum strsim 0.7.0 (registry+https://github.com/rust-lang/crates.io-index)" = "bb4f380125926a99e52bc279241539c018323fab05ad6368b56f93d9369ff550"
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
"checksum syn 0.11.11 (registry+https://github.com/rust-lang/crates.io-index)" = "d3b891b9015c88c576343b9b3e41c2c11a51c219ef067b264bd9c8aa9b441dad"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum syn 0.14.9 (registry+https://github.com/rust-lang/crates.io-index)" = "261ae9ecaa397c42b960649561949d69311f08eeaea86a65696e6e46517cf741"
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
"checksum synom 0.11.3 (registry+https://github.com/rust-lang/crates.io-index)" = "a393066ed9010ebaed60b9eafa373d4b1baac186dd7e008555b0f702b51945b6"
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
"checksum take 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)" = "b157868d8ac1f56b64604539990685fa7611d8fa9e5476cf0c02cf34d32917c5"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum tar 0.4.16 (registry+https://github.com/rust-lang/crates.io-index)" = "e8f41ca4a5689f06998f0247fcb60da6c760f1950cc9df2a10d71575ad0b062a"
"checksum tempdir 0.3.7 (registry+https://github.com/rust-lang/crates.io-index)" = "15f2b5fb00ccdf689e0149d1b1b3c03fead81c2b37735d812fa8bddbbf41b6d8"
chore: Update tempfile to 3
2018-08-28 15:20:49 +03:00
"checksum tempfile 3.0.3 (registry+https://github.com/rust-lang/crates.io-index)" = "c4b103c6d08d323b92ff42c8ce62abcd83ca8efa7fd5bf7927efefec75f58c76"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"checksum term 0.5.1 (registry+https://github.com/rust-lang/crates.io-index)" = "5e6b677dd1e8214ea1ef4297f85dbcbed8e8cdddb561040cc998ca2551c37561"
chore: Update log to 0.4 and env_logger to 0.5
2018-08-28 14:41:11 +03:00
"checksum termcolor 1.0.2 (registry+https://github.com/rust-lang/crates.io-index)" = "3390f44f1f706d8870297b6a2c4f92d9ab65a37c265fbbc6ac4ee72bcc2f3698"
Update ring
2018-01-07 18:33:04 +03:00
"checksum termion 1.5.1 (registry+https://github.com/rust-lang/crates.io-index)" = "689a3bdfaab439fd92bc87df5c4c78417d3cbe537487274e9b0b2dce76e92096"
Silence some warnings
2018-07-12 13:46:33 +03:00
"checksum textwrap 0.10.0 (registry+https://github.com/rust-lang/crates.io-index)" = "307686869c93e71f94da64286f9a9524c0f308a9e1c87a583de8e9c9039ad3f6"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum thread_local 0.3.6 (registry+https://github.com/rust-lang/crates.io-index)" = "c6b53e329000edc2b34dbe8545fd20e55a333362d0a321909685a19bd28c3f1b"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum threadpool 1.7.1 (registry+https://github.com/rust-lang/crates.io-index)" = "e2f0c90a5f3459330ac8bc0d2f879c693bb7a2f59689c1083fc4ef83834da865"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum time 0.1.40 (registry+https://github.com/rust-lang/crates.io-index)" = "d825be0eb33fda1a7e68012d51e9c7f451dc1a69391e7fdc197060bb8c56667b"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"checksum tiny_http 0.6.0 (registry+https://github.com/rust-lang/crates.io-index)" = "a442681f9f72e440be192700eeb2861e4174b9983f16f4877c93a134cb5e5f63"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum tokio 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)" = "fbb6a6e9db2702097bfdfddcb09841211ad423b86c75b5ddaca1d62842ac492c"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum tokio-codec 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)" = "881e9645b81c2ce95fcb799ded2c29ffb9f25ef5bef909089a420e5961dd8ccb"
"checksum tokio-core 0.1.17 (registry+https://github.com/rust-lang/crates.io-index)" = "aeeffbbb94209023feaef3c196a41cbcdafa06b4a6f893f68779bb5e53796f71"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum tokio-current-thread 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)" = "8fdfb899688ac16f618076bd09215edbfda0fd5dfecb375b6942636cb31fa8a7"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum tokio-executor 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)" = "84823b932d566bc3c6aa644df4ca36cb38593c50b7db06011fd4e12e31e4047e"
"checksum tokio-fs 0.1.3 (registry+https://github.com/rust-lang/crates.io-index)" = "b5cbe4ca6e71cb0b62a66e4e6f53a8c06a6eefe46cc5f665ad6f274c9906f135"
"checksum tokio-io 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)" = "8d6cc2de7725863c86ac71b0b9068476fec50834f055a243558ef1655bbd34cb"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum tokio-process 0.1.6 (registry+https://github.com/rust-lang/crates.io-index)" = "f282588e1373af0a4e16bddf0c215c1a68b0bfe9b2dfa9704e540f01c3866de8"
Update to using the new tokio-io crate This is an abstraction of the Tokio stack now and doesn't have much impact on sccache itself but I figured it'd be good to update a few deps and pick up the recent version of things! Plus that and I'd like to start using the length_delimited module soon...
2017-03-09 21:00:18 +03:00
"checksum tokio-proto 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)" = "8fbb47ae81353c63c487030659494b295f6cb6576242f907f203473b191b0389"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum tokio-reactor 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)" = "4bfbaf9f260635649ec26b6fb4aded03887295ffcd999f6e43fd2c4758f758ea"
Depend on tokio-serde-bincode from crates.io
2017-07-13 21:33:57 +03:00
"checksum tokio-serde 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)" = "894168193c4f80862a2244ff953b69145a9961a9efba39500e0970b083d0649c"
"checksum tokio-serde-bincode 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)" = "02e35c8d60a5e87cfb30dd562a309e56f8a6d36617b0a76c87f04d5466607ca8"
Rewrite the server module with Tokio This commit rewrites the `server` module of sccache to be backed with Tokio. The previous version was written with `mio`, which Tokio is built on, but is unfortunately less ergonomic. Tokio is the state-of-the-art for asynchronous programming in Rust and sccache serves as a great testing ground for ergonomics! It's intended that the support added here will eventually extend to many other operations that sccache does as well. For example thread spawning has all been replaced with `CpuPool` to have a shared pool for I/O operations and such (namely the filesystem). Eventually the HTTP requests made by the S3 backend can be integrated with the Tokio branch of Hyper as well to run that on the event loop instead of in a worker thread. I'd also like to eventually extend this with `tokio-process` as well to move process spawning off helper threads as well, but I'm leaving that to a future commit as well. Overall I found the transition was quite smooth, with the high level architecture look like: * The `tokio-proto` crate is used in streaming mode. The streaming part is used for the one RPC sccache gets which requires a second response to be sent later on. This second response is the "response body" in tokio-proto terms. * All of sccache's logic is manifested in an implementation of the `Service` trait. * The transport layer is provided with `tokio_core::io::{Framed, Codec}`, and simple deserialization/serialization is performed with protobuf. Some differences in design are: * The `SccacheService` for now is just a bunch of reference-counted pointers, making it cheap to clone. As the futures it returns progress they will each retain a reference to a cloned copy of the `SccacheService`. Before all this data was just stored and manipulated in a struct directly, but it's now directly managed through shared memory. * The storage backends share a thread pool with the main server instead of spawning threads. And finally, some things I've learned along the way: * Sharing data between futures isn't a trivial operation. It took an explicit decision to use `Rc` and I'm not sure I'm 100% happy with how the ergonomics played out. * Shutdown is pretty tricky here. I've tried to carry over all the previous logic but it definitely required not using `TcpServer` in tokio-proto at the very least, and otherwise required a few custom futures and such to track the various states. I have a hunch that tokio-proto could provide more options out of the box for something like this.
2017-01-31 04:04:03 +03:00
"checksum tokio-service 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)" = "24da22d077e0f15f55162bdbdc661228c1581892f52074fb242678d015b45162"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum tokio-signal 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)" = "e8f46863230f9a05cf52d173721ec391b9c5782a2465f593029922b8782b9ffe"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum tokio-tcp 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)" = "5b4c329b47f071eb8a746040465fa751bd95e4716e98daef6a9b4e434c17d565"
"checksum tokio-threadpool 0.1.6 (registry+https://github.com/rust-lang/crates.io-index)" = "a5758cecb6e0633cea5d563ac07c975e04961690b946b04fd84e7d6445a8f6af"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum tokio-timer 0.2.6 (registry+https://github.com/rust-lang/crates.io-index)" = "d03fa701f9578a01b7014f106b47f0a363b4727a7f3f75d666e312ab7acbbf1c"
Update ring
2018-01-07 18:33:04 +03:00
"checksum tokio-tls 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)" = "772f4b04e560117fe3b0a53e490c16ddc8ba6ec437015d91fa385564996ed913"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum tokio-udp 0.1.2 (registry+https://github.com/rust-lang/crates.io-index)" = "da941144b816d0dcda4db3a1ba87596e4df5e860a72b70783fe435891f80601c"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum tokio-uds 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)" = "424c1ed15a0132251813ccea50640b224c809d6ceafb88154c1a8775873a0e89"
Allow configuration of caches with a config file
2018-06-04 20:28:39 +03:00
"checksum toml 0.4.6 (registry+https://github.com/rust-lang/crates.io-index)" = "a0263c6c02c4db6c8f7681f9fd35e90de799ebd4cfdeab77a38f4ff6b3d8c0d9"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum treeline 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)" = "a7f741b240f1a48843f9b8e0444fb55fb2a4ff67293b50a9179dfd5ea67f8d41"
Feature flag toggle for distributed compilation, cleanups
2018-07-31 01:06:14 +03:00
"checksum try-lock 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)" = "ee2aa4715743892880f70885373966c83d73ef1b0838a664ef0c76fffd35e7c2"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum twoway 0.1.8 (registry+https://github.com/rust-lang/crates.io-index)" = "59b11b2b5241ba34be09c3cc85a36e56e48f9888862e19cedf23336d35316ed1"
Switch from assert_cli to assert_cmd
2018-07-26 22:52:50 +03:00
"checksum ucd-util 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)" = "fd2be2d6639d0f8fe6cdda291ad456e23629558d466e2789d2c3e9892bda285d"
Rework sccache to use http rather than tcp
2018-07-12 02:38:16 +03:00
"checksum unicase 1.4.2 (registry+https://github.com/rust-lang/crates.io-index)" = "7f4765f83163b74f957c797ad9253caf97f103fb064d3999aea9568d09fc8a33"
Update ring
2018-01-07 18:33:04 +03:00
"checksum unicase 2.1.0 (registry+https://github.com/rust-lang/crates.io-index)" = "284b6d3db520d67fbe88fd778c21510d1b0ba4a551e5d0fbb023d33405f6de8a"
"checksum unicode-bidi 0.3.4 (registry+https://github.com/rust-lang/crates.io-index)" = "49f2bd0c6468a8230e1db229cff8029217cf623c767ea5d60bfbd42729ea54d5"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum unicode-normalization 0.1.7 (registry+https://github.com/rust-lang/crates.io-index)" = "6a0180bc61fc5a987082bfa111f4cc95c4caff7f9799f3e46df09163a937aa25"
"checksum unicode-width 0.1.5 (registry+https://github.com/rust-lang/crates.io-index)" = "882386231c45df4700b275c7ff55b6f3698780a650026380e72dabe76fa46526"
Move from protobuf to bincode for a wire format This commit migrates away from the `protobuf` crate to instead just working with bincode on the wire as a serialization format. This is done by leveraging a few different crates: * The `bincode` and `serde_derive` crates are used to define serialization for Rust structures as well as provide a bincode implementation. * The `tokio_io::codec::length_delimited` module implements framing via length prefixes to transform an asynchronous stream of bytes into a literal `Stream` of `BytesMut`. * The `tokio_serde_bincode` crate is then used to tie it all together, parsing these `BytesMut` as the request/response types of sccache. Most of the changes here are related to moving away from the protobuf API throughout the codebase (e.g. `has_foo` and `take_foo`) towards a more rustic-ish API that just uses enums/structs. Overall it felt quite natural (as one would expect) to just use the raw enum/struct values. This may not be quite as performant as before but that doesn't really apply to sccache's use case where perf is hugely dominated by actually compiling and hashing, so I'm not too too worried about that. My personal motivation for this is twofold: 1. Using `protobuf` was a little clunky throughout the codebase and definitely had some sharp edges that felt good to smooth out. 2. There's currently what I believe some mysterious segfault and/or stray write happening in sccache and I'm not sure where. The `protobuf` crate had a lot of `unsafe` code and in lieu of actually auditing it I figured it'd be good to kill two birds with one stone. I have no idea if this fixes my segfault problem (I never could reproduce it) but I figured it's worth a shot.
2017-03-22 20:21:52 +03:00
"checksum unicode-xid 0.0.4 (registry+https://github.com/rust-lang/crates.io-index)" = "8c1f860d7d29cf02cb2f3f359fd35991af3d30bac52c57d265a3c461074cb4dc"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum unicode-xid 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)" = "fc72304796d0818e357ead4e000d19c9c174ab23dc11093ac919054d20a6a7fc"
Add a Memcached cache variant This cache module uses a Memcached cluster. To make sccache use this, set SCCACHE_MEMCACHED to a list of tcp://<hostname>:<port> addresses, separated by whitespace.
2017-08-10 17:50:33 +03:00
"checksum unix_socket 0.5.0 (registry+https://github.com/rust-lang/crates.io-index)" = "6aa2700417c405c38f5e6902d699345241c28c0b7ade4abaad71e35a87eb1564"
Update ring
2018-01-07 18:33:04 +03:00
"checksum unreachable 1.0.0 (registry+https://github.com/rust-lang/crates.io-index)" = "382810877fe448991dfc7f0dd6e3ae5d58088fd0ea5e35189655f84e6814fa56"
Use redis-0.9 for async requests
2018-08-27 17:23:32 +03:00
"checksum untrusted 0.6.2 (registry+https://github.com/rust-lang/crates.io-index)" = "55cd1f4b4e96b46aeb8d4855db4a7a9bd96eeeb5c6a1ab54593328761642ce2f"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"checksum url 1.7.1 (registry+https://github.com/rust-lang/crates.io-index)" = "2a321979c09843d272956e73700d12c4e7d3d92b2ee112b31548aef0d4efc5a6"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum utf8-ranges 1.0.1 (registry+https://github.com/rust-lang/crates.io-index)" = "fd70f467df6810094968e2fce0ee1bd0e87157aceb026a8c083bcf5e25b9efe4"
Always request color output from rustc. Fixes #99 This change makes sccache run rustc with `--color=always`, removing any other --color option from the compiler options so that it's not included in the cache key. A `color_mode` method is added to the `CompilerHasher` trait, and the value is sent back to the client in the `CompileFinished` method, so the client can determine whether specific --color options were passed without having to do its own commandline parsing. The client uses the new `strip-ansi-escapes` crate to remove escape codes from the compiler output in situations where color output is not desired: * When `--color=never` was passed on the compiler commandline. * When `--color=auto` is in effect (the default) but the output is not a terminal. The existing cargo tests were lightly modified to run compile once with `--color=never` and once with `--color=always` to validate that cache hits are not affected by color options.
2018-02-02 15:11:11 +03:00
"checksum utf8parse 0.1.0 (registry+https://github.com/rust-lang/crates.io-index)" = "a15ea87f3194a3a454c78d79082b4f5e85f6956ddb6cb86bbfbe4892aa3c0323"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum uuid 0.6.5 (registry+https://github.com/rust-lang/crates.io-index)" = "e1436e58182935dcd9ce0add9ea0b558e8a87befe01c1a301e6020aeb0876363"
"checksum vcpkg 0.2.6 (registry+https://github.com/rust-lang/crates.io-index)" = "def296d3eb3b12371b2c7d0e83bfe1403e4db2d7a0bba324a12b21c4ee13143d"
"checksum vec_map 0.8.1 (registry+https://github.com/rust-lang/crates.io-index)" = "05c78687fb1a80548ae3250346c3db86a80a7cdd77bda190189f2d0a0987c81a"
"checksum version_check 0.1.4 (registry+https://github.com/rust-lang/crates.io-index)" = "7716c242968ee87e5542f8021178248f267f295a5c4803beae8b8b7fd9bc6051"
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
"checksum void 1.0.2 (registry+https://github.com/rust-lang/crates.io-index)" = "6a02e4885ed3bc0f2de90ea6dd45ebcbb66dacffe03547fadbb0eeae2770887d"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum vte 0.3.3 (registry+https://github.com/rust-lang/crates.io-index)" = "4f42f536e22f7fcbb407639765c8fd78707a33109301f834a594758bedd6e8cf"
Update dependencies * Mostly upgrade to serde 1.0 * Pull in lots of other updates for other small deps
2017-05-18 23:53:00 +03:00
"checksum walkdir 1.0.7 (registry+https://github.com/rust-lang/crates.io-index)" = "bb08f9e670fab86099470b97cd2b252d6527f0b3cc1401acdb595ffc9dd288ff"
Feature flag toggle for distributed compilation, cleanups
2018-07-31 01:06:14 +03:00
"checksum want 0.0.4 (registry+https://github.com/rust-lang/crates.io-index)" = "a05d9d966753fa4b5c8db73fcab5eed4549cfe0e1e4e66911e5564a0085c35d1"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum which 1.0.5 (registry+https://github.com/rust-lang/crates.io-index)" = "e84a603e7e0b1ce1aa1ee2b109c7be00155ce52df5081590d1ffb93f4f515cb2"
make connecting to server a little more lenient when starting the server
2016-10-26 01:14:21 +03:00
"checksum winapi 0.2.8 (registry+https://github.com/rust-lang/crates.io-index)" = "167dc9d6949a9b857f3451275e911c3f44255842c1f7a76f33c55103a909087a"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum winapi 0.3.5 (registry+https://github.com/rust-lang/crates.io-index)" = "773ef9dcc5f24b7d850d0ff101e542ff24c3b090a9768e03ff889fdef41f00fd"
make connecting to server a little more lenient when starting the server
2016-10-26 01:14:21 +03:00
"checksum winapi-build 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)" = "2d315eee3b34aca4797b2da6b13ed88266e6d612562a0c46390af8299fc699bc"
cargo update
2018-02-01 18:29:23 +03:00
"checksum winapi-i686-pc-windows-gnu 0.4.0 (registry+https://github.com/rust-lang/crates.io-index)" = "ac3b87c63620426dd9b991e5ce0329eff545bccbbb34f3be09ff6fb6ab51b7b6"
chore: Update log to 0.4 and env_logger to 0.5
2018-08-28 14:41:11 +03:00
"checksum winapi-util 0.1.1 (registry+https://github.com/rust-lang/crates.io-index)" = "afc5508759c5bf4285e61feb862b6083c8480aec864fa17a81fdec6f69b461ab"
cargo update
2018-02-01 18:29:23 +03:00
"checksum winapi-x86_64-pc-windows-gnu 0.4.0 (registry+https://github.com/rust-lang/crates.io-index)" = "712e227841d057c1ee1cd2fb22fa7e5a5461ae8e48fa2ca79ec42cfc1931183f"
chore: Update log to 0.4 and env_logger to 0.5
2018-08-28 14:41:11 +03:00
"checksum wincolor 1.0.1 (registry+https://github.com/rust-lang/crates.io-index)" = "561ed901ae465d6185fa7864d63fbd5720d0ef718366c9a4dc83cf6170d7e9ba"
make connecting to server a little more lenient when starting the server
2016-10-26 01:14:21 +03:00
"checksum ws2_32-sys 0.2.1 (registry+https://github.com/rust-lang/crates.io-index)" = "d59cefebd0c892fa2dd6de581e937301d8552cb44489cdff035c6187cb63fa5e"
chore: Update predicates and assert_cmd
2018-08-28 14:29:00 +03:00
"checksum xattr 0.2.2 (registry+https://github.com/rust-lang/crates.io-index)" = "244c3741f4240ef46274860397c7c74e50eb23624996930e484c16679633a54c"
Add overlay builder (with bubblewrap), serde tweaks
2018-07-15 16:37:46 +03:00
"checksum zip 0.4.2 (registry+https://github.com/rust-lang/crates.io-index)" = "36b9e08fb518a65cf7e08a1e482573eb87a2f4f8c6619316612a3c1f162fe822"