b9de0de37e | ||
---|---|---|
include | ||
mpi | ||
pclient | ||
pclient_uint | ||
pfuzz | ||
prio | ||
ptest | ||
python | ||
scripts | ||
.dockerignore | ||
.gitignore | ||
.travis.yml | ||
CODE_OF_CONDUCT.md | ||
Dockerfile | ||
Dockerfile.dist | ||
LICENSE | ||
README.md | ||
SConstruct | ||
docker-compose.yml |
README.md
libprio - A Prio library in C using NSS
NOTE - this repository is being used for Firefox as part of a pilot experiment, this repository will be archived in favor of the new Rust implementation, libprio-rs. Please direct contributions that are not related to the Firefox pilot to this new project.
Warning: We do our best to write bug-free code, but I have no doubt that there are scary bugs, side-channel attacks, and memory leaks lurking herein.
Security bugs: If you find a security-critical bug in libprio, please report it to Mozilla using the contact information on this page.
Overview
This is an implementation of the core cryptographic routines for the Prio system for the private computation of aggregate statistics:
"Prio: Private, Robust, and Scalable Computation of Aggregate Statistics"
by Henry Corrigan-Gibbs and Dan Boneh
USENIX Symposium on Networked Systems Design and Implementation
March 2017Available online at: https://crypto.stanford.edu/prio/
Usage scenario. The library implements the cryptographic routines necessary for the following application scenario: Each client holds a vector of boolean values. Each client uses the library to encode her private vector into two encoded packets—one for server A and one for server B.
After receiving shares from a client, the servers can use the routines implemented here to check whether the client-provided packets are well formed. (Without this check, a single malicious client can corrupt the output of the computation.)
After collecting data packets from many clients, the servers
can combine their state to learn how many clients had the
ith bit of their data vector set to true
and how many
clients had the ith bit of their data vector set to false
.
As long as at least one of the two servers is honest
(i.e., runs the correct code),
the servers learn nothing else about the clients' data,
under standard cryptographic assumptions.
For example, the ith bit of the data vector could indicate whether the client ever visited the ith-ranked website in the Alexa Top 500. The servers would learn how many clients visited each of the Top 500 websites without learning which clients visited which websites.
Efficiency considerations. The code makes no use of public-key crypto, so it should be relatively fast. When each a data packet is of length N, all arithmetic is modulo a prime p (we use an 87-bit prime by default), and "elements" are integers modulo p, the dominant costs of the system are:
- Client compute: O(N log N) multiplications
- Client-to-server communication: 2N + O(1) elements
- Server compute: O(N log N) multiplications to check each packet
(NOTE: Using an optimization we haven't yet implemented, we can drop this cost to O(N) multiplications per packet.) - Server-to-server communication: O(1) elements
- Server storage: O(N) elements
Running the code
You must first install NSS/NSPR with NSPR version 4.13.1 (or newer?) and NSS version 3.35 (or newer?), SCons version 3.0.1 (or newer?), and msgpack-c version 2.1.5 (or newer?).
On Ubuntu Bionic (18.04LTS), you can install NSS and scons with:
$ sudo apt install scons libnspr4-dev libnss3-dev
and you will have to download msgpack-c 2.1.5 or newer here, since the Ubuntu packages for msgpack are far out of date.
For macOS using Homebrew:
$ brew install nss nspr scons msgpack
To compile the code, run:
$ scons
To run the test suite, execute:
$ build/ptest/ptest -v
To print debug messages while compiling:
$ scons VERBOSE=1
To compile with debug symbols, run:
$ scons DEBUG=1
To clean up the object and binary files, run:
$ scons -c
The library can be built and tested with docker.
$ docker-compose build
$ docker-compose run libprio
The files in this directory are:
/build - Binaries, object files, etc.
/include - Exported header files
(Note: The public header is <mprio.h> since
NSPR already has a file called <prio.h>.)
/mpi - NSS MPI bignum library
/pclient - Example code that uses the Prio library
/prio - Prio library core code
/ptest - Tests and test runner
Optimizations and features not yet implemented
- Server compute. By using a fast polynomial interpolation-and-evaluation routine, we can reduce the cost of checking a single client request from O(N log N) multiplications down to O(N) multiplications, for a data packet of N items.
- Differential privacy. It would be very straightforward to add some small amount of noise to the final statistics to provide differential privacy. If this would be useful, I can add it.
- Misc. There are TODO notes scattered throughout code indicating places for potential performance optimizations.