YCSB/s3

Quick Start

1. Set Up YCSB

Download the YCSB from this website:

https://github.com/brianfrankcooper/YCSB/releases/

You can choose to download either the full stable version or just one of the available binding.

2. Configuration of the AWS credentials

The access key ID and secret access key as well as the endPoint and region and the Client configurations like the maxErrorRetry can be set in a properties file under s3-binding/conf/s3.properties or sent by command line (see below). It is highly suggested to use the property file instead of to send the credentials through the command line.

3. Run YCSB

To execute the benchmark using the S3 storage binding, first files must be uploaded using the "load" option with this command:

   ./bin/ycsb load s3 -p table=theBucket -p s3.endPoint=s3.amazonaws.com -p s3.accessKeyId=yourAccessKeyId -p s3.secretKey=yourSecretKey -p fieldlength=10 -p fieldcount=20 -P workloads/workloada

With this command, the workload A will be executing with the loading phase. The file size is determined by the number of fields (fieldcount) and by the field size (fieldlength). In this case each file is 200 bytes (10 bytes for each field multiplied by 20 fields).

Running the command:

   ./bin/ycsb -t s3 -p table=theBucket -p s3.endPoint=s3.amazonaws.com -p s3.accessKeyId=yourAccessKeyId -p s3.secretKey=yourSecretKey -p fieldlength=10 -p fieldcount=20 -P workloads/workloada

the workload A will be executed with file size 200 bytes.

S3 Storage Configuration Parameters

The parameters to configure the S3 client can be set using the file "s3-binding/conf/s3.properties". This is highly advisable for the parameters s3.accessKeyId and s3.secretKey. All the other parameters can be set also on the command line. Here the list of all the parameters that is possible to configure:

• table

  • This should be a S3 Storage bucket name and it replace the standard table name assigned by YCSB.

• s3.endpoint

  • This indicate the endpoint used to connect to the S3 Storage service.
  • Default value is s3.amazonaws.com.

• s3.region

  • This indicate the region where your buckets are.
  • Default value is us-east-1.

• s3.accessKeyId

  • This is the accessKey of your S3 account.

• s3.secretKey

  • This is the secret associated with your S3 account.

• s3.maxErrorRetry

  • This is the maxErrorRetry parameter for the S3Client.

• s3.protocol

  • This is the protocol parameter for the S3Client. The default value is HTTPS.

• s3.sse

  • This parameter set to true activates the Server Side Encryption.

• s3.ssec

  • This parameter if not null activates the SSE-C client side encryption. The value passed with this parameter is the client key used to encrpyt the files.