S3

s3 based gateway allows to do long term reliable async persistency of the cluster state and indices directly to Amazon s3. Here is how it can be configured:

cloud:
    aws:
        access_key: AKVAIQBF2RECL7FJWGJQ
        secret_key: vExyMThREXeRMm/b/LRzEB8jWwvzQeXgjqMX+6br


gateway:
    type: s3
    s3:
        bucket: bucket_name

The following are a list of settings (prefixed with gateway.s3) that can further control the s3 gateway:

Setting	Description
chunk_size	Big files are broken down into chunks (to overcome AWS 5g limit and use concurrent snapshotting). Default set to 100m.

concurrent_streams

The gateway.s3.concurrent_streams allow to throttle the number of streams (per node) opened against the shared gateway performing the snapshot operation. It defaults to 5.

Region

The cloud.aws.region can be set to a region and will automatically use the relevant settings for both ec2 and s3. The available values are: us-east-1, us-west-1, ap-southeast-1, eu-west-1.