Storing ElastiCubes on S3

If you have configured AWS for Sisense, you can upload your ElastiCubes on S3 instead of shared storage. While you can use shared storage for your ElastiCubes, storing ElastiCubes on S3 works well when you have small to medium sized ElastiCubes, up to a maximum 10 GB.

In addition, from your S3 storage, Sisense enables you to build the ElastiCubes locally instead of shared storage. ElastiCubes stored locally are built from the default location /opt/sisense/local_storage.

Note:

Sisense recommends that you mount with NVMe for better performance.

If you build your ElastiCubes on S3, Sisense wraps these files and stores them as .tar archives. Sisense doesn't delete previous ElastiCubes from S3. You need to define an S3 policy to delete old files after a certain amount of days depending on your build policy and ensure you have enough storage to support the ElastiCubes.

Note:

AWS should be configured already and your AWS Secret Key and Access Key should be defined on the cluster level. You can configure these through the aws-i-am-authenticator.

There are two options for configuring Sisense to store and build your ElastiCubes on S3, from the Configuration Manager or through the Sisense CLI.

Configuration Manager

  1. In Sisense, open the Admin page, search for and select System Management which is located under Server & Hardware, and click Configuration.
  2. Click the Sisense Logo five times in quick succession to display advanced settings.
  3. In the left menu, select Management.
  4. Enter the following information:
    S3bucket.value : Enter the name of your S3 bucket where the ElastiCubes are to be stored.
    S3path.value : Enter the S3 file path where your ElastiCubes are to be stored.
    Build On Local Storage : Enable to build ElastiCubes on S3.
    BuildOnS3Storage.value : Enable to save your ElastiCubes on S3.
  5. Click Save.

Sisense CLI

In the Sisense CLI, run the following command to set:
Run Builds on Local Storage
si datagroups update -name Default -build-on-local (true/false)

Upload ElastiCubes to S3
si datagroups update -name Default -build-ons3 (true/false)

Automatically Run the Builds on Local Storage
si config set -key management.LocalStoragePath -new-value /opt/sisense/local_storage

Note:

Make sure you have enough space to support your ElastiCubes and Sisense recommends you mount with NVMe.

Copy to S3 Bucket Name
si config set -key management.S3bucket -new-value sisensebucket

Define the Bucket Path
si config set -key management.S3path -new-value sisense

Set Your AWS Keys
Access Key
si config set -key management.AWSAccessKey -new-value AKIASTI4JKEDZJXXXXXX
Secret Key
si config set -key management.AWSSecretKey -new-value XOHsMbjhywvA1m30cSf36QXOeEgvSobXXXXXXX/E