Skip to content

Installing a Storage Server

The Streaming Integration Platform relies on taking periodic snapshots of your application data, and those snapshots are usually stored on a network-based storage server. The preferred solution is to use an on premises Amazon S3 (Simple Storage Service) compatible storage server.

Synergex has tested the following S3-compatible storage server solutions:

Product Documentation
MinIO AIStor https://docs.min.io/enterprise/aistor-object-store
RustFS https://docs.rustfs.com/installation
SeaweedFS https://github.com/seaweedfs/seaweedfs/wiki

Once you have selected and deployed your chosen S3 storage server you will need to document and provide the following information to allow for the necessary configuration of the various Streaming Integration Platform components that need to interact with the storage server:

  • The name of the S3 storage server being used.
  • DNS name or IP address of the storage server.
  • IP port number of the storage server (many storage servers use port 9000 by default).
  • The name of the S3 storage bucket to be used to store snapshot data.
  • Access credentials (username and password) to be used to access the storage server. The credentials must be to a user account that has both read and write permissions to the storage bucket.
  • Whether TLS (HTTPS) is used when accessing the storage server. In the case where TLS is used, the storage servers TLS certifiate must be trusted by all systems that host Streaming Integration Platform components.
  • Some S3 compatible servers (for example MinIO) can be optionally configured to operate as if they are located in a particular AWS region (e.g. us-east-1), and will fail if clients specify a different region code. If your server is configured in this way then you must specify the region code in use.
  • Some S3 compatible servers require a path (e.g. /s3) to be specified between the host name or address and the bucket name. If your S3 server is so configured then you must provide the path to be used.
  • Many S3 compatible storage servers present a browser-based user interface on an alternate port number. If your storage server is so configured, please provide the port number used to access the UI, and also whether TLS (HTTPS) is used when accessing the UI.