BucketFS

This section describes the BucketFS file system in Exasol.

What is BucketFS?

BucketFS is a synchronous file system that is available on all database nodes in an Exasol cluster. Each node in the cluster can connect to the BucketFS service and will see the same content as the other nodes.

A BucketFS service contains a number of buckets that can store a number of files. Each bucket can have different access privileges. Folders are not supported directly, but if you specify an upload path including folders, these will be created.

Each configured data disk in Exasol has a preinstalled BucketFS service with a default bucket. You can create additional BucketFS services as needed.

Setting up BucketFS and creating buckets

You can configure the BucketFS in the EXAoperation user interface. There is a pre-installed default BucketFS service for the configured data disk. If you want to create additional file system services, you need to specify only the data disk and specify the HTTPS ports. If you follow the link of a BucketFS ID, you can create and configure any number of buckets within this BucketFS. Beside the bucket name, you have to specify read/write passwords and define whether the bucket should be public readable (accessible for everyone).

For detailed steps on how to create a new BucketFS service and create new buckets, see BucketFS Setup.

This video explains how to set up and use BucketFS within UDF scripts.

Usage notes

  • The default BucketFS service has a default bucket with the Java, Python and R script languages preinstalled. We recommend that you do not store large amounts of user data in this bucket, but instead create a separate BucketFS service on a separate partition for this purpose.

  • The data in BucketFS is replicated locally on every server and automatically synchronized. To avoid performance issues we recommend that you do not store very large amounts of data in BucketFS.

  • Writing data to BucketFS is an atomic operation. There is no lock on files, so the latest write operation will overwrite the file. In contrast to the database itself, BucketFS is a pure file-based system and has no transactional semantic.

  • The data in BucketFS is not part of the database backups and must be manually backed up.

  • The default BucketFS service does not have a TLS port defined in a new installation of Exasol, you must add a HTTP or HTTPS port. The recommended default port for the BucketFS service is 2580.

    To configure the ports in the default BucketFS service, open EXAoperation and navigate to the Services > EXABuckets > EXABucketFS Services screen, then select the service and click on Edit.