Skip to main content
Version: 0.0.36

Amazon S3

Integrating Amazon S3 with Lakehousecat provides comprehensive object storage capabilities, enabling seamless access and management of your S3 storage resources. This guide outlines the steps required to configure an Amazon S3 connection within the Lakehousecat workspace.

Prerequisites​

Ensure you have the following before starting the integration process:

  • Access to Lakehousecat as an admin or builder
  • Amazon S3 endpoint URL and access credentials
  • Specification of format and compression options

Step-by-Step Guide​

  1. Start in the Workspace

    • Navigate to your Lakehousecat workspace where you manage data connections.

  2. Go to the Data Section

    • Click on the 'Data' menu to explore various data-related options within Lakehousecat.

  3. Select "Datasource Types"

    • To view available data sources, select the "Datasource Types" option.

  4. Choose "Amazon S3 Datasource Type"

    • Click on the "Amazon S3 Datasource Type" to initiate the configuration process.

Step 3: Configure the Amazon S3 Connection​

  • Connection Name: Enter a clear and descriptive name for your connection to easily identify it within Lakehousecat.
  • Endpoint URL: Provide the Amazon S3 endpoint URL for accessing your storage resources. Ensure this URL is correct to facilitate a successful connection.
  • Access Key: Enter the Access-Key required for authentication.
  • Secret Key: Input the Secret-Key associated with your Access-Key.
  • Format: Specify the format used for data storage, such as CSV, JSON, Parquet, etc.
  • Compression: Choose the compression option that matches your storage requirements, such as gzip, snappy, etc.
  • Description (Optional): Provide an optional description to help others understand the purpose or scope of this connection.

Step 4: Validate and Create the Connection​

  1. After entering the required information, click on the Create button.
  2. Lakehousecat will initiate validation of the connection parameters. Ensure that all details are correct to avoid validation errors.
  3. Once validation is successful, your Amazon S3 connection will be established and ready for use.

Best Practices​

  • Naming Conventions: Utilize a consistent naming convention for connection names to improve recognition and manageability.
  • Description Usage: Utilize the description field to provide insights into the connection's intended use, especially if multiple connections exist.

Troubleshooting​

If you encounter issues during the connection setup:

  • Validation Errors: Double-check the Endpoint URL, Access-Key, Secret-Key, Format, and Compression settings for correctness.
  • Access Issues: Ensure you have the necessary permissions within both Lakehousecat and the Amazon S3 environment.