Skip to main content
Version: 0.0.37

Delta Lake

Integrating Delta Lake with Lakehousecat provides powerful capabilities for data management through ACID transactions and schema enforcement, allowing seamless interaction with your Delta Lake tables. This guide will outline the steps required to configure a Delta Lake connection within the Lakehousecat workspace.

Prerequisites​

Ensure you have the following before starting the integration process:

  • Access to Lakehousecat as an admin or builder
  • Endpoint URL and credentials for your Delta Lake tables

Step-by-Step Guide​

  1. Start in the Workspace

    • Navigate to your Lakehousecat workspace where you manage data connections.

  2. Go to the Data Section

    • Click on the 'Data' menu to explore various data-related options within Lakehousecat.

  3. Select "Datasource Types"

    • To view available data sources, select the "Datasource Types" option.

  4. Choose "Delta Lake Datasource Type"

    • Click on the "Delta Lake Datasource Type" to initiate the configuration process.

Step 3: Configure the Delta Lake Connection​

  • Connection Name: Enter a clear and descriptive name for your connection to easily identify it within Lakehousecat.
  • Endpoint URL: Provide the endpoint URL where your Delta Lake tables reside. Ensure this URL is correct to facilitate a successful connection.
  • Table Name: Specify the name of the Delta Lake table you wish to connect to.
  • Access Key: Enter the Access-Key required for authentication.
  • Secret Key: Input the Secret-Key associated with your Access-Key.
  • Description (Optional): Provide an optional description to help others understand the purpose or scope of this connection.

Step 4: Validate and Create the Connection​

  1. After entering the required information, click on the Create button.
  2. Lakehousecat will initiate validation of the connection parameters. Ensure that all details are correct to avoid validation errors.
  3. Once validation is successful, your Delta Lake connection will be established and ready for use.

Best Practices​

  • Naming Conventions: Utilize a consistent naming convention for connection names to improve recognition and manageability.
  • Description Usage: Utilize the description field to provide insights into the connection's intended use, especially if multiple connections exist.

Troubleshooting​

If you encounter issues during the connection setup:

  • Validation Errors: Double-check the Endpoint URL, Table Name, Access-Key, and Secret-Key for correctness.
  • Access Issues: Ensure you have the necessary permissions within both Lakehousecat and your Delta Lake environment.