Skip to main content
Version: 0.0.36

Apache Hudi

Integrating Apache Hudi with Lakehousecat provides efficient data management capabilities, allowing seamless interaction with your Hudi tables. This guide will outline the steps required to configure an Apache Hudi connection within the Lakehousecat workspace.

Prerequisites​

Ensure you have the following before starting the integration process:

  • Access to Lakehousecat as an admin or builder
  • Endpoint URL and credentials for your Hudi tables

Step-by-Step Guide​

  1. Start in the Workspace

    • Navigate to your Lakehousecat workspace where you manage data connections.

  2. Go to the Data Section

    • Click on the 'Data' menu to explore various data-related options within Lakehousecat.

  3. Select "Datasource Types"

    • To view available data sources, select the "Datasource Types" option.

  4. Choose "Hudi Datasource Type"

    • Click on the "Hudi Datasource Type" to initiate the configuration process.

Step 3: Configure the Hudi Connection​

  • Connection Name: Enter a clear and descriptive name for your connection to easily identify it within Lakehousecat.
  • Endpoint URL: Provide the endpoint URL for accessing your Hudi table. Ensure this URL is correct to facilitate a successful connection.
  • Table Name: Specify the name of the Hudi table you wish to connect to.
  • Access Key: Enter the Access-Key required for authentication.
  • Secret Key: Input the Secret-Key associated with your Access-Key.
  • Description (Optional): Provide an optional description to help others understand the purpose or scope of this connection.

Step 4: Validate and Create the Connection​

  1. After entering the required information, click on the Create button.
  2. Lakehousecat will initiate validation of the connection parameters. Ensure that all details are correct to avoid validation errors.
  3. Once validation is successful, your Hudi connection will be established and ready for use.

Best Practices​

  • Naming Conventions: Utilize a consistent naming convention for connection names to improve recognition and manageability.
  • Description Usage: Utilize the description field to provide insights into the connection's intended use, especially if multiple connections exist.

Troubleshooting​

If you encounter issues during the connection setup:

  • Validation Errors: Double-check the Endpoint URL, Access-Key, and Secret-Key for correctness.
  • Access Issues: Ensure you have the necessary permissions within both Lakehousecat and the Hudi environment.