Skip to main content
Version: 0.0.38

Create Datasource

The "Create Datasource" functionality in Lakehousecat is a process designed for administrators and users with the "Builder" role to establish connections to external data sources. These connections enable the integration of data into the workspace for analytical purposes. Below is a detailed step-by-step guide:

  1. Navigate to the Workspace: After logging into Lakehousecat, navigate to the workspace section. This area provides access to various features, including data management.

  2. Select the Datasource Type: In the workspace, go to the "Datasource Types" tab to browse the available data source options. Here, you can choose from a variety of database types and services, such as 'Postgres'.

  3. Enter Connection Parameters: Once a datasource type (e.g., 'Postgres') is selected, provide the required connection parameters:

    • Datasource Name: A unique name to identify the datasource.
    • Connection URI: The URI containing the address and access credentials for the database. These details are securely encrypted and stored.

    Optionally, you can add a description to document the purpose or content of the datasource.

  4. Create and Validate: After entering the necessary information, click 'Create' to establish the datasource and test the connection to the data service. Upon successful validation, the datasource is created and ready for further configuration.

  5. Advanced Settings and Filtering Options: After creation, proceed to the editing section to configure advanced settings. It is particularly important to set up filtering options to refine the data selection:

    • Filters can be applied at various levels, such as schema, table, or individual columns.
    • Raw filters can also be used for specific requirements, provided the datasource supports them.
    • These filtering options help reduce the volume of data used for analysis, which is especially beneficial for large datasets.

Scheduling Data Loads: Once filters and other settings are configured, you can schedule data load processes. This enables automated and regular updates of the data in your workspace.

In summary, the "Create Datasource" functionality is a critical step for connecting to external data sources, filtering relevant data, and preparing it for advanced analysis within Lakehousecat.