Connecting to SQream Using Talend

Overview

This page describes how to use Talend to interact with a SQream DB cluster. The Talend connector is used for reading data from a SQream DB cluster and loading data into SQream DB.

In addition, this page provides a viability report on Talend’s comptability with SQream DB for stakeholders.

It includes the following:

About Talend

Talend is an open-source data integration platform. It provides various software and services for Big Data integration and management, enterprise application integration, data quality and cloud storage.

For more information about Talend, see Talend.

Quick Start Guide

Creating a New Metadata JDBC DB Connection

To create a new metadata JDBC DB connection:

  1. In the Repository panel, nagivate to Metadata and right-click Db connections.
../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_1.png
  1. Select Create connection.
../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_2.png
  1. In the Name field, type a name.
../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_3.png

The name cannot contain spaces.

  1. In the Purpose field, type a purpose and click Next. You cannot go to the next step until you define both a Name and a Purpose.
../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_4.png
  1. In the DB Type field, select JDBC.
../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_5.png
  1. In the JDBC URL field, type the relevant connection string.

    For connection string examples, see Connection Strings.

../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_6.png
  1. In the Drivers field, click the Add button.

    The “newLine entry is added.

../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_7.png
  1. One the “newLine entry, click the ellipsis.
../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_8.png

The Module window is displayed.

  1. From the Module window, select Artifact repository(local m2/nexus) and select Install a new module.
../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_9.png
  1. Click the ellipsis.
../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_9.5.png

Your hard drive is displayed.

  1. Navigate to a JDBC jar file (such as sqream-jdbc-4.4.0.jar)and click Open.
../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_10.png
  1. Click Detect the module install status.
../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_11.5.png
  1. Click OK.

The JDBC that you selected is displayed in the Driver field.

../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_12.png
  1. Click Select class name.
../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_13.png
  1. Click Test connection.
../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_14.png

If a driver class is not found (for example, you didn’t select a JDBC jar file), the following error message is displayed:

../../_images/Creating_a_New_Metadata_JDBC_DB_Connection_15.png

After creating a new metadata JDBC DB connection, you can do the following:

  • Use your new metadata connection.
  • Drag it to the job screen.
  • Build Talend components.

For more information on loading data from JSON files to the Talend Open Studio, see How to Load Data from JSON Files in Talend.

Back to top

Supported SQream Drivers

The following list shows the supported SQream drivers and versions:

Back to top

Supported Data Sources

Talend Cloud connectors let you create reusable connections with a wide variety of systems and environments, such as those shown below. This lets you access and read records of a range of diverse data.

  • Connections: Connections are environments or systems for storing datasets, including databases, file systems, distributed systems and platforms. Because these systems are reusable, you only need to establish connectivity with them once.
  • Datasets: Datasets include database tables, file names, topics (Kafka), queues (JMS) and file paths (HDFS). For more information on the complete list of connectors and datasets that Talend supports, see Introducing Talend Connectors.

Back to top

Supported Tool and Operating System Versions

Talend was tested using the following:

  • Talend version 7.4.1M6
  • Windows 10
  • SQream version 2021.1
  • JDBC version <version number>

Back to top

Known Issues

The the list below describes the following known issues as of 6/1/2021:

  • Schemas not displayed for tables with identical names.

Back to top