CloverETL is now CloverDX - Learn Why

Back to CloverDX Blog on Data Integration

Connecting to LinkedIn API with CloverETL

Posted by Jan Sedláček on Feb 11, 2014 11:25:20 AM

A few weeks ago, we published a blog about the interaction between CloverETL and Twitter to kick off our series on CloverETL and social media. In this post, we’ll describe how to connect to another network. Today, we’ll use CloverETL to connect to LinkedIn, a website for networking business professionals.

Register the Application

Connecting to LinkedIn is very similar to connecting to Twitter. First, you need to register the application and get the necessary security credentials.

Go to https://www.linkedin.com/secure/developer, sign in, and use the “Add new application” link.

CloverETL-LinkedIn-New-App

Fill in the required information about the application (CloverETL in this case), then set the proper permissions to be able to use the API calls you need. See the LinkedIn API documentation for further details about member permissions.

CloverETL-LinkedIn-OAuth-User-Agreement

After setting the information about the application, submit the form. The application is now registered, you have the necessary security credentials, and everything is ready for you to use the LinkedIn REST API. Credentials are available in the confirmation screen after registering your API. You can find them later at any time in your application settings (available here).

Using HTTPConnector

Use HTTPConnector to perform requests on LinkedIn in CloverETL. You need only to set the URL of the request and OAuth attributes in the component. Use these values from LinkedIn as attribute values in CloverETL:

  • API Key as OAuth Consumer key
  • Secret Key as OAuth Consumer key secret
  • OAuth User Token as OAuth Access Token
  • OAuth User Secret as OAuth Access Token secret

CloverETL-LinkedIn-OAuth

Now, HTTPConnector is ready to use LinkedIn API. With these settings, you will get XML as in response to API calls. You can store it into a file or use one of the XML components on it right away.

An Example

The example below shows how the XMLExtract component reads the response from a call to http://api.linkedin.com/v1/people/~/network/updates

CloverETL-LinkedIn-RESTAPI

The parsed XML is stored into a CSV file.

Download the example

Connecting to LinkedIn with CloverETL - Download the example.

Data integration software and ETL tools provided by the CloverDX platform (formerly known as CloverETL) offer solutions for data management tasks such as data integration, data migration, or data quality. CloverDX is a vital part of enterprise solutions such as data warehousing, business intelligence (BI) or master data management (MDM). CloverDX Designer (formerly known as CloverETL Designer) is a visual data transformation designer that helps define data flows and transformations in a quick, visual, and intuitive way. CloverDX Server (formerly known as CloverETL Server) is an enterprise ETL and data integration runtime environment. It offers a set of enterprise features such as automation, monitoring, user management, real-time ETL, data API services, clustering, or cloud data integration.