Using a Talend Job to create the AMC database schema

To log the AMC data in a database, a predefined schema is required. Tables for "Logs", "Stats" and "Flowmeter" data are required. These can be built by using your database administration tools in the traditional way, or you can create a simple Talend Data Integration job to do it for you. This tutorial shows how to create such a job. This sort of job may only be required once if you are working on a single site with one installation, but if you are regularly changing sites it can be a very useful tool to have in your Talend toolkit.

Creating random test data using Talend Data Integration

Unless you are very lucky, you are unlikely to have a plethora of test data for all of your data sources when you start working on a Data Integration project. As building Data Integration solutions usually starts in the absence of some of the systems that are intended to be integrated, we need to do our best to emulate their data outputs as accurately as possible so that when they are introduced it is like slotting a puzzle piece in the right hole.

Creating a piece of simple metadata using Talend Data Integration

Metadata can be described as "data about data". It tells us about how the data we are interested in is structured and describes its content. When working in Data Integration the first thing it is a good idea to do is understand your data. When using Talend products it is a good idea to start with creating metadata. This tutorial demonstrates how to create some metadata for a simple semicolon separated file.

For this tutorial we are using Talend Open Studio for ESB version 5.4.1.