Handling integration errors

As we mentioned at the very beginning of our blog series, all integration problems essentially fall into two large categories: the problems that have to do with the technical mechanics of integration and the problems that concern the correct application of business rules. There are, however, certain types of problems that originate in both. In this article, which is closing …

Data Integration Best Practices - Data transformation

So far, we have addressed only the problems that concern the pure technical mechanics of integration. Now it’s time to review the challenges that are related to the correct application of business rules. These are, as we stated in the first article of our blog series, typically of higher level in nature and answer the question of “What?”. And the …

Data duplication and ID linking

Let us first make it clear what ID linking is about and what it has to do with data duplication. To do that, let’s take CRM systems as an example. It is likely there are more than one person in a system who share the same first and last names. And it is inevitable that sometimes, some pieces of information …

Three mechanisms to detect data changes

In the previous article of our series Data Integration Best Practices, we defined that all problems related to data integration can be essentially broken down into two large categories: The ones that have something to do with technical mechanics and the ones that are connected to business rules. In the second article of this series, we will review one of …

Data integration best practices

The topic of data and application integration has such a wide coverage that there seemingly should be no questions left. And yet every now and then, we come across certain questions both from the IT people and the business users. So, we decided to answer the most frequently asked questions in our new blog series on data integration best practices. …

Docker and NodeJS as PID 1 on Kubernetes, Mesosphere and Co

At elastic.io, we are using the ideology “one process per Docker container“. Surely, we apply this ideology for running integration components as well. So, each of our integration components is actually one process inside of one Docker container, and each of these Docker containers is running on Mesosphere and Kubernetes. Recently, though we had been having some unexplainable issues with …

New integration components

Our usual Feature Alerts are almost exclusively about new or improved features and functionalities of the elastic.io platform. Yet integration components are what makes any integration platform as a service a true magic wand in the hands of integrators. That is why we decided to dedicate one complete Feature Alert to new and updated integration components only. Below you will …

New Integration Flow Designer

Last time I wrote that we were working on a huge update of how elastic.io looks and feels. I even used the words “big changes to the elastic.io interface”. And it’s happened. This month’s feature alert is exclusively about only one new feature, but oh boy, what a feature that is. Without further ado, please welcome: New Integration Flow Designer …

real-time integration

It’s been quite a while since we issued our latest Feature Alert, being busy with several customer projects. But this doesn’t mean that we haven’t introduced new features, and in this Feature Alert, I’m going to run a review of selected new features and improvements we have worked on from September until the end of the year 2016. New Feature: …