ETL & Systems Integration

    Ever find yourself asking if only our tools could talk to one another? If so, you have come to the right place! If you want a process automated between multiple systems, or data synced from one system to another, we can do so via systems integration. This is great for integrating well established tools such as Salesforce, NetSuite, Marketo to even Slack and Workfront. If using a tool such as SnapLogic, SSIS or Alteryx are not in your budget, or integrating the way you want, having a custom scripted solution is always an option as well. In those cases I prefer using either python or node + express to connect to the APIs and build the integration. In either case, it is also good to consider relaying that same data into a data warehouse/lake for analytical purposes. I am familiar with most backend databases to store this data in, but you can refer to the warehousing services for more information.

Recommended Tools:

Snaplogic

    This is a great flexible tool I have found to be very helpful in connecting to APIs and moving data from one system to another, or even to collocate all into a single database. I have implemented this tool in the past, and have found it to be very successful in serving the ETL needs of several organizations.

python.jpg

Python

A great high-level functional language that could readily be used to automate any integration you have in mind. Some examples in which I have used it to pull data from an API include Seismic, Marketo, Data.com, Mandrill, Slack, Salesforce, and even SportRadar. For notification purposes, it is also helpful to have the integration call into customized alerting tools such as OpsGenie whenever say one of your tools API goes down.

express_and_nodejs.png

NOde.js + Express

Some times used an asynchronous javascript environment is better suited for certain use cases. I have found it particularly useful when setting up my own API endpoints and integrating with other webhooks. For fun I even built an app that integrates my Google calendar with Slack and Workfront's PTO calendar, to avoid unnecessarily updating multiple tools simply to go on vacation. I have also used it for receiving webhook data out of Marketo and Mandrill, as well as Amazon's Lambda for integrating with our MEAN stack app regarding SnapLogic performance.