• Real-time change replication with Kafka and Debezium

    If you are looking for an end-to-end CDC solution without using third-party services such as Connect and Debezium I recommend Etlwork’s built-in CDC connectors. Read more. Use this tutorial if you are ingesting data into Kafka using standalone Debezium and wish to sink CDC events into any destination using the… Read ⇢

  • Etlworks CEO: Efficient data structures and real-time data streaming

    Search Business Analytics recently interviewed Etlworks CEO, Maksym Sherbinin about the importance of creating efficient data structures and real-time data streaming. Here are his insights: Q: To what extent does defaulting to JSON as a data storage mechanism contribute to decreased analytics performance and larger file sizes? A: There are… Read ⇢

  • Connecting to Marketo API

    Marketo exposes a REST API which allows for remote execution of many of the system’s capabilities.  From creating programs to bulk lead import, there are a large number of options which allow fine-grained control of a Marketo instance. Read about Marketo REST API. Prerequisites Assuming that you already have Marketo account,… Read ⇢

  • Connecting to Microsoft Graph API

    Microsoft Graph provides a unified programmability model that you can use to take advantage of the tremendous amount of data in Microsoft 365, Azure Active Directory, and other Microsoft services. Read about Microsoft Graph and Microsoft Graph API. This blog post provides step-by-step instruction for creating a connection to the Microsoft… Read ⇢

  • Connecting to Salesforce API

    Updated (5/7/2019). Etlworks now includes a native connector for Salesforce but this article is still relevant if you need to access various Salesforce APIs (for example a streaming REST API) not supported by the native connector. In Etlworks, it is possible to connect to practically any HTTP-based API -the  Salesforce API… Read ⇢

  • Working with paginated API

    Read ⇢

  • Loading data in Snowflake

    In this blog post, I will be talking about building a reliable data injection pipeline for Snowflake. Snowflake is a data warehouse built for the cloud. It works across multiple clouds and combines the power of data warehousing, the flexibility of big data platforms, and the elasticity of the cloud.… Read ⇢

  • Etlworks installation options and pricing model

    In this blog post, I will explain the various Etlworks installation options and how our pricing model works. Our pricing model is a three-tiered, feature-based SaaS subscription. There are three clearly defined tiers: Startup, Business and Enterprise. All tiers allow for an unlimited number of users and provide you access to all… Read ⇢

  • Cloud Data Integration

    In this blog post, I will discuss the definition of cloud data integration and what makes it truly useful.   Before we start, let’s get on the same page and define what cloud data integration is. According to Wikipedia, cloud data integration software must have the following features: Deployed on a multi-tenant,… Read ⇢