Connector stories: Apache Kakfa
Apache Kafka is an extremely popular open-source event streaming platform. We talk to Estuary developer Alex about his process and the insights he gained building the Kafka connector.
Introducing Estuary’s open-source connector repository
We believe that an ecosystem of open-source connectors will be critical to the future of data integration. That’s why Estuary is excited to announce our open-source connector repository.
The costs of data integration explained, and how to minimize them
There is a cost associated with putting your data to work, and the benefits you gain depend on the systems you put into place. To maximize net value, you need to strike a balance between minimizing costs and maximizing gain.
Re-evaluating Kafka: issues and alternatives for real-time
Kafka’s challenges have exhausted many an engineer on the path to successful data streaming. What if there was an easier way?
5 example use-cases for real-time data processing
The applications for real-time data processing are diverse and far-reaching. This article highlights just a few.
Real-time and batch data processing: an introduction
Real-time and batch are two broad categories of data processing. Though they handle data differently, both are vital to the systems that make our businesses and society run.
Why MapReduce is making a comeback
What if we could adapt MapReduce to real-time data processing? Spoiler: it’s awesome and we’re building a next-gen data platform based on it!
ETL vs ELT: Breaking down the split paradigm
At first glance, ETL and ELT seem rigidly defined and mutually exclusive. But to understand our data integration options, we need to look closer.
Data pipeline basics for modern organizations
The term “data pipeline” evokes a mental image that speaks for itself. But their significance for your data goes far beyond that.