Data engineering salon. News and interesting reads about the world of data.
... who has the tools and motivation to make things better for everyone else.
I think the only place that the schema registry makes sense is when controlling 3rd party connections or in simple Kafka architectures.
Fundamental concepts that underlie them, and how they apply to popular queueing systems available today.
Dolt is Git for Data. It's a SQL database that you can clone, fork, branch, and merge.
History will repeat itself, of course.
The evolution, failures and design decisions behind one of the world’s largest real-time, high-frequency and low-latency streaming systems.
This is the story of how close we came to shutting down before even launching our first product, how we survived, and the lessons we learnt.