@rmoff rmoff
rmoff posts on Reddit about london, apachekafka, blog, ai the most. They currently have [-----] followers and [---] posts still getting attention that total [--] engagements in the last [--] hours.
Engagements: [--] #
Mentions: [--] #
Followers: [-----] #
CreatorRank: undefined #
Social Influence
Social category influence travel destinations technology brands social networks stocks cryptocurrencies
Social topic influence london, apachekafka #17, blog, ai, pinterest, collection of, events, build, kafka, fork
Top accounts mentioned or mentioned by @platformatickafka @rnpridgeonhttpsgithubcomrnpridgeon @manicbenhttpsgithubcommanicben @beneschhttpsgithubcombenesch @confluentiomailtorobin @confluentio
Top assets mentioned Uber Technologies, Inc. (UBER)
Top Social Posts
Top posts by engagements in the last [--] hours
"A Great Day Out With. Apache Kafka apachekafka apachekafka"
Reddit Link 2025-10-09T19:54Z [--] followers, [--] engagements
"Using Kafka Flink and AI to build the demo for the Current NOLA Day [--] keynote apachekafka apachekafka"
Reddit Link 2026-02-17T03:50Z [--] followers, [--] engagements
"A Fork in the Road: Deciding Kafkas Diskless Future Jack Vanlightly apachekafka apachekafka"
Reddit Link 2025-10-23T17:08Z [--] followers, [--] engagements
"List of Kafka TUIs apachekafka apachekafka"
Reddit Link 2026-01-20T14:24Z [--] followers, [---] engagements
"Stefan Kecskes - Kafka Dead Letter Queue (DLQ) Triage: Debugging [-----] Failed Messages apachekafka apachekafka"
Reddit Link 2026-01-19T16:18Z [--] followers, [--] engagements
"Mod notice Sockpuppets are not welcome on this sub apachekafka apachekafka"
Reddit Link 2026-02-04T17:38Z [--] followers, [---] engagements
"Next Generation DB Ingestion at Pinterest dataengineering dataengineering"
Reddit Link 2026-02-10T14:34Z [--] followers, [---] engagements
"How We Made @platformatic/kafka 223% Faster (And What We Learned Along the Way) apachekafka apachekafka"
Reddit Link 2025-12-22T03:48Z [--] followers, [--] engagements
"uForwarder: The Consumer Proxy for Kafka Async Queuing from Uber apachekafka apachekafka"
Reddit Link 2026-02-10T15:44Z [--] followers, [--] engagements
"Optimizing Flinks join operations on Amazon EMR with Alluxio apacheflink apacheflink"
Reddit Link 2026-02-10T16:06Z [--] followers, [--] engagements
"It's nine years since 'The Rise of the Data Engineer'what's changed dataengineering dataengineering"
Reddit Link 2026-02-11T10:42Z [--] followers, [---] engagements
"Apache Kafka [---] has been released Download: https://kafka.apache.org/downloads(https://kafka.apache.org/downloads) Release notes: https://downloads.apache.org/kafka/3.0.0/RELEASE_NOTES.html(https://downloads.apache.org/kafka/3.0.0/RELEASE_NOTES.html) Blog: https://www.confluent.co.uk/blog/apache-kafka-3-0-major-improvements-and-new-features/(https://www.confluent.co.uk/blog/apache-kafka-3-0-major-improvements-and-new-features/) Video: https://www.youtube.com/watchv=7SDwWFYnhGA(https://www.youtube.com/watchv=7SDwWFYnhGA) ---- Notable changes: * The deprecation of support for Java [--] and Scala"
Reddit Link 2021-09-22T08:49Z [----] followers, [--] engagements
"How do you implement data quality in your pipelines"
Reddit Link 2023-02-23T12:59Z [----] followers, [--] engagements
"Rob Burrow Leeds Marathon ### Race Information * Name: Rob Burrow Leeds Marathon * Date: [--] May [----] * Distance: [----] miles * Location: Leeds UK * Website: https://www.runforall.com/events/marathon/leeds-marathon/ * Strava: https://www.strava.com/activities/9070244293/overview * Time: 4:59:12 ### Goals Goal Description Completed ------------------------------- A Sub 4:30 No B Sub 4:45:07 (PB) No C Don't walk No D Sub [--] Yes ### Training I used the Garmin HR-based training plan with a nod to the Strava one too from which I'd mix up some of the Garmin speed"
Reddit Link 2023-05-14T18:03Z [----] followers, [---] engagements
"📣 Apache Iceberg has won the table format war"
Reddit Link 2023-07-06T09:03Z [----] followers, [--] engagements
"Where do you start when learning Apache Flink Here are some ideas 👇 ✨Where do you start when learning Apache Flink ✨ 💡A few weeks ago I started on my journey to learn Flink from scratch. My first step was trying to get a handle on quite where to start with it all which I summarised into this starter-for-ten: * What is Flink (high level) * Uses & Users * How do you run Flink * Who can use Flink * Java nerds only or normal non-Java folk too 😜 * Resources * Flink Architecture Concepts and Components * Learn some Flink * Where does Flink sit in relation to other software in this"
Reddit Link 2023-10-19T16:29Z [----] followers, [---] engagements
"Installing PyFlink - hacking my way around install errors ## Step 1: Install PyFlink The docs(https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/dev/python/datastream_tutorial/#how-to-follow-along) are a useful start here and tell us that we need to install Flink as a Python library first: $ pip install apache-flink ## No matching distribution found for numpy==1.21.4 This failed with the following output (truncated for readability) $ pip install apache-flink Collecting apache-flink Using cached apache-flink-1.18.0.tar.gz (1.2 MB) Preparing metadata (setup.py) . done Installing"
Reddit Link 2023-10-25T16:36Z [----] followers, [--] engagements
"Using Apache Kafka with ngrok"
Reddit Link 2023-11-01T19:17Z [----] followers, [--] engagements
"A useful list of companies who use Apache Flink u/dttung2905 put together this excellent list of companies using Apache Flink. It's a really useful reference to get an idea of who is using it what use cases it solves and at what kind of scale. 👉 Go check it out: https://github.com/dttung2905/flink-at-scale(https://github.com/dttung2905/flink-at-scale) apacheflink apacheflink"
Reddit Link 2023-11-07T09:39Z [----] followers, [---] engagements
"Checkpoint Chronicle - a monthly collection of interesting stuff in the data and stream processing space"
Reddit Link 2023-11-14T18:00Z [--] followers, [--] engagements
"Checkpoint Chronicle - a monthly collection of interesting stuff in the data and stream processing space"
Reddit Link 2023-11-15T19:59Z [----] followers, [----] engagements
"mod Rule update: Any blogs now need to be shared with a synopsis"
Reddit Link 2023-11-29T16:23Z [--] followers, [----] engagements
"poll When you set up a new Apache Kafka cluster nowadays do you use KRaft mode or ZooKeeper"
Reddit Link 2023-11-29T19:53Z [----] followers, [---] engagements
"TypeStream - OS tool to build pipelines with Kafka using unix-like pipe concepts"
Reddit Link 2023-12-04T11:37Z [----] followers, [---] engagements
"DoorDash's API-First Approach to Kafka Topic Creation"
Reddit Link 2023-12-07T11:33Z [----] followers, [----] engagements
"How Netflix does Data Engineering A collection of videos shared by Netflix from their Data Engineering Summit(https://netflixtechblog.com/our-first-netflix-data-engineering-summit-f326b0589102) * The Netflix Data Engineering Stack(https://youtu.be/QxaOlmv79ls) * Data Processing Patterns(https://www.youtube.com/watchv=vuyjK2TFZNk&list=PLSECvWLlUYeF06QK5FOOELvgKdap3cQf0&index=3) * Streaming SQL on Data Mesh using Apache Flink(https://www.youtube.com/watchv=TwcWvwU7B64&list=PLSECvWLlUYeF06QK5FOOELvgKdap3cQf0&index=4) * Building Reliable Data"
Reddit Link 2023-12-15T10:32Z [----] followers, [----] engagements
"Kafka: Automating Root CA rotation with Vault Useful description of how Zendesk automate Root CA rotation for Apache Kafka plus a nice primer on mTLS for Kafka too https://zendesk.engineering/kafka-automating-root-ca-rotation-with-vault-9bbbe07c7c6e(https://zendesk.engineering/kafka-automating-root-ca-rotation-with-vault-9bbbe07c7c6e) apachekafka apachekafka"
Reddit Link 2023-12-19T12:50Z [----] followers, [--] engagements
"One Billion Row Challengeusing SQL and DuckDB 1🐝🏎🦆 u/gunnarmorling launched a fun challenge(https://www.morling.dev/blog/one-billion-row-challenge/) this week: how fast can you aggregate and summarise a billion rows of data I'm not a Java coder (which is what the challenge is set in) but thought it'd be fun to do it in SQL with DuckDB nonetheless. Loading the CSV in is simple enough: CREATE OR REPLACE TABLE measurements AS SELECT * FROM READ_CSV('measurements.txt' header=false columns= 'station_name':'VARCHAR''measurement':'double' delim=';') LIMIT 2048; as are the calculations: SELECT"
Reddit Link 2024-01-03T15:01Z [----] followers, [--] engagements
"One Billion Row Challengeusing SQL and DuckDB 1🐝🏎🦆 DuckDB DuckDB"
Reddit Link 2024-01-03T15:01Z [----] followers, [--] engagements
"Ad-attribution toolstack and architecture evolution Kappa - Lambda Interesting writeup from Grab on the evolution of their architecture and what drove it also covers the tool stack https://engineering.grab.com/attribution-platform(https://engineering.grab.com/attribution-platform) dataengineering dataengineering"
Reddit Link 2024-02-20T10:03Z [----] followers, [--] engagements
"Flink&Spark - which OTF most commonly used with each Are folk seeing a general trend in the particular pairings of open-source compute platforms and open table formats (OTF) Specifically: [--]. My assumption is that #ApacheSpark Databricks is most often used with #DeltaLake Databricks and less so than with Hudi and Iceberg. Is that true [--]. Does #ApacheFlink get used with #ApacheIceberg / #ApacheHudi / #DeltaLake equally when an OTF is involved or weighted towards one or the other I know that folk at the various respective vendors in this space are going to have a bunch of data points to share"
Reddit Link 2024-03-13T18:29Z [----] followers, [--] engagements
"Flink SQLMisconfiguration Misunderstanding and Mishaps 📣 New blog post # Flink SQLMisconfiguration Misunderstanding and Mishaps(https://www.decodable.co/blog/flink-sql-misconfiguration-misunderstanding-and-mishaps) Pull up a comfy chair grab a mug of tea and settle in to read about my adventures troubleshooting some gnarly ApacheFlink problems ranging from the simple to the ridiculous Topics covered 🤔 What's Running Where (Fun with Java Versions) 🤨 What's Running Where (Fun with JAR dependencies) 😵 What's Running Where (Not So Much Fun with Hive MetaStore) 😌 The JDBC Catalog 😑 A"
Reddit Link 2024-04-17T14:21Z [----] followers, [--] engagements
"How Agoda Solved Load Balancing Challenges in Apache Kafka apachekafka apachekafka"
Reddit Link 2024-05-21T16:56Z [----] followers, [--] engagements
"RedPanda acquires Benthos stream processing tool WarpStream fork it to create Bento Benthos is a stream processing framework which RedPanda last week acquired and rebranded to "RedPanda Connect": https://redpanda.com/blog/redpanda-connect In response WarpStream have forked Benthos to create Bento: https://www.warpstream.com/blog/announcing-bento-the-open-source-fork-of-the-project-formerly-known-as-benthos dataengineering dataengineering"
Reddit Link 2024-06-03T10:33Z [----] followers, [--] engagements
"RFC: Should this sub be just about Apache Kafka the specific implementation or should it also include protocol-compatible implementations tl;dr: We are going to refine the charter of this sub. Should it be solely be about Apache Kafka and its binaries (kafka.apache.org) or more broadly the Apache Kafka protocol and all implementations thereof --- Apache Kafka used to mean just that. Then a bunch of other technologies came along that supported the Kafka protocol but with their own implementation. These include Redpanda WarpStream Kora (from Confluent) and others. Regardless of the"
Reddit Link 2024-06-03T11:22Z [----] followers, [--] engagements
"The SQL IDE for Your Terminal dataengineering dataengineering"
Reddit Link 2024-06-17T10:11Z [--] followers, [--] engagements
"My Biggest Issue With Apache Flink: State Is a Black Box apacheflink apacheflink"
Reddit Link 2024-06-25T13:18Z [----] followers, [--] engagements
"How Notion build and grew our data lake to keep up with rapid growth dataengineering dataengineering"
Reddit Link 2024-07-02T14:29Z [----] followers, [--] engagements
"How Canva collects [--] billion events per day dataengineering dataengineering"
Reddit Link 2024-07-11T09:23Z [----] followers, [--] engagements
"In-Memory Analytics for Kafka using DuckDB dataengineering dataengineering"
Reddit Link 2024-07-11T15:52Z [----] followers, [--] engagements
"Sending Data to Apache Iceberg from Apache Kafka with Apache Flink apacheflink apacheflink"
Reddit Link 2024-07-18T11:39Z [----] followers, [--] engagements
"Sending Data to Apache Iceberg from Apache Kafka with Apache Flink bigdata bigdata"
Reddit Link 2024-07-24T11:52Z [----] followers, [--] engagements
"Sending Data to Apache Iceberg from Apache Kafka with Apache Flink ApacheIceberg ApacheIceberg"
Reddit Link 2024-07-24T11:53Z [----] followers, [--] engagements
"Announcing the Release of Apache Flink [----] apacheflink apacheflink"
Reddit Link 2024-08-02T11:20Z [----] followers, [--] engagements
"Announcing the Release of Apache Flink [----] bigdata bigdata"
Reddit Link 2024-08-02T11:20Z [----] followers, [--] engagements
"HOWTO: Write to Delta Lake from Flink SQL I wrote a blog about getting Flink SQL writing to Delta Lake. It gives you the tl;dr of how and then the full troubleshooting story too for those interested in that kind of thing Read it here: https://dcbl.link/flink-sql-delta-lake-7 apacheflink apacheflink"
Reddit Link 2024-09-04T09:45Z [----] followers, [--] engagements
"HOWTO: Write to Delta Lake from Flink SQL I wrote a blog about getting Flink SQL writing to Delta Lake. It gives you the tl;dr of how and then the full troubleshooting story too for those interested in that kind of thing 🤓 Read it here: https://dcbl.link/flink-sql-delta-lake-7 dataengineering dataengineering"
Reddit Link 2024-09-04T09:47Z [----] followers, [--] engagements
"The Joy of JARs (and Other Flink SQL Troubleshooting Tales) Slides from my Current [--] talk "The Joy of JARs (and Other Flink SQL Troubleshooting Tales)" are now online: https://talks.rmoff.net/9GpIYA/the-joy-of-jars-and-other-flink-sql-troubleshooting-tales apacheflink apacheflink"
Reddit Link 2024-09-18T22:11Z [----] followers, [--] engagements
"Pinterest Tiered Storage for Apache Kafka: A Broker-Decoupled Approach apachekafka apachekafka"
Reddit Link 2024-09-20T21:40Z [----] followers, [--] engagements
"Data Ecosystem highlights from Thoughtworks Tech Radar October [----] The latest Thoughtworks Technology Radar is out: https://www.thoughtworks.com/radar. It's very LLM/GenAI heavy as you'd probably expect but here are a few things that caught my eye from the data ecosystem side of things 👇 The radar is not designed to be comprehensive so don't look it as a Gartner or Forrester thing but more just a snapshot of technologies of particular note that are getting used in the field. You can learn more about it here: https://www.thoughtworks.com/radar/faq) * Adopt dbt continues as an "Adopt" with"
Reddit Link 2024-10-23T13:06Z [----] followers, [--] engagements
"What is Flink CDC dataengineering dataengineering"
Reddit Link 2024-12-11T18:01Z [--] followers, [--] engagements
"📣 If you are employed by a vendor you must add a flair to your profile As the r/apachekafka community grows and evolves beyond just Apache Kafka(https://old.reddit.com/r/apachekafka/comments/1d7213p/rfc_should_this_sub_be_just_about_apache_kafka/) it's evident that we need to make sure that all community members can participate fairly and openly. We've always welcomed useful on-topic content from folk employed by vendors in this space. Conversely we've always been strict against vendor spam and shilling. Sometimes the line dividing these isn't as crystal clear as one may suppose. To keep"
Reddit Link 2025-01-20T16:52Z [----] followers, [---] engagements
"Apache Flink CDC 3.3.0 Release Announcement apacheflink apacheflink"
Reddit Link 2025-01-21T18:57Z [----] followers, [--] engagements
"Blogged: DuckDB tricks - renaming fields in a SELECT * across tables DuckDB DuckDB"
Reddit Link 2025-02-27T10:38Z [----] followers, [--] engagements
"Blogged: Exploring UK Environment Agency data in DuckDB and Rill DuckDB DuckDB"
Reddit Link 2025-02-28T11:33Z [----] followers, [--] engagements
"Exploring UK Environment Agency data in DuckDB and Rill dataengineering dataengineering"
Reddit Link 2025-03-03T09:56Z [----] followers, [--] engagements
"Data Modelling - The Tension of Orthodoxy and Speed dataengineering dataengineering"
Reddit Link 2025-03-03T17:05Z [----] followers, [---] engagements
"Roches Maxim of Data Transformation dataengineering dataengineering"
Reddit Link 2025-03-04T14:27Z [----] followers, [--] engagements
"Blogged: Data Wrangling with Flink SQL apacheflink apacheflink"
Reddit Link 2025-03-11T09:41Z [----] followers, [--] engagements
"Kicking the tyres on the new DuckDB UI DuckDB DuckDB"
Reddit Link 2025-03-14T14:32Z [----] followers, [--] engagements
"Taking a look at the new DuckDB UI The recent release of DuckDB's UI caught my attention so I took a quick (quack) look at it to see how much of my data exploration work I can now do solely within DuckDB. The answer: most of it 👉 https://rmoff.net/2025/03/14/kicking-the-tyres-on-the-new-duckdb-ui/ (for more background see https://rmoff.net/2025/02/28/exploring-uk-environment-agency-data-in-duckdb-and-rill/) dataengineering dataengineering"
Reddit Link 2025-03-14T15:17Z [----] followers, [---] engagements
"Apache Kafka [---] released 🎉 * Download: https://kafka.apache.org/downloads * Release notes: https://dlcdn.apache.org/kafka/4.0.0/RELEASE_NOTES.html Quoting from the release blog(https://kafka.apache.org/blog#apache_kafka_400_release_announcement): Apache Kafka [---] is a significant milestone marking the first major release to operate entirely without Apache ZooKeeper. By running in KRaft mode by default Kafka simplifies deployment and management eliminating the complexity of maintaining a separate ZooKeeper ensemble. This change significantly reduces operational overhead enhances scalability"
Reddit Link 2025-03-18T15:21Z [----] followers, [---] engagements
"Apache Kafka [---] released 🎉 bigdata bigdata"
Reddit Link 2025-03-18T16:09Z [----] followers, [--] engagements
"Exporting Notebook SQL from DuckDB UI DuckDB DuckDB"
Reddit Link 2025-03-19T17:40Z [----] followers, [--] engagements
"Roast my pipeline (ETL with DuckDB) It's been a while since I did some ETL. I had a going at building a data pipeline with DuckDB. How badly did I do https://rmoff.net/2025/03/20/building-a-data-pipeline-with-duckdb/ dataengineering dataengineering"
Reddit Link 2025-03-21T15:59Z [----] followers, [---] engagements
"Apache Flink [---] released 💾 Download: https://flink.apache.org/downloads/ 📖 Blog: https://flink.apache.org/2025/03/24/apache-flink-2.0.0-a-new-era-of-real-time-data-processing/ apacheflink apacheflink"
Reddit Link 2025-03-24T09:27Z [----] followers, [--] engagements
"Apache Flink [---] released bigdata bigdata"
Reddit Link 2025-03-24T09:30Z [----] followers, [--] engagements
"Yet another vendor with their benchmark blog dataengineering dataengineering"
Reddit Link 2025-03-27T15:03Z [----] followers, [----] engagements
"Latest Thoughtworks TechRadar - data blips Thoughtworks have published their latest Technology Radar: https://www.thoughtworks.com/radar FWIW here are a few of the 'blips' (as they call them) of note in the data space: 🟢 Adopt: Data product thinking(https://www.thoughtworks.com/radar/techniques/data-product-thinking) 🟢 Adopt: Trino(https://www.thoughtworks.com/radar/platforms/trino) 👍 Trial: Databricks Delta Live Tables(https://www.thoughtworks.com/radar/tools/databricks-delta-live-tables) 👍 Trial: Metabase(https://www.thoughtworks.com/radar/tools/metabase) ✋ Hold: Reverse"
Reddit Link 2025-04-02T10:17Z [----] followers, [--] engagements
"Docker Compose for running Trino with Superset and Metabase https://github.com/rmoff/trino-metabase-simple-superset(https://github.com/rmoff/trino-metabase-simple-superset) This is a minimal setup to run Trino as a query engine with the option for query building and visualisation with eitherSuperset(https://superset.apache.org/)orMetabase(https://www.metabase.com/). It includes installation of Trino support for Supersert and Metabase neither of which ship with support for it by default. It also includespspg(https://github.com/okbob/pspg)for the Trino CLI. dataengineering dataengineering"
Reddit Link 2025-04-10T11:38Z [----] followers, [--] engagements
"Overclocking dbt: Discord's Custom Solution in Processing Petabytes of Data dataengineering dataengineering"
Reddit Link 2025-04-14T08:43Z [----] followers, [---] engagements
"video What is Iceberg and why is everyone talking about it dataengineering dataengineering"
Reddit Link 2025-04-14T14:59Z [----] followers, [---] engagements
"Greenfield: Do you go DWH or DL/DLH If you're building a data platform from scratch today do you start with a DWH on RDBMS Or Data LakeHouse on object storage with something like Iceberg I'm assuming the near dominance of Oracle/DB2/SQL Server of [--] years ago has shifted And Postgres has entered the mix as a serious option But are people building data lakes/lakehouses from the outset or only once they breach the size of what a DWH can reliably/cost-effectively do dataengineering dataengineering"
Reddit Link 2025-04-15T17:07Z [----] followers, [---] engagements
"What If We Could Rebuild Kafka From Scratch A good read from u/gunnarmorling: if we were to start all over and develop a durable cloud-native event log from scratchKafka.next if you willwhich traits and characteristics would be desirable for this to have apachekafka apachekafka"
Reddit Link 2025-04-24T14:52Z [----] followers, [--] engagements
"What If We Could Rebuild Kafka From Scratch programming programming"
Reddit Link 2025-04-24T14:53Z [----] followers, [--] engagements
"Its Time We Talked About Time: Exploring Watermarks (And More) In Flink SQL apacheflink apacheflink"
Reddit Link 2025-04-29T16:39Z [----] followers, [--] engagements
"Who is coming to Current [----] in London this month There's gonna be a ton of great talks about Kafka Flink & other good stuff. The agenda is online here: https://current.confluent.io/london/agenda Plus we're doing our now-traditional 5k run/walk on the Tuesday morning: https://rmoff.net/2025/05/02/the-unofficial-current-london-2025-run/walk/ 🎟 If you've not yet registered you can get 40% off using code L-PRM-DEVREL. apachekafka apachekafka"
Reddit Link 2025-05-02T15:58Z [--] followers, [--] engagements
"Apache Flink CDC 3.4.0 released includes Apache Iceberg sink pipeline connector apacheflink apacheflink"
Reddit Link 2025-05-16T13:37Z [----] followers, [--] engagements
"Apache Flink CDC 3.4.0 released includes Apache Iceberg sink pipeline connector ApacheIceberg ApacheIceberg"
Reddit Link 2025-05-19T12:03Z [----] followers, [--] engagements
"Exploring Joins and Changelogs in Flink SQL apacheflink apacheflink"
Reddit Link 2025-05-20T18:09Z [----] followers, [--] engagements
"Digging into Ducklake DuckDB DuckDB"
Reddit Link 2025-06-02T19:53Z [----] followers, [--] engagements
"Digging into Ducklake dataengineering dataengineering"
Reddit Link 2025-06-02T19:54Z [----] followers, [---] engagements
"Current [----] New Orleans CfP is open until 15th June apacheflink apacheflink"
Reddit Link 2025-06-05T08:48Z [----] followers, [--] engagements
"Current [----] New Orleans CfP is open ApacheIceberg ApacheIceberg"
Reddit Link 2025-06-05T08:48Z [----] followers, [--] engagements
"When plans change at [---] feet: Complex event processing of ADS-B aviation data with Apache Flink dataengineering dataengineering"
Reddit Link 2025-06-19T14:50Z [----] followers, [--] engagements
"Does anyone still think "Schema on Read" is a good idea Does anyone still think "Schema on Read" is still a good idea It's always felt slightly gross like chucking your rubbish over the wall to let someone else deal with. dataengineering dataengineering"
Reddit Link 2025-06-20T15:08Z [----] followers, [---] engagements
"Introducing Northguard and Xinfra: scalable log storage at LinkedIn apachekafka apachekafka"
Reddit Link 2025-06-26T09:09Z [----] followers, [--] engagements
"Interesting links - June [----] dataengineering dataengineering"
Reddit Link 2025-06-27T16:00Z [----] followers, [--] engagements
"Writing to Apache Iceberg on S3 using Kafka Connect with Glue catalog ApacheIceberg ApacheIceberg"
Reddit Link 2025-07-07T08:32Z [--] followers, [--] engagements
"Using Kafka Connect to write to Apache Iceberg apachekafka apachekafka"
Reddit Link 2025-07-07T08:33Z [--] followers, [--] engagements
"Mastering Postgres Replication Slots: Preventing WAL Bloat and Other Production Issues PostgreSQL PostgreSQL"
Reddit Link 2025-07-08T14:54Z [--] followers, [--] engagements
"Keeping your Data Lakehouse in Order: Table Maintenance in Apache Iceberg dataengineering dataengineering"
Reddit Link 2025-07-15T16:58Z [--] followers, [--] engagements
"Building Streaming ETL Pipelines With Flink SQL apacheflink apacheflink"
Reddit Link 2025-07-18T08:33Z [----] followers, [--] engagements
"Kafka to Iceberg - Exploring the Options apachekafka apachekafka"
Reddit Link 2025-08-20T08:52Z [--] followers, [--] engagements
"Kafka to Iceberg - Exploring the Options ApacheIceberg ApacheIceberg"
Reddit Link 2025-08-20T08:52Z [----] followers, [--] engagements
"Kafka to Iceberg - Exploring the Options dataengineering dataengineering"
Reddit Link 2025-08-20T08:53Z [--] followers, [--] engagements
"Interesting Links in Data Engineering - August [----] I trawl the RSS feeds so you don't have to ;) I've collected together links out to stuff that I've found interesting over the last month in Data Engineering as a whole including areas like Iceberg RDBMS Kafka Flink plus some stuff that I just found generally interesting :) 👉 https://rmoff.net/2025/08/21/interesting-links-august-2025/ dataengineering dataengineering"
Reddit Link 2025-08-22T09:07Z [--] followers, [--] engagements
"Interesting Links in Data Engineering - August [----] removed programming programming"
Reddit Link 2025-08-22T09:41Z [--] followers, [--] engagements
"Stumbling into AI: Part 1MCP mcp mcp"
Reddit Link 2025-09-04T17:06Z [--] followers, [--] engagements
"PagerDuty - August [--] Kafka Outages What Happened apachekafka apachekafka"
Reddit Link 2025-09-05T16:35Z [--] followers, [--] engagements
"Wrote up my first steps in trying to learn about LLMs https://rmoff.net/2025/09/08/stumbling-into-ai-part-2models/(https://rmoff.net/2025/09/08/stumbling-into-ai-part-2models/) Feedback corrections and clarifications very welcome be gentle :) (https://rmoff.net/2025/09/08/stumbling-into-ai-part-2models/) LLM LLM"
Reddit Link 2025-09-09T15:28Z [--] followers, [--] engagements
"Interesting Links in Data Engineering - September [----] In the very nick of time here are a bunch of things that I've found in September that are interesting to read. It's all there: Kafka Flink Iceberg (so. much. iceberg.) Medallion Architecture discussions DuckDB [---] with Iceberg write support the challenge of Fast Changing Dimensions in Iceberg The Last Days of Social Media and lots more. 👉 Enjoy 😁 https://rmoff.net/2025/09/29/interesting-links-september-2025/ dataengineering dataengineering"
Reddit Link 2025-09-30T09:56Z [--] followers, [---] engagements
"Roast my Post: What is an AI Agent I'm still trying to figure out what an AI Agent is. To try and learn I've written an article in which I note down some of the common features that people ascribe to them. 🔗 https://rmoff.net/2025/10/06/stumbling-into-ai-part-5agents/(https://rmoff.net/2025/10/06/stumbling-into-ai-part-5agents/) What did I miss or get wrong aiagents aiagents"
Reddit Link 2025-10-07T09:08Z [--] followers, [--] engagements
"Session recordings & slides from Kafka Summit London [----] are available online apachekafka apachekafka"
Reddit Link 2018-05-04T08:16Z [----] followers, [--] engagements
"My Keybase proof reddit:rmoff = keybase:rmoff (2d-4ol-5fsArkEawMCYyT_j7R5fjq-ikPtoDCj0q2xY) KeybaseProofs KeybaseProofs"
Reddit Link 2025-08-03T08:58Z [--] followers, [--] engagements
"Kafka Summit London CfP closes in two weeks Submit here: https://kafka-summit.org/kafka-summit-london-2020/speakers/(https://kafka-summit.org/kafka-summit-london-2020/speakers/) If youd like help or advice with your CfP were holding Office Hours at http://cnfl.io/slack(http://cnfl.io/slack) on two dates to cover more timezones 📆Dec [--] 14:00 PT https://everytimezone.com/s/d7066196(https://everytimezone.com/s/d7066196) 📆Dec [--] 17:00 GMT https://everytimezone.com/s/61bf1f19(https://everytimezone.com/s/61bf1f19) apachekafka apachekafka"
Reddit Link 2019-12-02T12:52Z [----] followers, [--] engagements
"Kafka Summit London CfP closes in two weeks java java"
Reddit Link 2019-12-02T12:52Z [----] followers, [--] engagements
"Kafka Summit London CfP closes in two weeks bigdata bigdata"
Reddit Link 2019-12-02T16:05Z [----] followers, [--] engagements
"librdkafka 1.4.0 released https://github.com/edenhill/librdkafka/releases/tag/v1.4.0(https://github.com/edenhill/librdkafka/releases/tag/v1.4.0) From the release notes: v1.4.0 is a feature release: * KIP-98(https://cwiki.apache.org/confluence/display/KAFKA/KIP-98+-+Exactly+Once+Delivery+and+Transactional+Messaging): Transactional Producer API * KIP-345(https://cwiki.apache.org/confluence/display/KAFKA/KIP-345%3A+Introduce+static+membership+protocol+to+reduce+consumer+rebalances): Static consumer group membership (by @rnpridgeon(https://github.com/rnpridgeon)) *"
Reddit Link 2020-04-02T21:02Z [----] followers, [--] engagements
"📼 Stream Processing with Apache Kafka - A mini video series 📼 https://i.redd.it/2gh4n0wsuei61.gif 🍿 Watch an episode a week or binge-watch them all in one eveninghowever you want to consume them enjoy this brand new set of videos for you all about stream processing with Apache Kafka and ksqlDB(https://ksqldb.ioutm_source=reddit&utm_medium=organicsocial&utm_campaign=tm.devx_ch.rmoff_2021-02-19&utm_term=rmoff-devx) Topics covered include: * Filtering streams of events * Splitting and merging streams * Building aggregates * Serialisation formats and how to convert a stream from CSV"
Reddit Link 2021-02-19T10:23Z [----] followers, [--] engagements
"Wrangling data with ksqlDB apachekafka apachekafka"
Reddit Link 2021-03-19T16:58Z [----] followers, [--] engagements
"Diving into the Deep End - Kafka Connect Just come across this excellent talk all about Kafka Connect - make sure to check it out for lots of good info and tips: 🎥 Recording: https://videos.confluent.io/watch/NujMdE2Zj3AxAFbGA5CKdu 📔 Slides: https://www.slideshare.net/ConfluentInc/diving-into-the-deep-end-kafka-connect apachekafka apachekafka"
Reddit Link 2021-04-19T13:08Z [----] followers, [--] engagements
"📣 Kafka Summit - Call for Papers closing soon Kafka Summit(https://www.kafka-summit.org/) is the fandabidoziest(https://www.collinsdictionary.com/dictionary/english/fandabidozi) conference dedicated to Apache Kafka and event streaming. The Call for Papers(https://sessionize.com/kafka-summit-london-2022/) (CfP) closes in less than two weeks - and we would love to hear from Kafka users architects operators and anyone with an interesting Kafka story to tell. To get an idea of the kind of talks that Kafka Summit audiences enjoy check out the programmes from previous"
Reddit Link 2021-12-07T15:52Z [----] followers, [--] engagements
"Kafka Summit London 2022- Call for Papers closes soon dataengineering dataengineering"
Reddit Link 2021-12-08T14:55Z [----] followers, [--] engagements
"Who is coming to Kafka Summit London Just that really :) I wondered who else from this sub will be there. Will be great to say hi to anyone who is. P.S. if you're coming and like running or walking you'd be very welcome to join in this(https://rmoff.net/2022/04/05/the-unofficial-kafka-summit-london-2022-run/walk/) :) apachekafka apachekafka"
Reddit Link 2022-04-06T13:33Z [----] followers, [--] engagements
"Recap of Kafka Summit London [----] apachekafka apachekafka"
Reddit Link 2022-04-28T15:23Z [----] followers, [--] engagements
"KIP-833: Mark KRaft as Production Ready This is very exciting KIP-833: Mark KRaft as Production Ready(https://cwiki.apache.org/confluence/display/KAFKA/KIP-833%3A+Mark+KRaft+as+Production+Ready) This KIP proposes to: [--]. Mark KRaft as production-ready for new clusters in the upcoming Kafka [---] release. This is also known as "GA" or "general access." [--]. Deprecate ZooKeeper mode in the upcoming Kafka [---] release [--]. Plan to remove ZooKeeper mode entirely in Kafka [---]. The timeline is given as roughly August [----] for KRaft mode declared production-ready (in Kafka 3.3) Read more in the KIP:"
Reddit Link 2022-05-24T08:29Z [----] followers, [--] engagements
"QCon NY Streaming from Apache Iceberg - Building Low-Latency and Cost Effective Data Pipelines - Steven Wu @ Apple dataengineering dataengineering"
Reddit Link 2025-07-19T16:57Z [--] followers, [--] engagements
"Who's going to Kafka Summit London apachekafka apachekafka"
Reddit Link 2025-03-02T14:35Z [--] followers, [--] engagements
"kaskade - a Text User Interface (TUI) for Apache Kafka apachekafka apachekafka"
Reddit Link 2025-03-10T04:47Z [--] followers, [--] engagements
"What is Flink CDC apacheflink apacheflink"
Reddit Link 2024-12-11T18:12Z [--] followers, [--] engagements
"Current [----] New Orleans CfP is open apachekafka apachekafka"
Reddit Link 2025-06-05T08:49Z [--] followers, [--] engagements
"Flink Watermarks. WTF dataengineering dataengineering"
Reddit Link 2025-11-05T09:40Z [--] followers, [---] engagements
"Understanding Watermarks in Apache Flink apacheflink apacheflink"
Reddit Link 2025-10-20T13:33Z [--] followers, [---] engagements
"Flink WatermarksWTF bigdata bigdata"
Reddit Link 2025-11-01T05:39Z [--] followers, [--] engagements
"A Dive into the Metadata of Apache Iceberg ApacheIceberg ApacheIceberg"
Reddit Link 2025-10-29T06:02Z [--] followers, [--] engagements
"Interesting Links in Data Engineering - October [----] dataengineering dataengineering"
Reddit Link 2025-10-31T16:04Z [--] followers, [---] engagements
"Some interesting talks from P99 Conf dataengineering dataengineering"
Reddit Link 2025-11-10T12:52Z [--] followers, [--] engagements
"Flink talks from P99 Conf apacheflink apacheflink"
Reddit Link 2025-11-11T10:19Z [--] followers, [--] engagements
"Joe Reis - How to Sell Data Modeling dataengineering dataengineering"
Reddit Link 2025-11-18T12:30Z [--] followers, [--] engagements
"Ive been thinking about Agents and MCP all wrong mcp mcp"
Reddit Link 2025-11-20T22:43Z [--] followers, [--] engagements
"Interesting Links in Data Engineering - November [----] dataengineering dataengineering"
Reddit Link 2025-11-29T07:38Z [--] followers, [--] engagements
"Bridging the gap between application development and data engineering - Reliable Data Flows and Scalable Platforms: Tackling Key Data Challenges dataengineering dataengineering"
Reddit Link 2025-11-30T00:14Z [--] followers, [--] engagements
"Riskified's Journey to a Single Source of Truth dataengineering dataengineering"
Reddit Link 2025-12-02T15:46Z [--] followers, [--] engagements
"Why Apache Flink Is Not Going Anywhere apacheflink apacheflink"
Reddit Link 2025-12-04T01:20Z [--] followers, [--] engagements
"Data Quality Design Patterns dataengineering dataengineering"
Reddit Link 2025-12-04T17:20Z [--] followers, [--] engagements
"Data Modeling: A Field Guide dataengineering dataengineering"
Reddit Link 2025-12-17T08:43Z [--] followers, [---] engagements
"Mike Stonebraker and Andy Pavlo: DB & AI [----] Year in Review dataengineering dataengineering"
Reddit Link 2025-12-16T16:48Z [--] followers, [--] engagements
"Interesting Links in Data Engineering - December [----] dataengineering dataengineering"
Reddit Link 2025-12-17T11:20Z [--] followers, [--] engagements
"The Hidden Cost Crisis in Data Engineering dataengineering dataengineering"
Reddit Link 2026-01-05T12:18Z [--] followers, [--] engagements
"Blog Alternatives to MinIO for single-node local S3 selfhosted selfhosted"
Reddit Link 2026-01-14T18:12Z [--] followers, [--] engagements
"Blog Alternatives to MinIO for single-node local S3 minio minio"
Reddit Link 2026-01-14T18:18Z [--] followers, [--] engagements
"Alternatives to MinIO for single-node local S3 programming programming"
Reddit Link 2026-01-15T10:51Z [--] followers, [---] engagements
"How Vinted standardizes large-scale decentralized data pipelines dataengineering dataengineering"
Reddit Link 2026-01-19T14:52Z [--] followers, [--] engagements
"Interesting Links in Data Engineering - January [----] dataengineering dataengineering"
Reddit Link 2026-01-21T14:10Z [--] followers, [---] engagements
"Cosplaying as a webdev with Claude Code in January [----] ClaudeCode ClaudeCode"
Reddit Link 2026-01-28T10:46Z [--] followers, [--] engagements
"🎅🎄TwelveDaysOfSMT 🎄🎅 - Exploring Single Message Transforms for Kafka Connect dataengineering dataengineering"
Reddit Link 2025-10-24T02:38Z [--] followers, [--] engagements
"🎂🎂🎉 Happy 10th Birthday Apache Kafka apachekafka apachekafka"
Reddit Link 2024-10-22T22:37Z [--] followers, [---] engagements
Limited data mode. Full metrics available with subscription: lunarcrush.com/pricing