Skip to content

KE Insights

Data Engineering

Real-time data and event-driven infrastructure: streaming architecture, Apache Kafka and Confluent, schema evolution, and the foundations on which AI depends.

Data Engineering insights

Bite Size Streams: Stream-to-Versioned-Table JoinDATA ENGINEERING cover for Bite Size Streams: Stream-to-Versioned-Table JoinP0P1P2P3DATA ENGINEERINGBite Size Streams:Stream-to-Versioned-TableJoin// VERSIONED · STATEFUL · JOIN
KE Engineering TeamMar 3, 2026
Bite Size Streams: Stream-to-Table JoinDATA ENGINEERING cover for Bite Size Streams: Stream-to-Table JoinJOINstreamtableDATA ENGINEERINGBite Size Streams:Stream-to-Table Join// STATEFUL JOIN · KAFKA STREAMS
KE Engineering TeamFeb 4, 2026
koffset: consumer lag without the consumerDATA ENGINEERING cover for koffset: consumer lag without the consumerp99DATA ENGINEERINGkoffset: consumer lagwithout the consumer// CONSUMER GROUP · OFFSET MONITORING
KE Engineering TeamJan 22, 2026
Confluent Cloud Migration ChecklistData Engineering cover for Confluent Cloud Migration ChecklistSELF-MANAGEDCONFLUENT CLOUDTOPICS · SCHEMASCONSUMERS · OFFSETSCONNECTORS · STREAMSCUTOVERDATA ENGINEERINGConfluent CloudMigration Checklist// PLAN THE FULL CUTOVER
KE Engineering TeamSep 28, 2025
Druid: Rollups with First and Last AggregationsDATA ENGINEERING cover for Druid: Rollups with First and Last Aggregationst0t1t2t3DATA ENGINEERINGDruid: Rollups withFirst and LastAggregations// FIRST AND LAST AT INGESTION
KE Engineering TeamOct 22, 2024
KZSH: Kafka AutocompleteDATA ENGINEERING cover for KZSH: Kafka Autocomplete$ kafka-topics --describe --topic ordordersorders.dlqorders.enrichedTAB · 3 TOPICS FROM THE BROKERDATA ENGINEERINGKZSH: KafkaAutocomplete// TYPE LESS · OPERATE FASTER
KE Engineering TeamSep 23, 2024
KTools: Console Consumer FilterDATA ENGINEERING cover for KTools: Console Consumer Filter$.status == "paid"EVERY RECORDMATCHES ONLYDATA ENGINEERINGKTools: ConsoleConsumer Filter// JSON PATH · FILTER ON READ
KE Engineering TeamMar 13, 2024
KTools: Truncate a Kafka TopicDATA ENGINEERING cover for KTools: Truncate a Kafka Topic0x000x1F0x3A0x570x6BDATA ENGINEERINGKTools: Truncate aKafka Topic// TRUNCATE WITHOUT DELETE
KE Engineering TeamFeb 20, 2024
Kafka Configuration from Environment VariablesDATA ENGINEERING cover for Kafka Configuration from Environment VariablesENVCLIENT PROPERTIESKAFKA_BOOTSTRAP_SERVERSbootstrap.serversKAFKA_SECURITY_PROTOCOLsecurity.protocolKAFKA_GROUP_IDgroup.idNO CONFIG FILE IN THE IMAGEDATA ENGINEERINGKafka Configurationfrom EnvironmentVariables// ENV VARS · CONTAINER READY
KE Engineering TeamSep 5, 2023
Flink and KafkaDATA ENGINEERING cover for Flink and KafkaSCHEMA REGISTRYKAFKAFLINKAVRO · SCHEMA IDONE CONTRACT, BOTH SIDESDATA ENGINEERINGFlink and Kafka// SCHEMA REGISTRY · FLINK
KE Engineering TeamJan 17, 2023
JDBC Sink Without a SchemaDATA ENGINEERING cover for JDBC Sink Without a SchemaTOPIC · NO SCHEMA{ … }#1040{ … }#1041{ … }#1042JDBC SINKTABLEidtspayloadDATA ENGINEERINGJDBC Sink Without aSchema// SCHEMA-LESS · JDBC SINK
KE Engineering TeamDec 20, 2022
Kafka Raft (KRaft)DATA ENGINEERING cover for Kafka Raft (KRaft)replicasDATA ENGINEERINGKafka Raft (KRaft)// KRAFT · DEDICATED CONTROLLER
KE Engineering TeamDec 9, 2022

Keep up with KE

New posts in your inbox.
Unsubscribe anytime.

Waiting for the security check to finish.