Kafka Improvement Proposals (KIPs)

Back to OSSIP

GitHub Repository: tomncooper/ossip

Last Updated: 2025/06/17 09:47:52 UTC

Status Key

Status Mentioned within the last N days
0
28
84
365
106751

KIPs Under Discussion

KIP Description Status +1 0 -1 Created by Age
1187 Support to retrieve remote log size via DescribeLogDirs RPC 0 0 0 PoAn Yang 1 days
1186 Update AddRaftVoterRequest RPC to support auto-join 0 0 0 Kevin Wu 5 days
1184 Add connector name and task index tags to MirrorMaker tasks' metrics 0 0 0 Jhen-Yung Hsu 4 weeks
1183 Unified Shared Storage 0 0 0 Xinyu Zhou 5 weeks
1181 Metadata Rack Awareness for Diskless Topics 0 0 0 Anatolii Popov 5 weeks
1178 Introduce remote.max.partition.fetch.bytes config in Consumer 0 0 0 Kamal Chandraprakash 6 weeks
1177 Consider renaming org.apache.kafka.storage.internals.log.RemoteStorageThreadPool metrics 0 0 0 Jiunn Yang Huang 6 weeks
1176 Tiered Storage for Active Log Segment 0 0 0 Henry Cai 7 weeks
1174 Expose addReadOnlyStateStore in DSL (StreamsBuilder) 0 0 0 Siddhartha Devineni 7 weeks
1173 Connect Storage Topics Sharing Across Clusters 0 0 0 Pritam Kumar Mishra 7 weeks
1172 Improve EndToEndLatency tool 0 0 0 Nick Guo 10 weeks
1171 Majority replication and leader election 0 0 0 José Armando García Sancio 8 weeks
1170 Unify cluster metadata bootstrapping 0 0 0 José Armando García Sancio 8 weeks
1165 Object Compaction for Diskless 0 0 0 Ivan Yurchenko 9 weeks
1164 Topic Based Batch Coordinator 0 0 0 Giuseppe Lillo 9 weeks
1163 Diskless Core 0 0 0 Ivan Yurchenko 9 weeks
1162 Redesign ClientQuotaCallback#updateClusterMetadata 0 0 0 Kuan Po Tseng 9 weeks
1161 cleanup.policy shouldn't be empty 0 0 0 Jiunn Yang Huang 9 weeks
1160 Enable returning supported features from a specific broker 0 0 0 PoAn Yang 10 weeks
1159 Large message reference based Serializer 0 0 0 Omnia Ibrahim 10 weeks
1158 Improve Connect SourceTask commit() 0 0 0 Sudesh Wasnik 10 weeks
1156 Define an official backward compatibility contract 0 0 0 Matthias J. Sax 10 weeks
1155 Metadata Version Downgrades 0 0 0 Colin McCabe 10 weeks
1154 Extending support for Microsecond/Nanosecond Precision for Kafka Connect 0 0 0 Pritam Kumar Mishra 10 weeks
1153 Refactor Kafka Streams CloseOptions to Fluent API Style 0 0 0 Jiunn Yang Huang 11 weeks
1151 Minimal movement replica balancing algorithm for reassignment 0 0 0 pengjialun 12 weeks
1150 Diskless Topics 0 0
1 Colin McCabe
Josep Prat 12 weeks
1149 Helm Chart for Apache Kafka 0 0 0 Steve A 12 weeks
1147 Improve consistency of command-line arguments 0 0 0 Andrew Schofield 13 weeks
1146 Anchored punctuation
1 Sophie Blee-Goldman
0 0 Herman Kolstad Jakobsen 13 weeks
1145 Kafka Streams `CloseOptions` should not have a public constructor 0 0 0 TengYao Chi 14 weeks
1144 Exposing a new public REST API for MirrorMaker 2 0 0 0 Bertlan Kondrat 14 weeks
1141 Simplifying MetadataQuorumCommand by Leveraging Admin API for Controller Management 0 0
1 Colin McCabe
Kuan Po Tseng 14 weeks
1138 Clean up TopologyConfig and API for supplying configs needed by the topology 0 0 0 Sébastien Viale 16 weeks
1137 Standardize Property Loading Priority 0 0 0 Jhen-Yung Hsu 16 weeks
1136 Make ConsumerGroupMetadata an interface 0 0 0 Paweł Szymczyk 16 weeks
1135 Deprecated "org.apache.kafka.disallowed.login.modules"
1 =?UTF-8?B?6b6a5a6j55KL?=
0 0 XuanZhang Gong 17 weeks
1134 Multi-tenancy in Kafka: Virtual Clusters 0 0 0 Viktor Somogyi 18 weeks
1130 Add metrics indicating the connection count exceeds 0 0 0 TengYao Chi 20 weeks
1129 Update ConfigException constructors 0 0 0 Gaurav Narula 20 weeks
1128 Replace KTable.transformValues with KTable.processValues 0 0 0 Matthias J. Sax 20 weeks
1127 Flexible Windows for Late Arriving Data 0 0 0 Almog Gavra 21 weeks
1122 Create a dedicated data module for Kafka Connect data classes 0 0 0 Mario Fiore Vitale 26 weeks
1121 Compression acceleration in Kafka 0 0 0 Olasoji Denloye 26 weeks
1120 AppInfo metrics don't contain the client-id 0 0 0 Jiunn Yang Huang 26 weeks
1119 Add support for SSL auto reload 0 0 0 Moncef Abboud 28 weeks
1115 Bazel Builds 0 0 0 Vince Rose 30 weeks
1114 Introducing Chunk in Partition 0 0 0 De Gao 30 weeks
1113 Enhancements to Rack-Aware Partition Assignor for Improved Client-Side Independence and Load Balancing 0 0 0 Jerry Cai 30 weeks
1110 Metadata of sensitive configuration 0 0 0 Luke Chen 31 weeks
1108 Publish metrics for skipped records in Kafka Connect 0 0 0 Hector Geraldino 32 weeks
1107 Adding topic-level acks and compressions for producers 0 0 0 TaiJuWu 32 weeks
1100 Rename org.apache.kafka.server:type=AssignmentsManager and org.apache.kafka.storage.internals.log.RemoteStorageThreadPool metrics 0 0 0 Jiunn Yang Huang 33 weeks
1098 Reverse Checkpointing in MirrorMaker 0 0 0 Daniel Urban 35 weeks
1097 Error record reporter in Connect 0 0 0 Anton Liauchuk 36 weeks
1096 Add ability to pass headers to ProducerPerformance 0 0 0 Max 36 weeks
1095 Kafka Canary Isolation 0 0 0 Zhifeng Chen 39 weeks
1093 Add more observability for MirrorMaker2 0 0 0 PoAn Yang 39 weeks
1091 Improved Kafka Streams operator metrics 0 0 0 Bill Bejeck 39 weeks
1088 Replace KafkaClientSupplier with KafkaClientInterceptor 0 0 0 Matthias J. Sax 41 weeks
1086 Add ability to specify a custom produce request parser. 0 0
1 Colin McCabe
Max 42 weeks
1083 Increase default value of task.shutdown.graceful.timeout.ms in Connect 0 0 0 Sagar Rao 44 weeks
1081 Graduation Steps for KIPs 0 0 0 Josep Prat 44 weeks
1072 Add @FunctionalInterface annotation to Kafka Streams SAM methods 0 0 0 Bill Bejeck 47 weeks
1067 Remove ReplicaVerificationTool in 5.0 (deprecate in 3.9)
1 Dongjin Lee
0 0 Dongjin Lee 49 weeks
1066 Mechanism to cordon brokers and log directories 0 0 0 Mickael Maison 50 weeks
1064 Upgrade slf4j to 2.x
1 Chia-Ping Tsai
0 0 Muralidhar Basani 51 weeks
1063 Drop inconsistent casing in Selector metrics tags 0 0 0 PoAn Yang 51 weeks
1062 Introduce Pagination for some requests used by Admin API 0 0 0 Omnia Ibrahim 51 weeks
1061 Allow exporting SCRAM credentials 0 0 0 Gaurav Narula 51 weeks
1059 Enable Producer to resolve send() method errors 0 0
1 Chris Egerton
Alieh Saeedi 52 weeks
1055 Introducing Round-Robin Assignment Strategy to ConnectorUtils 0 0 0 Fan Yang 1 years 1 weeks
1051 Statically configured log replication throttling 0 0 0 Harry Fallows 1 years 2 weeks
1048 Improve kafka-consumer-perf-test to benchmark single partition 0 0 0 Harsh Panchal 1 years 4 weeks
1046 Expose producer.id.expiration.check.interval.ms as dynamic broker configuration 0 0 0 Jorge Esteban Quilcate Otoya 1 years 5 weeks
1045 Move MockAdminClient to public api 0 0 0 Muralidhar Basani 1 years 5 weeks
1044 A proposal to change idempotent producer -- server implementation 0 0 0 Claude Warren 1 years 5 weeks
1042 Implementation of a GLOB Pattern type for ACL pattern matching.
1 Claude Warren, Jr
0
1 Colin McCabe
Muralidhar Basani 1 years 7 weeks
1039 Disable automatic topic creation for MirrorMaker2 consumers 0 0 0 Yangkun Ai 1 years 9 weeks
1038 Add Custom Error Handler to Producer 0 0 0 Alieh Saeedi 1 years 9 weeks
1027 Add MockFixedKeyProcessorContext and TestFixedKeyRecordFactory 0 0 0 Matthias J. Sax 1 years 14 weeks
1026 Handling producer snapshot when upgrading from < v2.8.0 for Tiered Storage 0 0 0 Divij Vaidya 1 years 14 weeks
1024 Make the restore behavior of GlobalKTables with custom processors configureable 0 0 0 Walker Carlson 1 years 16 weeks
1021 Allow to get last stable offset (LSO) in kafka-get-offsets.sh 0 0 0 Ahmed Sobeh 1 years 16 weeks
1016 Make MM2 heartbeats topic name configurable 0 0 0 Bertlan Kondrat 1 years 22 weeks
1015 Limit number of ssl connections in brokers 0 0 0 Jimmy Wang 1 years 23 weeks
1014 Managing Unstable Features in Apache Kafka 0 0 0 Proven Provenzano 1 years 24 weeks
1010 Topic Partition Quota 0 0 0 Afshin Moazami 1 years 27 weeks
1009 Add Broker-level Throttle Configurations 0 0 0 Ria Pradeep 1 years 30 weeks
1008 ParKa - the Marriage of Parquet and Kafka 0 0 0 Xinli Shang 1 years 30 weeks
1006 Remove SecurityManager Support
1 Luke Chen
0 0 Greg Harris 1 years 30 weeks
1003 Signal next segment when remote fetching 0 0 0 Jorge Esteban Quilcate Otoya 1 years 31 weeks
1002 Fetch remote segment indexes at once 0 0 0 Jorge Esteban Quilcate Otoya 1 years 31 weeks
998 Give ProducerConfig(props, doLog) constructor protected access 0 0 0 A. Sophie Blee-Goldman 1 years 33 weeks
997 update WindowRangeQuery and unify WindowKeyQuery and WindowRangeQuery 0 0 0 Pengcheng Zheng 1 years 33 weeks
991 Allow DropHeaders SMT to drop headers by wildcard/regexp 0 0 0 Roman Schmitz 1 years 35 weeks
990 Capability to PAUSE Tasks on DeserializationException 0 0 0 Nicholas Telford 1 years 36 weeks
987 Connect Static Assignments 0 0 0 Greg Harris 1 years 37 weeks
986 Cross-Cluster Replication 0 0 0 Greg Harris 1 years 37 weeks
984 Add pluggable compression interface to Kafka 0 0 0 Assane Diop 1 years 37 weeks
983 Full speed async processing during rebalance 0 0 0 Erik van Oosten 1 years 38 weeks
982 Access SslPrincipalMapper and kerberosShortNamer in Custom KafkaPrincipalBuilder 0 0 0 Raghu Baddam 1 years 39 weeks
981 Manage Connect topics with custom implementation of Admin 0 0 0 Omnia Ibrahim 1 years 39 weeks
973 Expose per topic replication rate metrics 0 0 0 Nelson B. 1 years 42 weeks
972 Add the metric of the current running version of kafka 0 0 0 hudeqi 1 years 42 weeks
969 Support range interactive queries (IQv2) for versioned state stores 0 0 0 Alieh Saeedi 1 years 44 weeks
967 Support custom SSL configuration for Kafka Connect RestServer 0 0 0 Taras Ledkov 1 years 45 weeks
965 Support disaster recovery between clusters by MirrorMaker 0 0 0 hudeqi 1 years 45 weeks
964 Have visibility when produce requests become "async" 0 0 0 Sergio Troiano 1 years 45 weeks
958 Tiered Storage Metrics 0 0 0 Abhijeet Kumar 1 years 47 weeks
953 partition method to be overloaded to accept headers as well. 0 0 0 Jacob Tomy 1 years 48 weeks
952 Regenerate segment-aligned producer snapshots when upgrading to a Kafka version supporting Tiered Storage 0 0 0 Christo Lolov 1 years 48 weeks
948 Allow custom prefix for internal topic names in Kafka Streams 0 0 0 Igor Buzatović 1 years 50 weeks
945 Update threading model for Consumer 0 0 0 Kirk True 1 years 51 weeks
943 Add independent “offset.storage.segment.bytes” for connect-distributed.properties 0 0 0 hudeqi 1 years 51 weeks
940 Broker extension point for validating record contents at produce time 0 0 0 Edoardo Comar 2 years 2 weeks
936 Throttle number of active PIDs 0 0 0 Omnia Ibrahim 2 years 4 weeks
935 Extend AlterConfigPolicy with existing configurations 0 0 0 Jorge Esteban Quilcate Otoya 2 years 4 weeks
934 Add DeleteTopicPolicy 0 0 0 Jorge Esteban Quilcate Otoya 2 years 4 weeks
933 Publish metrics when source connector fails to poll data 0 0 0 Ravindranath 2 years 4 weeks
928 Making Kafka resilient to log directories becoming full 0 0 0 Christo Lolov 2 years 6 weeks
922 Add the traffic metric of the partition dimension 0 0 0 hudeqi 2 years 8 weeks
921 OpenJDK CRaC support 0 0 0 Radim Vansa 2 years 9 weeks
920 Support upgrading KRaft MetadataVersion based on a static config 0 0 0 Colin McCabe 2 years 9 weeks
918 MM2 Topic And Group Listener 0 0 0 Daniel Urban 2 years 10 weeks
916 MM2 distributed mode flow log context 0 0 0 Daniel Urban 2 years 12 weeks
913 add new method to provide possibility for accelerate first record's sending 0 0 0 fu.jian 2 years 15 weeks
912 Support decreasing send's max block time without worrying about metadata's fetch 0 0 0 fu.jian 2 years 15 weeks
910 Update Source offsets for Source Connectors without producing records 0 0 0 Sagar Rao 2 years 17 weeks
905 Broker interceptors 0 0 0 David Mariassy 2 years 19 weeks
901 Add connectorDeleted flag when stopping tasks 0 0 0 Hector Geraldino 2 years 21 weeks
895 Dynamically refresh partition count of __consumer_offsets 0 0 0 Christo Lolov 2 years 25 weeks
888 Batch describe ACLs and describe client quotas 0 0 0 Mickael Maison 2 years 31 weeks
886 Add Client Producer and Consumer Builders 0 0 0 Daniel Scanteianu 2 years 32 weeks
885 Expose Broker's Name and Version to Clients 0 0 0 Travis Bischel 2 years 32 weeks
883 Add isDeleted flag when stopping a connector 0 0 0 Hector Geraldino 2 years 33 weeks
882 Kafka Connect REST API configuration validation timeout improvements 0 0 0 Yash Mayya 2 years 34 weeks
880 X509 SAN based SPIFFE URI ACL within mTLS Client Certificates 0 0 0 Bart Van Bos 2 years 33 weeks
879 Multi-level Rack Awareness 0 0 0 Viktor Somogyi 2 years 37 weeks
874 TopicRoundRobinAssignor 0 0 0 Mathieu Amblard 2 years 37 weeks
873 ExceptionHandlingDeserializer, RetryDeserializer, PipeSerializer, PipeDeserializer 0 0 0 Alex Collins 2 years 37 weeks
870 Retention policy based on record event time 0 0 0 Nikolay Izhikov 2 years 39 weeks
864 Add End-To-End Latency Metrics to Connectors 0 0 0 Jorge Esteban Quilcate Otoya 2 years 42 weeks
861 Add BytesIn/BytesOut per listener metrics 0 0 0 Luke Chen 2 years 46 weeks
857 Streaming recursion in Kafka Streams 0 0 0 Nicholas Telford 2 years 47 weeks
855 Add schema.namespace parameter to SetSchemaMetadata SMT in Kafka Connect 0 0 0 Michael Negodaev 2 years 48 weeks
849 Expose logdirs total and usable space via kafka-log-dirs.sh 0 0 0 Deng Ziming 2 years 0 weeks
842 Add richer group offset reset mechanisms 0 0 0 hudeqi 3 years 4 weeks
839 Provide builders for KafkaProducer/KafkaConsumer and KafkaStreams 0 0 0 Francois Rosiere 3 years 5 weeks
832 Allow creating a producer/consumer using a producer/consumer config 0 0 0 Francois Rosiere 3 years 7 weeks
829 (console-consumer) add print.topic property 0 0 0 Evans Jahja 3 years 10 weeks
828 Add the corresponding validator to the configuration where the validator is missing 0 0 0 RivenSun 3 years 11 weeks
826 Define platforms supported 0 0 0 Mickael Maison 3 years 12 weeks
823 Update Admin::describeConfigs to allow fetching specific configurations 0 0 0 Vikas Singh 3 years 17 weeks
822 Optimize the semantics of KafkaConsumer#pause to be consistent between the two RebalanceProtocols 0 0 0 RivenSun 3 years 18 weeks
821 Connect Transforms support for nested structures 0 0 0 Jorge Esteban Quilcate Otoya 3 years 19 weeks
819 Merge multiple KStreams in one operation 0 0 0 Nicholas Telford 3 years 20 weeks
818 Introduce cache-size-bytes-total Task Level Metric 0 0 0 Sagar Rao 3 years 20 weeks
817 Fix inconsistency in dynamic application log levels 0 0 0 Dongjin Lee 3 years 21 weeks
816 Topology changes without local state reset 0 0 0 Nicholas Telford 3 years 21 weeks
809 Support live upgrades with dynamic addition/removal of modular topologies 0 0 0 A. Sophie Blee-Goldman 3 years 27 weeks
807 Refactor KafkaStreams exposed metadata hierarchy 0 0 0 Josep Prat 3 years 28 weeks
804 OfflinePartitionsCount Tagged by Topic 0 0 0 Mason Joseph Legere 3 years 30 weeks
803 Add Task ID and Connector Name to Connect Task Context 0 0 0 Sarah Story 3 years 30 weeks
802 Validation Support for Kafka Connect SMT and Converter Options 0 0 0 Gunnar Morling 3 years 30 weeks
799 Align behaviour for producer callbacks with documented behaviour 0 0 0 Seamus O Ceanainn 3 years 32 weeks
786 Emit Metric Client Quota Values 0 0 0 Mason Joseph Legere 3 years 35 weeks
785 Automatic storage formatting 0 0 0 Igor Soarez 3 years 35 weeks
782 Expandable batch size in producer 0 0 0 Luke Chen 3 years 35 weeks
781 Improve MirrorMaker2's client configuration 0 0 0 Dongjin Lee 3 years 36 weeks
780 Support fine-grained compression options 0 0 0 Dongjin Lee 3 years 36 weeks
777 Improved testability for Admin client 0 0 0 Tom Bentley 3 years 39 weeks
776 Add Consumer#peek for debugging/tuning 0 0 0 Luke Chen 3 years 39 weeks
774 Deprecate public access to Admin client's *Result constructors 0 0 0 Tom Bentley 3 years 41 weeks
772 Encrypt KRaft Metadata Secrets at Rest 0 0 0 Colin McCabe 3 years 42 weeks
767 Connect Latency Metrics 0 0 0 Jordan Bull 3 years 45 weeks
765 Introduce new SlidingWindow type for [start,end] time 0 0 0 Luke Chen 3 years 47 weeks
762 Delete Committed Connect Records 0 0 0 Ryanne Dolan 3 years 49 weeks
760 Minimum value for segment.ms and segment.bytes 0 0 0 Badai Aqrandista 3 years 50 weeks
758 Remove list of latest producer append information for broker 0 0 0 Yi Ding 3 years 52 weeks
755 Add new AUTO_CREATE ACL for auto topic creation 0 0 0 Christopher L. Shannon 4 years 2 weeks
754 Make Scala case class's final 0 0 0 Matthew de Detrich 4 years 2 weeks
753 ACL authentication, Host field support IP network segment 0 0 0 loboxu 4 years 2 weeks
749 Add --files and --file-separator options to the ConsoleProducer 0 0 0 Wenbing Shen 4 years 2 weeks
743 Remove config value 0.10.0-2.4 of Streams built-in metrics version config 0 0 0 Bruno Cadonna 4 years 5 weeks
739 Block Less on KafkaProducer#send 0 0 0 Moses Nakamura 4 years 6 weeks
737 Add canTrackSource to ReplicationPolicy 0 0 0 Matthew de Detrich 4 years 6 weeks
736 Report the true end to end fetch latency 0 0 0 Ming Liu 4 years 8 weeks
731 Record Rate Limiting for Kafka Connect 0 0 0 Ryanne Dolan 4 years 10 weeks
729 Custom validation of records on the broker prior to log append 0 0 0 Soumyajit Sahu 4 years 12 weeks
728 Introduce the RESTORING state to the KafkaStreams state machine 0 0 0 A. Sophie Blee-Goldman 4 years 12 weeks
727 Add --under-preferred-replica-partitions option to describe topics command 0 0 0 Wenbing Shen 4 years 12 weeks
723 Add socket.tcp.no.delay property to Kafka Config 0 0 0 Andrei Iatsuk 4 years 14 weeks
718 Make KTable Join on Foreign key unopinionated 0 0 0 Marco Lotz 4 years 16 weeks
713 Validation of Enums in configuration 0 0 0 Jeremy Custenborder 4 years 19 weeks
712 Shallow Mirroring 0 0 0 Henry Cai 4 years 20 weeks
706 Add method "Producer#send" to return CompletionStage instead of Future 0 0 0 Ismael Juma 6 years 22 weeks
705 Selectively Disable Topology Optimizations 0 0 0 Almog Gavra 4 years 23 weeks
703 Add a metrics for reporting idle connections closed 0 0 0 Pere Urbon 4 years 23 weeks
702 The control plane needs to force the validation of requests from the controller 0 0 0 Wenbing Shen 4 years 24 weeks
701 Add--override option to bin/connect-distributed.sh 0 0 0 Akitoshi Yoshida 4 years 26 weeks
697 Stricter parsing of addresses in configs 0 0 0 Tom Bentley 4 years 28 weeks
694 Support Reducing Partitions for Topics 0 0 0 George Shu 4 years 29 weeks
693 Client-side Circuit Breaker for Partition Write Errors 0 0 0 George Shu 4 years 29 weeks
692 Make AdminClient value object constructors public 0 0 0 Noa Resare 4 years 29 weeks
688 Support dynamic update of delete.topic.enable config 0 0 0 Prateek Agarwal 4 years 30 weeks
686 API to ensure Records policy on the broker 0 0 0 Nikolay Izhikov 4 years 31 weeks
685 Loosen permission for listing reassignments 0 0 0 David Jacot 4 years 32 weeks
683 Add recursive support to Connect Cast and ReplaceField transforms, and support for casting complex types to either a native or JSON string 0 0 0 Joshua Grisham 4 years 32 weeks
682 Connect TimestampConverter support for multiple fields and multiple input formats 0 0 0 Joshua Grisham 4 years 32 weeks
681 Rename master key in delegation token feature 0 0 0 Tom Bentley 4 years 32 weeks
678 New Kafka Connect SMT for plainText => Struct(or Map) with Regex 0 0 0 whsoul82 4 years 35 weeks
674 Metric Reporter to Aggregate Metrics in Kafka Streams 0 0 0 Bruno Cadonna 4 years 38 weeks
672 Introduce Kafka Streams Specific Uncaught Exception Handler 0 0 0 Walker Carlson 4 years 39 weeks
670 Add ConsumerGroupCommand to delete static members 0 0 0 Sandeep Kumar 4 years 42 weeks
669 Preserve Source Partition in Kafka Streams from context 0 0 0 satya k 4 years 42 weeks
668 Expose REST endpoint to list converter plugins 0 0 0 Rupesh Kumar Patel 4 years 42 weeks
665 Kafka Connect Hash SMT 0 0 0 Brandon Brown 4 years 43 weeks
658 [DISCARD] KIP-658 Deprecate all setters of Headers 0 0 0 Chia-Ping Tsai 4 years 44 weeks
657 Add Customized Kafka Streams Logo 0 0 0 Boyang Chen 4 years 45 weeks
656 MirrorMaker2 Exactly-once Semantics 0 0 0 Ning Zhang 4 years 46 weeks
655 Windowed Distinct Operation for Kafka Streams API 0 0 0 Ivan Ponomarev 4 years 46 weeks
650 Enhance Kafkaesque Raft semantics 0 0 0 Boyang Chen 4 years 47 weeks
649 Dynamic Client Configuration 0 0 0 Ryan Dielhenn 4 years 47 weeks
647 Add ability to handle late messages in streams-aggregation 0 0 0 Igor Piddubnyi 4 years 48 weeks
646 Serializer API should support ByteBuffer 0 0 0 Chia-Ping Tsai 4 years 48 weeks
644 Support sources which can't give out changed data in kafka connect 0 0 0 Nikhil Kumar 4 years 49 weeks
640 Add log compression analysis tool 0 0 0 Christopher Beard 4 years 51 weeks
639 Move nodeLevelSensor and storeLevelSensor methods from StreamsMetricsImpl to StreamsMetrics 0 0 0 mohamed chebbi 4 years 50 weeks
637 Include min.insync.replicas in MetadataResponse to make Producer smarter in partitioning events 0 0 0 Arvin Zheng 4 years 51 weeks
636 Make RPC error codes and messages tagged fields 0 0 0 Tom Bentley 4 years 51 weeks
631 The Quorum-based Kafka Controller 0 0 0 Colin McCabe 4 years 52 weeks
628 ConsumerPerformance's multi-thread implementation 0 0 0 Jiamei.xie 5 years 1 weeks
625 Richer encodings for integral-typed protocol fields 0 0 0 Tom Bentley 5 years 1 weeks
624 Consolidate Offset Validation into Fetch Protocol 0 0 0 Boyang Chen 5 years 1 weeks
619 Add internal topic creation support 0 0 0 Cheng Tan 5 years 4 weeks
609 Use Pre-registration and Blocking Calls for Better Transaction Efficiency 0 0 0 Boyang Chen 5 years 7 weeks
603 Change `ConfigEntry` value to use optional fields 0 0 0 Wang Ge 5 years 8 weeks
598 Augment TopologyDescription with store and source / sink serde information 0 0 0 Guozhang Wang 5 years 9 weeks
596 Safely abort Producer transactions during application shutdown 0 0 0 Xiang Zhang 5 years 10 weeks
592 MirrorMaker 1.0 should replicate topics from earliest 0 0 0 Jeff Widman 5 years 10 weeks
587 Suppress detailed responses for handled exceptions in security-sensitive environments 0 0 0 Connor Penhale 5 years 12 weeks
583 add tag "partition" to BrokerTopicMetrics so as to observe the partition metrics on the same broker 0 0 0 Chia-Ping Tsai 5 years 14 weeks
582 Add a "continue" option for Kafka Connect error handling 0 0 0 Zihan Li 5 years 14 weeks
579 new exception on min.insync.replicas > replication.factor 0 0 0 Paolo Moriello 5 years 14 weeks
578 Add configuration to limit number of partitions 0 0 0 Gokul Ramanan Subramanian 5 years 15 weeks
576 Support dynamic update of more broker configs related to replication 0 0 0 Cheng Tan 5 years 15 weeks
575 build a Kafka-Exporter by Java 0 0 0 francis lee 5 years 16 weeks
568 Support RPC message type 'double' 0 0 0 Brian Byrne 5 years 21 weeks
567 Kafka Cluster Audit 0 0 0 Igor Martemyanov 5 years 22 weeks
566 Add rebalance callbacks to ConsumerInterceptor 0 0 0 Tommy Becker 5 years 22 weeks
563 Add 'tail -n' feature for ConsoleConsumer 0 0 0 huxihx 5 years 22 weeks
561 Regex Support for ConsumerGroupCommand 0 0 0 Alex Dunayevsky 5 years 26 weeks
560 Auto infer external topic partitions in stream reset tool 0 0 0 high.lee 5 years 23 weeks
550 Mechanism to Delete Stray Partitions on Broker 0 0 0 Dhruvil Shah 5 years 28 weeks
549 Surface Consumer's Metadata in KafkaAdminClient#describeConsumerGroups 0 0 0 David Jacot 5 years 30 weeks
548 Add Option to enforce rack-aware custom partition reassignment execution 0 0 0 Satish Bellapu 5 years 31 weeks
547 Extend ConsumerInterceptor to allow modification of Consumer Commits 0 0 0 Eric Azama 5 years 31 weeks
542 Partition Reassignment Throttling 0 0 0 Viktor Somogyi 5 years 35 weeks
540 Implement per key stream time tracking 0 0 0 Richard Yu 5 years 35 weeks
539 Implement mechanism to flush out records in low traffic suppression buffers 0 0 0 Richard Yu 5 years 36 weeks
536 Propagate broker start time to Admin API 0 0 0 Noa Resare 5 years 36 weeks
532 Broker Consumer Lag metrics in size and time 0 0 0 NIKHIL BHATIA 5 years 43 weeks
526 Reduce Producer Metadata Lookups for Large Number of Topics 0 0 0 Brian Byrne 5 years 40 weeks
514 Add a bounded flush() API to Kafka Producer 0 0 0 kun du 5 years 43 weeks
513 Distinguish between Key and Value serdes in scala wrapper library for kafka streams 0 0 0 Mykhailo Yeromenko 5 years 44 weeks
510 Metrics library upgrade 0 0 0 Mario Molina 5 years 44 weeks
509 Rebalance and restart Producers 0 0 0 Werner Dähn 5 years 44 weeks
508 Make Suppression State Queriable 0 0 0 Dongjin Lee 5 years 44 weeks
506 Allow setting SCRAM password via Admin interface 0 0 0 Tom Bentley 5 years 45 weeks
505 Add new public method to only update assignment metadata in consumer 0 0 0 Jungtaek Lim 5 years 46 weeks
503 Add metric for number of topics marked for deletion 0 0 0 David Arthur 5 years 46 weeks
502 Connect Task Method Signature to be More Specific for Developers 0 0 0 Cyrus Vafadari 5 years 46 weeks
501 Avoid out-of-sync or offline partitions when follower fetch requests are not processed in time 0 0 0 Satish Duggana 5 years 47 weeks
498 Add client-side configuration for maximum response size to protect against OOM 0 0 0 Alexandre Dupriez 5 years 47 weeks
494 Connect REST Endpoint to get Transformations (SMTs) 0 0 0 Cyrus Vafadari 5 years 48 weeks
491 Preferred Leader Deprioritized List (Temporary Blacklist) 0 0 0 George Li 5 years 49 weeks
490 New metric to count offsets expired without being consumed by a consumer group 0 0 0 Jose Morales Aragon 5 years 49 weeks
487 Client-side Automatic Topic Creation on Producer 0 0 0 Justine Olshan 5 years 50 weeks
483 Add Broker Version API in Admin Client 0 0 0 Boyang Chen 5 years 52 weeks
473 Enable KafkaLog4JAppender to use SASL Authentication Callback Handlers 0 0 0 Ryan Pridgeon 6 years 5 weeks
469 Pre-registration support for static members 0 0 0 Boyang Chen 6 years 6 weeks
468 Avoid decompression of record when validate record at server in the scene of inPlaceAssignment . 0 0 0 Flowermin 6 years 6 weeks
463 Auto-configure non-default Serdes passed alongside the TopologyBuilder 0 0 0 Richard Yu 6 years 9 weeks
459 Improve KafkaStreams#close 0 0 0 Dongjin Lee 6 years 9 weeks
457 Add DISCONNECTED status to Kafka Streams 0 0 0 Richard Yu 6 years 10 weeks
452 Tool to view cluster status 0 0 0 Łukasz Antoniak 6 years 10 weeks
448 Add State Stores Unit Test Support to Kafka Streams Test Utils 0 0 0 Yishun Guan 6 years 12 weeks
439 Cleanup built-in Store interfaces 0 0 0 Matthias J. Sax 6 years 15 weeks
438 Expose task, connector IDs in Connect API 0 0 0 Ryanne Dolan 6 years 16 weeks
435 Internal Partition Reassignment Batching 0 0 0 Viktor Somogyi 6 years 17 weeks
433 Block old clients on brokers 0 0 0 Ying Zheng 6 years 18 weeks
426 Persist Broker Id to Zookeeper 0 0 0 Kan Li 6 years 20 weeks
424 Allow suppression of intermediate events based on wall clock time 0 0 0 Jonathan Gordon 6 years 22 weeks
423 Add JoinReason to Consumer Join Group Protocol 0 0 0 Boyang Chen 6 years 21 weeks
419 Safely notify Kafka Connect SourceTask is stopped 0 0 0 Andrew Schofield 6 years 22 weeks
410 Add metric for request handler thread pool utilization by request type 0 0 0 Mayuresh Gharat 6 years 27 weeks
409 Allow creating under-replicated topics and partitions 0 0 0 Mickael Maison 6 years 27 weeks
408 Add Asynchronous Processing To Kafka Streams 0 0 0 Richard Yu 6 years 27 weeks
406 GlobalStreamThread should honor custom reset policy 0 0 0 Richard Yu 6 years 27 weeks
403 Increase ProducerPerformance precision by using nanoTime 0 0 0 Kevin Lu 6 years 28 weeks
400 Improve exit status in case of errors in ConsoleProducer 0 0 0 Kamal Kang 6 years 32 weeks
398 Support reading trust store from classpath 0 0 0 Noa Resare 6 years 29 weeks
397 Add methods to override fetch offsets based on timestamp 0 0 0 Brandon Kirchner 6 years 30 weeks
395 Encypt-then-MAC Delegation token metadata 0 0 0 Attila Sasvári 6 years 30 weeks
388 Add observer interface to record request and response 0 0 0 Lincong Li 6 years 33 weeks
387 Fair Message Consumption Across Partitions in KafkaConsumer 0 0 0 CHIENHSING WU 6 years 33 weeks
385 Avoid throwing away prefetched data 0 0 0 Zahari Dichev 6 years 35 weeks
384 Add config for incompatible changes to persistent metadata 0 0 0 Jason Gustafson 6 years 35 weeks
381 Connect: Tell about records that had their offsets flushed in callback 0 0 0 Per Steffensen 6 years 37 weeks
375 Kafka Clients - make Metadata#TOPIC_EXPIRY_MS configurable 0 0 0 Pavel Moukhataev 6 years 39 weeks
370 Remove Orphan Partitions 0 0 0 xiongqi wu 6 years 42 weeks
363 Allow performance tools to print final results to output file 0 0 0 Attila Sasvári 6 years 44 weeks
362 Support dynamic gap session window 0 0 0 Lei Chen 6 years 44 weeks
350 Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it 0 0 0 Ratish Ravindran 6 years 47 weeks
349 Priorities for Source Topics 0 0 0 Nick Afshartous 6 years 47 weeks
348 Deprecate null from SourceTask#poll() 0 0 0 Chia-Ping Tsai 6 years 47 weeks
343 Add a Controller Heartbeat Mechanism 0 0 0 Colin McCabe 6 years 49 weeks
340 Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file 0 0 0 Dong Lin 6 years 50 weeks
333 Add faster mode of rebalancing 0 0 0 Richard Yu 6 years 51 weeks
325 Extend Consumer Group Command to Show Beginning Offsets 0 0 0 Vahid Hashemian 6 years 52 weeks
322 Return new error code for DeleteTopics API when topic deletion disabled. 0 0 0 Manikumar Reddy O. 6 years 1 weeks
320 Allow fetchers to detect and handle log truncation 0 0 0 Jason Gustafson 6 years 1 weeks
317 Add end-to-end data encryption functionality to Apache Kafka 0 0 0 Sönke Liebau 7 years 1 weeks
316 Command-line overrides for ConnectDistributed worker properties 0 0 0 Kevin Lafferty 7 years 2 weeks
315 Stream Join Sticky Assignor 0 0 0 Mike Freyberger 7 years 2 weeks
314 KTable to GlobalKTable Bi-directional Join 0 0 0 Adam Bellemare 7 years 2 weeks
304 Connect runtime mode improvements for container platforms 0 0 0 Saulius Valatka 7 years 6 weeks
301 Schema Inferencing for JsonConverter 0 0 0 Allen Tang 7 years 6 weeks
296 Connector level configurability for client configs 0 0 0 Allen Tang 7 years 7 weeks
293 Add new metrics for consumer/replication fetch requests 0 0 0 Adam Kotwasinski 7 years 8 weeks
287 Support partition and processor expansion for stateful processing jobs 0 0 0 Dong Lin 7 years 10 weeks
286 producer.send() should not block on metadata update 0 0 0 Dong Lin 7 years 11 weeks
273 Kafka to support using ETCD beside Zookeeper 0 0 0 Balint Molnar 7 years 13 weeks
271 Add NetworkClient redirector 0 0 0 Sergey Korytnikov 7 years 14 weeks
270 A Scala Wrapper Library for Kafka Streams 0 0 0 Debasish Ghosh 7 years 15 weeks
264 Add a consumer metric to record raw fetch size 0 0 0 Vahid Hashemian 7 years 17 weeks
259 Improve Streams DSL Timestamp Propagation Semantics 0 0 0 Matthias J. Sax 7 years 18 weeks
256 Add RocksDB statistics via Streams metrics 0 0 0 jameschien 7 years 18 weeks
254 JsonConverter Exception Handeling 0 0 0 Prasanna Subburaj 7 years 19 weeks
253 Support in-order message delivery with partition expansion 0 0 0 Dong Lin 7 years 20 weeks
252 Extend ACLs to allow filtering based on ip ranges and subnets 0 0 0 Sönke Liebau 7 years 21 weeks
250 Add Support for Quorum-based Producer Acknowledgment 0 0 0 Litao Deng 7 years 22 weeks
249 Add Delegation Token Operations to KafkaAdminClient 0 0 0 Manikumar Reddy O. 7 years 23 weeks
242 Mask password in Kafka Connect Rest API response 0 0 0 Vincent Meng 7 years 27 weeks
241 KTable repartition with compacted Topics 0 0 0 Jan Filipiak 7 years 27 weeks
240 AdminClient.listReassignments AdminClient.describeReassignments 0 0 0 Tom Bentley 7 years 27 weeks
236 Interruptible Partition Reassignment 0 0 0 Tom Bentley 7 years 29 weeks
234 add support for getting topic defaults from AdminClient 0 0 0 dan norwood 7 years 29 weeks
232 Detect outdated metadata using leaderEpoch and partitionEpoch 0 0 0 Dong Lin 7 years 29 weeks
228 Negative record timestamp support 0 0 0 Konstantin Chukhlomin 7 years 30 weeks
209 Connection String Support 0 0 0 Clebert Suconic 7 years 36 weeks
201 Rationalising Policy interfaces 0 0 0 Tom Bentley 7 years 41 weeks
193 Add SchemaBuilder.from(Schema) 0 0 0 Ewen Cheslack-Postava 7 years 43 weeks
185 Make exactly once in order delivery per partition the default producer setting 0 0 0 Apurva Mehta 7 years 46 weeks
181 DescribeGroups Protocol Enhancement 0 0 0 Vahid Hashemian 7 years 48 weeks
178 Size-based log directory selection strategy 0 0 0 huxihx 7 years 49 weeks
169 Lag-Aware Partition Assignment Strategy 0 0 0 Grant Neale 8 years 1 weeks
166 Add a tool to make amounts of replicas and leaders on brokers balanced 0 0 0 Ma Tianchi 8 years 4 weeks
159 Introducing Rich functions to Streams 0 0 0 Jeyhun Karimov 8 years 5 weeks
148 Add a connect timeout for client 0 0 0 pengwei 8 years 9 weeks
142 Add ListTopicsRequest to efficiently list all the topics in a cluster 0 0 0 Colin McCabe 8 years 10 weeks
139 Kafka TestKit library 0 0 0 Ismael Juma 8 years 11 weeks
135 Send of null key to a compacted topic should throw non-retriable error back to user 0 0 0 Mayuresh Gharat 8 years 14 weeks
125 ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback 0 0 0 Onur Karaman 8 years 18 weeks
87 Add Compaction Tombstone Flag 0 0 0 Michael André Pearce 8 years 35 weeks
76 Enable getting password from executable rather than passing as plaintext in config files 0 0 0 Ashish Singh 8 years 44 weeks
69 Kafka Schema Registry 0 0 0 Harsha 8 years 52 weeks
68 Add a consumed log retention before log retention 0 0 0 pengwei 8 years 52 weeks
64 Allow underlying distributed filesystem to take over replication depending on configuration 0 0 0 Arvind Kandhare 9 years 1 weeks
61 Add a log retention parameter for maximum disk space usage percentage 0 0 0 Ben Drees 9 years 6 weeks
60 Make Java client classloading more flexible 0 0 0 Rajini Sivaram 9 years 7 weeks
59 Proposal for a kafka broker command 0 0 0 Jayesh Thakrar 9 years 7 weeks
53 Add custom policies for reconnect attempts to NetworkdClient 0 0 0 Florian Hussonnois 9 years 12 weeks
52 Connector Control APIs 0 0 0 Jason Gustafson 9 years 13 weeks
49 Fair Partition Assignment Strategy 0 0 0 Andrew Olson 9 years 17 weeks
47 Add timestamp-based log deletion policy 0 0 0 Bill Warshaw 9 years 20 weeks
46 Self Healing Kafka 0 0 0 Aditya Auradkar 9 years 21 weeks
45 Standardize all client sequence interaction on j.u.Collection. 0 0 0 Pierre-Yves Ritschard 9 years 22 weeks
44 Allow Kafka to have a customized security protocol 0 0 0 XIAO, TAO 9 years 22 weeks
37 Add Namespaces to Kafka 0 0 0 Ashish Singh 9 years 38 weeks
34 Add Partitioner Change Listener to Partitioner Interface for Multiple Use Case 0 0 0 Bhavesh Mistry 9 years 41 weeks
30 Allow for brokers to have plug-able consensus and meta data storage sub systems 0 0 0 Joe Stein 10 years 18 weeks
29 Add an IsrPropagateIntervalMs configuration to KafkaConfig 0 0 0 Jiangjie Qin 9 years 46 weeks
27 Conditional Publish 0 0 0 Ben Kirwin 9 years 50 weeks
23 Add JSON/CSV output and looping options to ConsumerGroupCommand 0 0 0 Ashish Singh 10 years 8 weeks
17 Add HighwaterMarkOffset to OffsetFetchResponse 0 0 0 Grant Henke 10 years 14 weeks
14 Tools Standardization 0 0 0 Jiangjie Qin 10 years 17 weeks
6 New reassignment partition logic for rebalancing 0 0 0 Joe Stein 10 years 23 weeks