The only things remotely related to that I've seen are KIP-47 (cwiki.apache.org/confluence/d... which is really old and still open) to allow for event deletion based on event time. And KIP-280 (cwiki.apache.org/confluence/d...) for compaction
The only things remotely related to that I've seen are KIP-47 (cwiki.apache.org/confluence/d... which is really old and still open) to allow for event deletion based on event time. And KIP-280 (cwiki.apache.org/confluence/d...) for compaction
If I've got an uncompacted topic and its `retention.ms` (kafka.apache.org/documentatio...) is set to 24 hours, segments older than 24 hours can be dropped.
If I've got an uncompacted topic and its `retention.ms` (kafka.apache.org/documentatio...) is set to 24 hours, segments older than 24 hours can be dropped.
<(kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list "<broker>" --topic "<topic>" --time -2) \
| awk -F'[:\t]' '{ sum += ($3 - $6) } END {printf "%.0f\n", sum}'
<(kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list "<broker>" --topic "<topic>" --time -2) \
| awk -F'[:\t]' '{ sum += ($3 - $6) } END {printf "%.0f\n", sum}'