Incorrect numInputRows values even with row limits set per batch

Problem You are running an Apache Spark streaming query and reading data from Kafka streams when you encounter an issue with the  numInputRows metric. The  numInputRows metric displays an incorrect value, showing a significantly higher number of rows than expected. This is true even when configurations such as  maxOffsetsPerTrigger are set to limit ...

0 min reading time