Skip to content Skip to sidebar Skip to footer
Showing posts with the label Apache Kafka
Not Able To Access Messages From Confluent Kafka On Ec2

Not Able To Access Messages From Confluent Kafka On Ec2

Post a Comment
Confluent Kafka 5.0.0 has been installed on AWS EC2 which has Public IP say 54.XX.XX.XX Opened port… Read more Not Able To Access Messages From Confluent Kafka On Ec2
Spark Streaming: Read Csv String From Kafka, Write To Parquet

Spark Streaming: Read Csv String From Kafka, Write To Parquet

Post a Comment
There are lots of online examples of reading json from Kafka (to write to parquet) - but I cannot f… Read more Spark Streaming: Read Csv String From Kafka, Write To Parquet
Pyspark Structured Streaming From Kafka Does Not Output To Console For Debugging

Pyspark Structured Streaming From Kafka Does Not Output To Console For Debugging

Post a Comment
Below is my code. I have tried many different select variations, and yet the app runs, but without … Read more Pyspark Structured Streaming From Kafka Does Not Output To Console For Debugging
No Module Named 'pyspark.streaming.kafka' Even With Older Spark Version

No Module Named 'pyspark.streaming.kafka' Even With Older Spark Version

Post a Comment
In another similar question, they hint 'install older spark 2.4.5.' EDIT: the solution from… Read more No Module Named 'pyspark.streaming.kafka' Even With Older Spark Version
How To Produce A Tombstone Avro Record In Kafka Using Python?

How To Produce A Tombstone Avro Record In Kafka Using Python?

Post a Comment
my sink properties : { 'name': 'jdbc-oracle', 'config': { 'conn… Read more How To Produce A Tombstone Avro Record In Kafka Using Python?
Nobrokersavailable: Nobrokersavailable-kafka Error

Nobrokersavailable: Nobrokersavailable-kafka Error

Post a Comment
i have already started to learn Kafka. Trying basic operations on it. I have stucked on a point whi… Read more Nobrokersavailable: Nobrokersavailable-kafka Error