Unable to connect to kafka topic

Help Connectors and Pipelines
1

Hi,

I created a pipeline which will connect to Kafka topic and load the data into table.

CREATE PIPELINE mypipeline3 AS
LOAD DATA KAFKA ‘ec2-********.compute-1.amazonaws.com:9092/memsqltest’
INTO TABLE memsqltest
FORMAT JSON
(a <- a default NULL,
b <- b default NULL,
c <- c default NULL,
d <- d default NULL)

Getting an error
ERROR 1933 (HY000): Cannot get offsets for pipeline mypipeline3 because ‘FAILURE’. Truncated stderr:
Timed out fetching metadata: err=-185 loop=1 time=10.000000 start_ts=1552902970
Timed out fetching metadata: err=-185 loop=2 time=10.000000 start_ts=1552902980
Timed out fetching metadata: err=-185 loop=3 time=10.000000 start_ts=1552902990
failed after timing out 3 times (metadata)

I verified troubleshooting documents and didn’t find any errors with this code. Our listener is updated in Kafka server properties.

Can anyone help on this?

Thanks
Arun

2

Besides the listener configuration in server.properties, you may also need to open incoming traffic on port 9092 in AWS security groups, and potentially in iptables (if your host is using that).

3

Thank you. After I added host details in the /etc/hosts file then it started working fine.