I’m creating a pipeline which connects to Kafka. The topic has messages. the metadata is fetched successfully (There is broker connectivity) but the Pipeline fails to create with the following error message:
Subprocess timed out because no data was received from source in pipelines_extractor_idle_timeout_ms ms. Stderr:
2020-09-14 10:51:26.943 Batch starting with new consumer.
Here’s my pipeline code:
CREATE
PIPELINE my_pipeline
AS
LOAD DATA KAFKA ‘172.18.0.1/my-topic’
SKIP DUPLICATE KEY ERRORS
INTO TABLE s2FORMAT AVRO
( tenant_id ← %::id )
SCHEMA
‘{
“doc”: “my message”,
“fields”: [
{
“doc”: “My Id”,
“name”: “id”,
“type”: “int”
}
]
}’