Confluent Kafka topic streaming with Schema Registry

57d6210a16b5dd0062d8 · September 16, 2024, 9:03pm

I’m trying to stream data from my confluent kafka cluster into Foundry. The confluent kafka topic has a schema registry associated with it but there is no way to specify the schema registry credentials in the default Kafka source in the foundry data connection. How can I go about implementing this?

As of right now, when I specify the bootstrap url of the cluster and the SASL credentials, I’m able to list the topics on the cluster inside foundry, but it is unable to preview any data/messages inside those topics (I see. 0 rows). I’m not sure what is wrong.

Any help would be appreciated!

rkasar · September 16, 2024, 10:21pm

Try the more options section

57d6210a16b5dd0062d8 · September 17, 2024, 12:49am

I’m trying the agentless way (direct connection). Is there a way to add this using the direct connection?

rkasar · September 17, 2024, 4:41pm

Yes, in the same more options section

57d6210a16b5dd0062d8 · September 17, 2024, 7:10pm

I dont see that option on my Foundry instance. I only see the option to configure client/server certificates. Is it located somewhere else?