Apache Kafka
Bring messages from an Apache Kafka topic into DataOS
This guide brings messages from an Apache Kafka topic (a stream of events your systems publish) into DataOS.
apache.org
?
What you need
A Kafka username and password (only if your Kafka needs sign-in)
Who can get it
Your Kafka administrator
Where data lands
A governed table in your DataOS lakehouse
Connection type
Streaming
How the connection works
?
Source
Apache Kafka
DataOS connector
Keeps it up to date
DataOS lakehouse
Governed data product
The connector signs in to your Kafka servers, reads the new messages from one topic, and adds them to a table in DataOS. It remembers where it stopped, so each message is read once.
What's next
Ready to bring this data into DataOS?
