Backend Mystery · Card #40
How do you develop a backend system for handling IoT device data streams?
A real-time data capture and processing architecture would require the following components:
- Use a scalable data ingestion service such as Kafka or AWS Kinesis that is compatible with one of the many IoT standard protocols (like MQTT or CoAP).
- Process the data through real-time processing engines such as Apache Flink or Spark Streaming.
- Store the data inside a scalable data lake, ideally a time-series compatible system such as InfluxDB.
data system-design