In Part I, I went over the overview of use cases, scale, ingestion and storage. In Part II, I will cover the real-time streaming of data to longer-term storage for analytics. I will also go over the configuration of Power BI for real-time Q&A analytics.

Data Movement

Once the data arrives in an Event Hub, it won’t stay for long. Event Hubs have a configurable retention period of 1-7 days, so you need to “read” the data out fairly quickly. To do this, you need a service that can scale to millions of records per second and offer the flexibility to interpret the data along the way by minor forms of aggregation. For this, Azure Stream Analytics is the perfect solution.