Skip to content

Latest commit

 

History

History
46 lines (35 loc) · 4.32 KB

README.md

File metadata and controls

46 lines (35 loc) · 4.32 KB

FabricRTI_Accelerator

Introduction

Real-Time Intelligence is a powerful service in Microsoft Fabric that empowers everyone in your organization to extract insights and visualize their streaming and high granularity data in real time. It offers an end-to-end solution for event-driven scenarios, streaming data, and data logs. Whether dealing with gigabytes or petabytes, all organizational data in motion converges in the Real-Time Hub. It seamlessly connects time-based data from various sources using no-code connectors, enabling immediate visual insights, geospatial analysis, and trigger-based reactions that are all part of an organization-wide data catalog. Once you seamlessly connect any stream of data, the entire SaaS solution becomes accessible. Real-Time Intelligence handles data ingestion, transformation, storage, analytics, visualization, tracking, AI, and real-time actions. Your data remains protected, governed, and integrated across your organization, seamlessly aligning with all Fabric offerings. Real-Time Intelligence transforms your data into a dynamic, actionable resource that drives value across the entire organization.

Read more

Overview

This project aims to provide easy, Low code and automated way of deploying Real-Time intelligence workload and its entities in Microsoft Fabric. This removes the hassle of manually creating each item and entities when you want to move from one environment or workspace to another. Users can run the PowerShell script along with required parameters to provision automatically -

  • Eventhouse, KQL Database and it's entities like Tables, Functions and Materialized Views.
  • Eventstream with definition of source, processing and destination.

Full List of Fabric APIs

Currently Eventhouse and Eventstream accelerators are added in this project. Look out for accelerators for Activator as soon as the APIs are available. Jump to the relavent section by using the links below

Eventstream

Eventstream APIs Docs

Instructions

To create Eventstream with definition of source , destination and processing, run the PowerShell script with following parameters

Parameter Mandatory? Description
tenantId Yes Tenant ID of your Fabric tenant
workspaceId Yes Workspace ID where you want to create Eventstream
eventstreamCreateFileName Yes Filename of json which contains definition placed in same folder as this script

Please follow the steps below in order to create the right payload for Eventstream definition

  • Use the EventstreamDefinition.json file as a base to create the source, destination and processing blocks. You can use the samples present in Eventstream definition github repo to further modify each definition. A test definition file is also provided in this repo - EventstreamDefinition.json . This creates a Eventstream with the name AutoDeployES2 with Bicycle Sample data as source and an already created Eventhouse as destination.

  • Once the definition is ready, use https://www.base64encode.org/ to encode it into base64 string.

  • Use this string as part of "payload" in EventstreamCreate.json . A place holder for pasting the above base64 definition is given in the example file provided in this repo.

  • Make sure you have the Eventstream create file(EventstreamCreate.json) with definition in the same folder as the Powershell script.

  • The script will open an interactive login window and then ask for a selection of tenant and subscription (Yes! You must select subscription although you are working with Fabric).

  • Run the script

.\createEventstream.ps1 -tenantId 'xxxxxx-yyyy-aaaa-bbbb-aaaaaaaaa'  -workspaceId 'xxxxx-yyyy-yyyy-aaaa-aaaaaaaaaaaa' -eventstreamCreateFileName 'EventstreamCreate.json'

  • Example of Eventstream created along with defined topology

    Eventstream