Introducing Open Mirroring in Microsoft Fabric
As mentioned in Arun’s blog post, we are thrilled to announce Open Mirroring in Microsoft Fabric is now publicly available.
Mirroring in Fabric provides a modern way of accessing and ingesting your existing data estate continuously and seamlessly from any database or data warehouse into OneLake in Microsoft Fabric.
Open Mirroring in Fabric is designed to be extensible, customizable, and open. It is a powerful feature that extends Mirroring in Fabric based on open Delta Lake table format. This capability enables any applications and data ISVs to write change data directly into a Mirrored Database in Microsoft Fabric based on the open mirroring public Apis and approach.
Once the data lands in OneLake in Fabric, Open Mirroring simplifies the handling of complex data changes, ensuring that all mirrored data is continuously up-to-date and ready for analysis.
We are excited to see many of our industry-leading partners, streamlining delivery of mirroring solutions in Fabric with announcement to integrate their data solution into Open Mirroring. Our Open Mirroring partner ecosystem continues to grow with publicly available solutions from Striim, Oracle Golden Gate, and MongoDB, with DataStax’s solution coming soon.
Let’s dive into this amazing new capability in Microsoft Fabric!
Simplifies building custom mirroring solutions with Open Mirroring in Microsoft Fabric
With Mirroring in Fabric, you can enjoy a highly integrated, end-to-end, and easy-to-use product that is designed to simplify your analytics needs, with a direct connection to the source.
Open Mirroring in Fabric extends the Mirroring in Fabric capability to provide you the choice to build your own custom mirroring solutions based on Open Mirroring Landing Zone requirements and formats or leverage existing Open Mirroring partner solutions to land data into a mirrored database’ landing zone within OneLake in Fabric. Once the data lands in the landing zone, Mirroring’s replication engine continuously manages the complexity of CDC processing and convert all changes into delta tables that are ready to be consumed by all the experiences in Fabric.
Streamlining delivery of mirroring solutions in Fabric with Open Mirroring partners ecosystem
Since our announcement of Mirroring being publicly available to our customers, we have been hard at work with our lighthouse partners to build custom mirroring solutions that integrates into Open Mirroring in Microsoft Fabric.
Here is what our lighthouse partners are saying about Open Mirroring…
- “Striim, a strategic data partner for Microsoft Fabric, has introduced a cutting-edge real-time data integration and streaming service designed to drive AI-powered insights within Microsoft’s next-generation data platform. With seamless integration into Fabric services like Mirroring, Striim offers robust continuous data replication and integrated governance to protect sensitive PII data. With Striim’s real-time streaming and transformation capabilities with Fabric’s scalable platform, businesses can securely access immediate AI insights and speed up critical decision-making.” Codin Pora, VP Partner Technology, Striim
- “In the modern era of data analytics where AI and BI come together as a unified data platform, Oracle GoldenGate and Microsoft Fabric are working together to provide deep integrations for real-time use cases. Our goal is to help mutual customers realize the benefits of a real-time data fabric that seamlessly integrates their operational data stores all the way through to their AI, ML and Analytic solutions. I am very excited for our existing certifications as well as the innovations our partnership will bring in the coming years.” Jeff Pollock, Vice President of Product Management, Oracle GoldenGate
- “MongoDB has collaborated extensively with the Microsoft Fabric team to enable real-time ingestion of transactional data from MongoDB Atlas to OneLake using Open Mirroring. This integration empowers customers leveraging MongoDB Atlas as their operational and vector database to easily extract real-time insights and power the next generation of AI application.” Abhinav Mehla, RVP, Worldwide Cloud Partners at MongoDB
- “We’re excited to partner with the Microsoft Fabric Mirroring team to simplify data analysis for developers by integrating Astra and Apache Cassandra data directly into OneLake. This collaboration empowers enterprises to leverage Fabric Copilot for deeper insights, enabling data-driven decisions on the very application data that drives their business operations.” Davor Bonaci, Chief Technology Officer, DataStax
Today, we are proud to present the following partner mirroring solutions available in our Open Mirroring ecosystem to bring your data estate into OneLake in Microsoft Fabric.
Real-time replication from on-premises SQL Server to Microsoft Fabric via Open Mirroring for fast and seamless unified analytics.
Any supported Oracle GoldenGate source including Oracle Database@Azure can replicate data to Mirrored Database in Microsoft Fabric. This powerful combination unlocks real-time data integration, continuously synchronizing data across your hybrid and multicloud environments.
Mirroring solution for customers who are looking to bring operational data from MongoDB Atlas to Microsoft Fabric for Big data analytics, AI and BI, combining it with the rest of the data estate of the enterprise.
Accelerate data potential with your data estate in OneLake with a custom mirroring solution
Once your data estate is mirrored with a custom mirroring solution, any mirrored database can be queried and cross joined with other mirrored databases, warehouses, or lakehouses in Fabric. As every analytics workload in Fabric works seamlessly with OneLake, your data in OneLake can be used with Notebooks to analyze and create models, while building Power BI reports and semantic models quickly and efficiently.
Free Mirroring Storage for Replicas in OneLake
Same as to all Mirroring, Open Mirroring storage for replicas is free providing generous amounts (terabytes) of storage based on the capacity size. This enables your organization to focus on finding valuable analytics scenarios unlocked by Mirroring. For example, if you purchase an F64 capacity, you get 64 free terabytes worth of storage exclusively for mirroring. OneLake storage is billed only when the free Mirroring storage limit is exceeded, or the capacity is paused.
In addition, the compute needed to manage the complexity of change data is free and it does not consume capacity. Requests to OneLake as part of the mirroring process will consume capacity like normal with OneLake compute consumption.
Learn more about Mirroring and OneLake storage pricing Microsoft Fabric – Pricing.
Mirroring in Microsoft Fabric Announcements and Roadmap
Today, in addition to the exciting announcement of Open Mirroring in Microsoft Fabric is now publicly available, we are also proud to announce the general availability of Mirroring for Azure SQL DB and Mirroring for Azure SQL MI in preview.
Together with Mirroring for Snowflake, Azure SQL DB, Azure Cosmos DB, Azure SQL MI and many more sources to be added, you can leverage the same mirroring technology and trivial setup to automatically reflect your data estate into OneLake in Microsoft Fabric.
We also love to learn about your ideas and what you need to run Mirroring in your production workload, add your ideas Fabric Ideas.
Finally, please stay tuned to our Mirroring roadmap for new data sources and feature updates.
