In today’s world, cleaning and transforming data is incredibly important. Clean data means removing errors, duplicates, and irrelevant information to ensure its correct and complete, making the data more trustworthy for analysis. Transforming data means changing it into a format that is easy to use and analyze. Together, these steps improve data quality, leading to … Continue reading “Enhancing data quality with Copilot for Data Factory”
Introduction In the era of digital transformation, managing and analyzing log files in real-time is essential for maintaining application health, security, and performance. There are many 3rd party solutions in this area allowing collecting/processing storing, analyzing and acting upon this data source. Sometimes as your systems scale, those solution can become very costly, their cost … Continue reading “Efficient log management with Microsoft Fabric”
A couple of weeks ago we had such an exciting week for Fabric during the Ignite Conference, filled with several product announcements and sneak previews of upcoming new features. Thanks to all of you who participated in the conference, either in person or by being part of the many virtual conversations through blogs, Community forums, … Continue reading “Data Factory Announcements at Ignite 2024 Recap”
We are excited to announce the preview availability of REST APIs for connections and gateways in Microsoft Fabric. These new APIs provide developers with powerful tools to programmatically manage and interact with connections and gateways within the Fabric ecosystem. Connections REST API The Connections REST API allows you to create, retrieve, update, and delete connections … Continue reading “Announcing the Availability of REST APIs for Connections and Gateways in Microsoft Fabric”
We’ve made a significant enhancement in Fabric Data Factory: Data pipeline can now write data in Iceberg format via the Azure Data Lake Storage (ADLS) Gen2 connector! This addition provides a powerful new option for users who need to manage and optimize large datasets with a high level of flexibility, reliability, and performance. Iceberg format … Continue reading “Fabric Data Factory now supports writing data in Iceberg format via Azure Data Lake Storage Gen2 Connector in Data pipeline”
