In today’s world, cleaning and transforming data is incredibly important. Clean data means removing errors, duplicates, and irrelevant information to ensure its correct and complete, making the data more trustworthy for analysis. Transforming data means changing it into a format that is easy to use and analyze. Together, these steps improve data quality, leading to … Continue reading “Enhancing data quality with Copilot for Data Factory”
The Microsoft Fabric API for GraphQL is a handy service that lets you quickly set up a GraphQL API to pull data from places like Data Warehouses, Lakehouse, and Mirrored Databases. It comes with an in-browser tool for writing and testing your queries and mutations that can work with tables, views and stored procedures. In this blog post, I shall cover what are some of best practices when building applications using Fabric API for GraphQL.
Introduction In the era of digital transformation, managing and analyzing log files in real-time is essential for maintaining application health, security, and performance. There are many 3rd party solutions in this area allowing collecting/processing storing, analyzing and acting upon this data source. Sometimes as your systems scale, those solution can become very costly, their cost … Continue reading “Efficient log management with Microsoft Fabric”
The Fabric Livy endpoint lets users submit and execute their Spark code on the Spark compute within a designated Fabric workspace, eliminating the need to create a Notebook or Spark Job Definition artifacts. This integration with a specific Lakehouse artifact ensures straightforward access to data stored on OneLake. Additionally, Livy API offers the ability to … Continue reading “Announcing the preview of the REST API for Livy for Data Engineering.”
As announced in the previous blog post on this topic, the Fabric Apache Spark Diagnostic Emitter for Logs and Metrics has recently entered preview, enabling you to emit Spark logs and metrics to various Azure destinations. In this blog post, you will learn how to build a centralized Spark monitoring solution, leveraging Fabric Real-Time Intelligence capabilities. … Continue reading “Monitor Fabric Spark applications using Fabric Real-Time Intelligence”
