Shortcut cache and on-prem gateway support are now generally available (GA) Shortcut cache Shortcuts in OneLake allow you to quickly and easily source data from external cloud providers and use it across all Fabric workloads such as Power BI reports, SQL, Spark and Kusto. However, each time these workloads read data from cross-cloud sources, the … Continue reading “Shortcut cache and on-prem gateway support (Generally Available)”
Shortcuts in OneLake provide a quick and easy way to make your data available in Fabric without having to copy it. Simply create a new shortcut and your data is instantly available to all Fabric workloads. When you first create a new shortcut, you also set up a shared cloud connection. These are the same connections … Continue reading “Manage connections for shortcuts”
You now have the capability with service principals to create shortcuts to Azure Data Lake Storage (ADLS) Gen2 storage accounts that have firewall enabled. Previously, the creation of ADLS Gen2 shortcuts by service principals was restricted when firewall settings were active. However, with the latest changes, service principals will be able to navigate these restrictions … Continue reading “Use Service Principals to create shortcuts to ADLS Gen2 storage accounts with trusted access”
Co-Author – Gyani Sinha, Abhishek Narain Overview A well-architected lakehouse enables organizations to efficiently manage and process data for analytics, machine learning, and reporting. To achieve governance, scalability, operational excellence, and optimal performance, adopting a structured, metadata-driven approach is crucial for lakehouse implementation. Building on our previous blog, Demystifying Data Ingestion in Fabric, this post … Continue reading “Playbook for metadata driven Lakehouse implementation in Microsoft Fabric”
Introducing predefined Spark resource profiles in Microsoft Fabric—making it easier than ever for data engineers to optimize their compute configurations based on workload needs. Whether you’re handling read-heavy, write-heavy, or mixed workloads, Fabric now provides a property bag-based approach that streamlines Spark tuning with just a simple setting. With these new configurations, users can effortlessly … Continue reading “Supercharge your workloads: write-optimized default Spark configurations in Microsoft Fabric”
