Shortcut cache and on-prem gateway support (Generally Available)
Shortcut cache and on-prem gateway support are now generally available (GA)
Shortcut cache
Shortcuts in OneLake allow you to quickly and easily source data from external cloud providers and use it across all Fabric workloads such as Power BI reports, SQL, Spark and Kusto. However, each time these workloads read data from cross-cloud sources, the source provider (AWS, GCP) charges additional egress fees on the data. Thankfully, shortcut caching allows the data to only be sourced once and then used across all Fabric workloads without additional egress fees.
With the general availability for cross-cloud shortcut cache, new capabilities have been added as well. You now have the ability to define the retention period for your shortcut cache. Previously, data was only cached for 24hr, with these updates, you can select a retention period from 1-28 days. This greatly improves the effectiveness and cost savings of cache for sources that are not accessed every day.
To set the retention period for your shortcut cache, simply open your workspace settings, select the OneLake, ensure the shortcut cache is enabled, then choose the retention period from the dropdown menu.
The OneLake workspace settings now also allow you to reset your shortcut cache. If for any reason you need to reset your cache, simply open the workspace settings, choose the OneLake tab and click the Reset cache button. This will remove all cached data for shortcuts within the workspace.
Resetting your workspace cache can also be performed through our public APIs. This enables programmatic access and the ability to automate processes. For API details, refer to the OneLake Shortcuts – Reset Shortcut Cache documentation.
To learn more about Shortcuts and how caching works, refer to the OneLake Shortcuts documentation.
On-Premises Gateway
On-premises gateway support for shortcuts is also generally available. The on-premises gateway allows you to securely connect to your data through multiple network restricted scenarios.
Hybrid-Cloud
Setting up the on-premises gateway on your corporate network allows you to access your on-premises storage systems such as NetApp, Dell, Qumulo and many more. Take full advantage of Fabric’s data analytics and reporting capabilities without having to migrate all of your data and other processes to the cloud.
Cross-Cloud
You can also configure the on-premises gateway to operate inside of other cloud providers such as AWS and GCP. This enables Fabric to access data from these providers even when a virtual private cloud (VPC) is configured.
As part of this GA release, we have also added shortcut caching support for the On-Premises gateway. It helps to reduce egress costs when sourcing data across cloud providers and helps to improve performance when sourcing data from on-premises storage systems.
To learn more about setting up the on-premises gateways for use with shortcuts, refer to the Create shortcuts to on-premises data guide. Submit your feedback on Fabric Ideas and join the conversation on the Fabric Community.
