Microsoft Fabric Updates Blog

Delta-RS introduces native support for OneLake 

Delta-RS, the native Rust library for DeltaLake, now supports OneLake, enabling partners to directly manage their lakehouses in OneLake using Delta-RS!  As the single data lake for all Fabric tenants, it is imperative that OneLake enables organizations to use their tool, language, and package of choice to manage their data.  This is especially true for tools and packages supporting Delta Lake, the backbone of Fabric’s data and table management. Delta-RS is also used by a multitude of other packages and libraries, such as Polars, a highly performant DataFrame library.  

While OneLake was built to have full parity with any code compatible with ADLS Gen2, some tools use URL validation to help protect customer code, ensuring that all URL calls match the expected ADLS Gen2 format.  Because OneLake uses a different URL scheme than ADLS Gen2 (fabric.microsoft.com vs core.windows.net), this has the unfortunate side effect of blocking OneLake URLs completely, as was the case with Delta-RS.   

The OneLake team worked with the Delta-RS community to help introduce support for recognizing OneLake URLs in both Delta-RS and the Rust Object Store, which Delta-RS had a dependency on. Now both libraries can recognize OneLake URLs and handle them identically to ADLS Gen2, providing easy integration with OneLake without interrupting functionality.  

What’s next for OneLake?

To learn more about how to access OneLake, check out the OneLake documentation.  The OneLake team is dedicated to ensuring full compatibility with all tools and libraries currently compatible with ADLS Gen2. The OneLake team will continue working with the open-source community to help address issues with OneLake compatibility.  If you’re experiencing issues interaction with OneLake from your tool of choice, please let us know at aka.ms/fabricideas

Relaterade blogginlägg

Delta-RS introduces native support for OneLake 

oktober 4, 2024 från Jason Himmelstein

We had an incredible time in our host city of Stockholm for FabCon Europe! 3,300 attendees joined us from our international community, and it was wonderful to meet so many of you in person. Throughout the week of FabCon Europe, our teams published a wealth of valuable content, and we want to ensure you have … Continue reading “Fabric Community Conference Europe Recap”

september 30, 2024 från Matt Basile

You can now delegate access to OneLake using short-lived OneLake shared access signatures (SAS). OneLake SAS make it easy to provide limited access to applications which may not support Microsoft Entra, as well as support applications serving as proxy layers between users and their data in OneLake. OneLake SAS follow security best practices for delegated … Continue reading “OneLake shared access signatures (SAS) now available in public preview”