Please enter your information to subscribe to the Microsoft Fabric Blog.

Thanks for subscribing to the Microsoft Fabric Blog. You’ll receive email notifications when we publish new posts.

Microsoft Fabric Updates Blog

  1. Updates
  2. Jianlei Shen

Copy data to Amazon S3 & Amazon S3 Compatible via Fabric Data Factory Data Pipeline

We are happy to announce that copying data to Amazon S3 and Amazon S3 Compatible is now available in Data pipeline of Fabric Data Factory! You can use Copy assistant and Copy activity in your Data pipeline to finish this data movement.  

How to create Amazon S3 & Amazon S3 Compatible connection 

You can create an Amazon S3/Amazon S3 Compatible connection directly through Copy assistant or Copy activity destination tab. 

In Copy assistant

Amazon S3 and Amazon S3 Compatible are now available when creating new connections with the Copy assistant.

In Data pipeline

Create a new connection to Amazon S3 and Amazon S3 Compatible in your Copy data activity.
A pop-up allows you to select a new connection to Amazon S3 and Amazon S3 Compatible.

How to configure the copy destination for Amazon S3 & Amazon S3 Compatible 

To copy data directly to Amazon S3/Amazon S3 Compatible, specify the data destination folder path (required) and the file name.

If you use the Copy activity in your Data pipeline, specify the File format (required) for the destination data. Meanwhile, you can choose to use advanced features to improve copy flexibility and performance. There are options for Copy behavior that allows you to define the copy behavior when the source is a file from a file-based data store, and Max concurrent connections that allows you to indicate the upper limit of concurrent connections established to the data store during the activity run.  

For more details about the copy destination configuration, read Configure Amazon S3 in a copy activity – Microsoft Fabric | Microsoft Learn and Configure Amazon S3 Compatible in a copy activity – Microsoft Fabric | Microsoft Learn. 

Have any questions or feedback? Leave a comment below!

Related blog posts

Copy data to Amazon S3 & Amazon S3 Compatible via Fabric Data Factory Data Pipeline

Blog's featured image

Microsoft Fabric Lifecycle Management: Getting started with development in isolation using a Private Workspace
June 24, 2024 by Justin Barry

When we talk about Microsoft Fabric workspace collaboration, a common scenario is developers and their teams using a shared workspace environment, which means they have access to “live items”. A change made directly within a workspace would override and affect all other developers or users utilizing that workspace. This is where git becomes increasingly important … Continue reading “Microsoft Fabric Lifecycle Management: Getting started with development in isolation using a Private Workspace”

Read more
Blog's featured image

Mastering Enterprise T-SQL ETL/ELT: A Guide with Data Warehouse and Fabric Pipelines
June 21, 2024 by Marc Bushong

Developing ETLs/ELTs can be a complex process when you add in business logic, large amounts of data, and the high volume of table data that needs to be moved from source to target. This is especially true in analytical workloads involving relational data when there is a need to either fully reload a table or incrementally update a table. Traditionally this is easily completed in a flavor of SQL (or name your favorite relational database). But a question is, how can we execute a mature, dynamic, and scalable ETL/ELT utilizing T-SQL with Microsoft Fabric? The answer is with Fabric Pipelines and Data Warehouse.

Read more