Simplifying Data Ingestion with Copy job – More File Formats with Enhancements
Copy job is the go-to solution in Microsoft Fabric Data Factory for simplified data movement, whether you’re moving data across clouds, from on-premises systems, or between services. With native support for multiple delivery styles, including bulk copy, incremental copy, and change data capture (CDC) replication, Copy job offers the flexibility to handle a wide range of data movement scenarios—all through an intuitive, easy-to-use experience.
Copy job helps you copy data across different formats—whether from databases or file stores. This post introduces several enhancements for copying data with file stores, including more file formats support (ORC, Excel, Avro, and XML) and enhanced CSV format support with Quote, Escape, and Encoding options.
More file formats support (ORC, Excel, Avro, and XML)
Now, Copy job supports even more file formats—including ORC, Excel, Avro, and XML—so you can move data from any source to any destination with greater flexibility. Whether you’re working with structured tables or semi-structured files, Copy job lets you seamlessly ingest, and distribute your data in the format that best fits your business and analytics needs.
Enhanced CSV Support: Quote, Escape, and Encoding Options
You can now configure Quote character, Escape character, and Encoding when moving data in CSV format using Copy job.
Capabilities
- Precisely control how text values and delimiters are handled, ensuring accurate data parsing.
- Escape quotes or delimiters within text fields to avoid broken records.
- Choose from a wide range of encoding formats—from UTF-8 and UTF-16 to regional encodings like BIG5, GB18030, and SHIFT-JIS—to ensure compatibility across global data sources and destinations.
This enhancement gives you the flexibility to handle any CSV structure, maintain data fidelity, and enable seamless cross-system integration.
Additional Resources
To learn more, explore Microsoft Fabric Copy job documentation.
Submit your feedback on Fabric Ideas and join the conversation in the Fabric Community.
To get into the technical details, check out the Fabric documentation.
If you have a question or want to share your feedback, please leave us a comment.
