Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Ask INFA.
Not Found
English

Page Not Found

The page or file you are looking for has been moved or no longer exists.

The following links might help you find the content you need:


You can also search the Documentation Portal or visit the home page.

English
  • Data Integration Connectors
  • All Products

Table of Contents

Search

  1. Introduction to Amazon S3 V2 Connector
  2. Amazon S3 V2 connections
  3. Amazon S3 V2 sources and targets
  4. Mappings and mapping tasks with Amazon S3 V2
  5. Migrating a mapping
  6. Upgrading to Amazon S3 V2 Connector
  7. Data type reference
  8. Troubleshooting

Amazon S3 V2 Connector

Amazon S3 V2 Connector

Back Next

Data compression in Amazon S3 V2 sources and targets

Data compression in Amazon S3 V2 sources and targets

You can decompress data when you read data from Amazon S3
and compress the data when you write data to Amazon S3
.
The following table lists the supported source compression formats:
Compression format
Avro File
Binary File
1
Flat
JSON File
2
ORC File
Parquet File
None
Yes
No
Yes
Yes
Yes
Yes
Bzip2
No
No
No
Yes
No
No
Deflate
Yes
No
No
No
No
No
Gzip
No
No
Yes
No
No
Yes
Lzo
No
No
No
No
No
No
Snappy
Yes
No
No
No
Yes
Yes
Zlib
No
No
No
No
Yes
No
Binary File support doesn't apply to mappings in advanced mode, while the JSON File support applies only to mappings in advanced mode.
The following table lists the supported target compression formats:
Compression format
Avro File
Binary File
1
Flat
JSON File
2
ORC File
Parquet File
None
Yes
No
Yes
Yes
Yes
Yes
Bzip2
No
No
No
Yes
No
No
Deflate
Yes
No
No
Yes
No
No
Gzip
No
No
Yes
Yes
No
Yes
Lzo
No
No
No
No
No
No
Snappy
Yes
No
No
Yes
Yes
Yes
Zlib
No
No
No
No
Yes
No
1
Doesn't apply to mappings in advanced mode.
2
Applies only to mappings in advanced mode.
Configure the compression format in the
Compression Format
 option under the advanced source
and target
 properties.
For the Avro, ORC and Parquet file formats, the support for the following compression formats are implicit even though these compression formats do not appear in the
Compression Format
 option under the advanced source property:
Compression format
Avro File
ORC File
Parquet File
Deflate
Yes
No
No
Snappy
Yes
Yes
Yes
Zlib
No
Yes
No
0 COMMENTS
We’d like to hear from you!