Skip to content

Conversation

shishaochen
Copy link

@shishaochen shishaochen commented Nov 5, 2019

Aligning with org.tensorflow.hadoop.io.TFRecordFileOutputFormat, enable compression in org.tensorflow.hadoop.io.TFRecordFileOutputFormatV1 as well.
To activate compression in old MapReduce APIs, simply specify options as below:

-Dmapred.output.compress=true
-Dmapred.output.compression.codec=org.apache.hadoop.io.compress.GzipCodec

This pull request can be considered as supplementary to #61.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants