0.5.3

• [Enhancement] #55 Replace parquet-tools with parquet-avro
• [Enhancement] #57 Upgrade hadoop-common library to resolve CVE-2021-37404

gem

• https://rubygems.org/gems/embulk-output-s3_parquet/versions/0.5.3-java

Changes

• 0.5.2...0.5.3

0.5.2

• [Fix] #51 Use PluginClassLoader when oparating catalog.

gem

• https://rubygems.org/gems/embulk-output-s3_parquet/versions/0.5.2-java

Changes

• 0.5.1...0.5.2

0.5.1

• [Fix] #47 Use lower case without any space for Glue data type.

gem

• https://rubygems.org/gems/embulk-output-s3_parquet/versions/0.5.1-java

Changes

• 0.5.0...0.5.1

0.5.0

• [New Feature] #45 Introduce the new usage of column_options.logical_type, type_options.logical_type to configure more detailed logical types.
• [Deprecated] #45 The old usage of column_options.logical_type, type_options.logical_type is deprecated. Use column_options.converted_type, type_options.converted_type instead.
• [New Feature] #45 Support casting boolean, double, string, timestamp, json to the int logical type.
• [New Feature] #45 Support casting long to the timestamp logical type.
• [New Feature] #45 Support the decimal logical type. (close #44)
• [New Feature] #45 Support the time logical type.
• [New Feature] #45 Support the date logical type.
• [New Feature] #45 Support is_adjusted_to_utc = false for the timestamp logical type.
• [Fix] #45 Fix the issue 'Logical type int{8,16,32} don't work' (close #43)
• [Enhancement] Add lots of tests.

gem

• https://rubygems.org/gems/embulk-output-s3_parquet/versions/0.5.0-java

Changes

• 0.4.2...0.5.0

0.4.2

• [Enhancement] #40 Check combinations with embulk-type and logical-type strictly.

gem

• https://rubygems.org/gems/embulk-output-s3_parquet/versions/0.4.2-java

Changes

• 0.4.1...0.4.2

0.4.1

• [Enhancement] #37 Rewrite the integration tests to make writing and reading tests easier & Use Diagrams for all test cases.
• [Enhancement] #38 Make all column types enable to use LogicalTypeHandler.
• [Enhancement] #38 Make parquet schema testable.
• [New Feature] #38 Support timestamp-nanos.

gem

• https://rubygems.org/gems/embulk-output-s3_parquet/versions/0.4.1-java

Changes

• 0.4.0...0.4.1

0.4.0

• [Enhancement] #35 Fix deprecation warnings.

gem

• https://rubygems.org/gems/embulk-output-s3_parquet/versions/0.4.0-java

Changes

• 0.3.0...0.4.0

0.3.0

• [Enhancement] #27 Github Actions releases automatically when a new release tag pushed instead of releasing from local.
  • [HotFix] #29 Do not skip the CI when a tag is pushed.
• [Enhancement] #28 Apply the "org.embulk.embulk-plugins" Gradle plugin.

gem

• https://rubygems.org/gems/embulk-output-s3_parquet/versions/0.3.0-java

Changes

• 0.2.0...0.3.0

0.2.0

• [Enhancement] #23 Limit the usage of swapping ContextClassLoader
• [BugFix] #24 Use basic credentials correctly
• [Enhancement] #20 Update gradle 4.1 -> 6.1
• [Enhancement] #20 Update parquet-{column,common,encoding,hadoop,jackson,tools} 1.10.1 -> 1.11.0 with the latest parquet-format 2.4.0 -> 2.7.0
  • parquet-format CHANGELOG
  • parquet-mr CHANGELOG
• [Enhancement] #20 Update aws-java-sdk 1.11.676 -> 1.11.739
• [Enhancement] #20 Update embulk 0.9.20 -> 0.9.23 with embulk-deps-{config,buffer}
• [Enhancement] #19 Use scalafmt instead of the Intellij formatter.
• [Enhancement] #19 Use scalafmt in CI.
• [Enhancement] #19 Enable to run examples locally with some prepared scripts.

gem

• https://rubygems.org/gems/embulk-output-s3_parquet/versions/0.2.0

0.1.0

• [New Feature] Support Logical Types older representations(OriginalTypes) #12
• [Enhancement] Add Github Actions CI settings #13
• [Enhancement] Support LogicalTypes for Glue Data Catalog #14
• [Enhancement] Update dependencies #15
• [New Feature] Support auth_method: web_identity_token #15

rubygems: https://rubygems.org/gems/embulk-output-s3_parquet/versions/0.1.0