Skip to content

Latest commit

 

History

History
242 lines (150 loc) · 10.7 KB

CHANGELOG.md

File metadata and controls

242 lines (150 loc) · 10.7 KB
Raw

0.7.3 - 2024-08-28

  • [enhancement] Add TIME type conversion to string converter (Thanks to p-eye)

0.7.2 - 2024-07-21

  • [maintenance] Fix GitHub Actions #166
  • [maintenance] Fix gcs_client in order to load data using gcs_bucket parameter (Thanks to kashira202111) #164
  • [maintenance] Prevent creating unnecessary tables. (Thanks to kashira202111) #148

0.7.1 - 2024-03-4

  • [enhancement] Support description of columns and tables (Thanks to @kyoshidajp and @fagai ) #142
  • [maintenance] Add missing GitHub Actions environment setting. #160
  • [maintenance] Replace google-api-client with specific Google APIs (Thanks to @Nozomuts) #161
  • [maintenance] Update GitHub Actions use checkout@v4 and setup-java@v4 #162

0.7.0 - 2024-02-1

  • [enhancement] Add support Embulk 0.11.x

0.6.9 - 2023-03-16

  • [enhancement] Add SSLException to retry job (thanks to @mzumi)

0.6.8 - 2022-10-12

  • [enhancement] Support JSON type (thanks to @civitaspo )
  • [maintenance] Add an error message in order to retry (thanks to @mzumi)

0.6.7 - 2021-09-10

  • [enhancement] Add an expiration option of temporary table to clean up (thanks to @TKNGUE)

0.6.6 - 2021-06-10

  • [maintenance] Fix network retry function (thanks to @case-k-git)
  • [enhancement] Allow to specify the billing project and the project to which the data will be loaded separately (thanks to @ck-fm0211)
  • [enhancement] Include original error message on json parse error (thanks to @k-yomo)

0.6.5 - 2021-06-10

  • [maintenance] Fix failed tests (thanks to @kyoshidajp)
  • [maintenance] Lock representable version for avoiding requiring Ruby 2.4 (thanks to @hiroyuki-sato)

0.6.4 - 2019-11-06

  • [enhancement] Add DATETIME type conveter (thanks to @kekekenta)

0.6.3 - 2019-10-28

  • [enhancement] Add DATE type conveter (thanks to @tksfjt1024)

0.6.2 - 2019-10-16

  • [maintenance] Lock signet and google-api-client version (thanks to @hiroyuki-sato)

0.6.1 - 2019-08-28

  • [maintenance] Release a new gem not to include symlinks to make it work on Windows.

0.6.0 - 2019-08-11

Cleanup auth_method:

  • [enhancement] Support auth_method: authorized_user (OAuth)
  • [incompatibility change] Rename auth_method: json_key to auth_method: service_account (json_key is kept for backward compatibility)
  • [incompatibility change] Remove deprecated auth_method: private_key (p12 key)
  • [incompatibility change] Change the default auth_method to application_default from private_key because private_key was dropped.

0.5.0 - 2019-08-10

  • [incompatibility change] Drop deprecated time_partitioning.require_partition_filter
  • [incompatibility change] Drop prevent_duplicate_insert which has no use-case now
  • [incompatibility change] Modes replace, replace_backup, append, and delete_in_advance require auto_create_table: true now because, previously, these modes had created a target table even with auto_create_table: false and made users being confused. Note that auto_create_table: true is always required even for a partition (a table name with a partition decorator) which may not require creating a table. This is for simplicity of logics and implementations.
  • [incompatibility change] Change default value of auto_create_table to true because the above 4 modes, that is, except append_direct always require auto_create_table: true now.

0.4.14 - 2019-08-10

  • [enhancement] Support field partitioning correctly.

0.4.13 - 2019-03-20

  • [enhancement] Support clustered table as an experimental feature

0.4.12 - 2019-03-20

  • [maintenance] Fix time_partitioning.requirePartitionFilter was not working. Use time_partitioning.require_partition_filter (thanks to @gitetsu)

0.4.11 - 2019-03-07

  • [maintenance] Fix to use response.status.error_result instead of response.status.errors to check job failure status (thanks to @nownabe)

0.4.10 - 2018-11-08

  • [enhancement] Support column-based partition (thanks to Chi-Ruei Li)

0.4.9 - 2018-09-08

  • [enhancement] Enable object lifecycle management when creating buckets with auto_create_gcs_bucket (thanks to @potato2003)

0.4.8 - 2017-05-23

  • [enhancement] Support location option for auto_create_gcs_bucket option (thanks to @potato2003)

0.4.7 - 2017-05-02

  • [enhancement] Support location option to allow to use 'asia-northeast1' region

0.4.6 - 2017-04-17

  • [enhancement] Support auth_method 'application_default'

0.4.5 - 2017-04-04

  • [maintenance] Fix deprecated warning log condition for timeout_sec

0.4.4 - 2017-04-04

  • [maintenance] Support google-api-ruby-client >= v0.11.0
  • [maintenance] Add send_timeout_sec and read_timeout_sec option for google-api-ruby-client >= v0.11.0

0.4.3 - 2017-02-11

  • [maintenance] Fix schma_update_options was not set with load_from_gcs (thanks to h10a-bf)

0.4.2 - 2016-10-12

  • [maintenance] Fix schema_update_options was not working (nil error)

0.4.1 - 2016-10-03

  • [enhancement] Support schema_update_options option

0.4.0 - 2016-10-01

  • [enhancement] Support partitioned table
  • [maintenance] Add progress_log_interval option to control the interval of showing progress log, and now showing progress log is off by default

0.3.7 - 2016-08-03

  • [maintenance] Fix Thread.new to use thread local variables to avoid nil idx error (thanks to @shyouhei and @umisora)

0.3.6 - 2016-06-15

  • [maintenance] if is_skip_job_result_check is true, skip output_rows checking (thanks to @joker1007)

0.3.5 - 2016-06-13

  • [enhancement] retry backendError and internalError in waiting load job
  • [enhancement] retry Broken pipe and Connection reset in inserting object to GCS

0.3.4 - 2016-06-01

  • [new feature] Add gcs_bucket option to load multiple files from a GCS bucket with one load job

0.3.3 - 2016-05-24

  • [maintenance] Fix private_key auth is not working

0.3.2 - 2016-05-03

  • [new feature] Add abort_on_error option
  • [maintenance] Use uuid instead of current time for temp_table name

0.3.1 - 2016-04-15

  • [new feature] Add sdk_log_level option to show log of google-api-client
  • [maintenance] Fix prevent_duplicate_insert was not working correctly
  • [maintenance] Change to get num_output_rows of transaction_report from get_table API
  • [maintenance] Log response.statistics of load jobs
  • [maintenance] Always create job_id on client side as google recommends so that duplication not to be occurred
  • [maintenance] Fix a possibility which rehearsal would load 0 rows file

0.3.0 - 2016-04-08

Big change is introduced. Now, embulk-output-bigquery is written in JRuby.

  • [new feature] Support parallel loads. Fix #28.
  • [new feature] Create table first. Fix #29.
  • [new feature] Introduce rehearsal mode. Fix #30.
  • [new feature] Support dataset_old option for replace_backup. Fix #31.
  • [maintenance] Fix default timestamp format to %Y-%m-%d %H:%M:%S.%6. Fix #32.
  • [new feature] Support request options such as timeout_sec, open_timeout_sec, retries. Fix #33.
  • [new feature] Support continuing from file generation with skip_file_generation option.
  • [new feature] Guess BigQuery schema from Embulk schema. Fix #1.
  • [new feature] Support automatically create dataset.
  • [new feature] Support transactional append mode.
  • [incompatibility change] Formatter plugin support is dropped. Formatter is done in this plugin for specified source_format.
  • [incompatibility change] Encoder plugin support is dropped. Encoding is done in this plugin for specified compression.
  • [incompatibility change] append mode now expresses a transactional append, and append_direct is one which is not transactional (this was append mode before)

0.2.3 - 2016-02-19

  • [maintenance] Fix detect logic of delete_in_advance mode. #26. @sonots thanks!

0.2.2 - 2016-02-15

  • [new feature] Added template_table option. #25. @joker1007 thanks!

0.2.1 - 2016-01-28

  • [maintenance] Upgraded Embulk version to 0.8.1 #22. @joker1007 thanks!
  • [maintenance] Formatted code style by checkstyle #23

0.2.0 - 2016-01-26

  • [new feature] Added mode parameters and support 4 modes(append, replace, replace_backup, delete_in_advance). #20 #21 @joker1007 thanks!

0.1.11 - 2015-11-16

  • [maintenance] Change error result display for easy investigation. #18

0.1.10 - 2015-10-06

  • [new feature] Added new auth method - json_keyfile of GCP(Google Cloud Platform)'s service account #17

0.1.9 - 2015-08-19

  • [maintenance] Upgraded Embulk version to 0.7.1

0.1.8 - 2015-08-19

  • [new feature] Supported mapreduce-executor. @frsyuki thanks! #13
  • [maintenance] Fixed job_id generation logic #15
  • [maintenance] Refactored #11

0.1.7 - 2015-05-20

  • [new feature] Added allow_quoted_newlines option #10
  • [maintenance] Upgraded embulk version to 0.6.8

0.1.6 - 2015-04-23

  • [new feature] Added ignore_unknown_values option to job_id generation logic. #9

0.1.5 - 2015-04-23

  • [new feature] Added ignore_unknown_values option. #8 @takus thanks!

0.1.4 - 2015-04-21

  • [new feature] Added prevent_duplicate_insert option

0.1.3 - 2015-04-06

  • [new feature] Added new auth method - pre-defined access token of GCE(Google Compute Engine)
  • [maintenance] Updated Google provided libraries
    • http-client:google-http-client-jackson2 from 1.19.0 to 1.20.0
    • apis:google-api-services-bigquery from v2-rev193-1.19.1 to v2-rev205-1.20.0

0.1.2 - 2015-04-01

  • [new feature] Changed bulk-load method from "via GCS" to direct-insert
  • [new feature] added dynamic table creationg option