Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dynamic table creating #1

Closed
sakama opened this issue Mar 17, 2015 · 2 comments · Fixed by #35
Closed

Dynamic table creating #1

sakama opened this issue Mar 17, 2015 · 2 comments · Fixed by #35

Comments

@sakama
Copy link
Contributor

sakama commented Mar 17, 2015

create table when data load to BigQuery.

For example fluent-plugin-bigquery support 3method.

  1. List fields in config.yml
  2. Load a schema file in JSON. implemented
  3. Fetch a schema using BigQuery API implemented at v0.2.2

in embulk-output-bigquery...as follows?

load schema from json file implemented

out:
  type: bigquery
  auto_create_table: true
  table: target_table
  schema_path: /path/to/schema.json

load from config.yml

out:
  type: bigquery
  auto_create_table: true
  table: target_table
  schema: id:integer, name:string, time:timestamp

fetch_schema implemented at v0.2.2

out:
  type: bigquery
  fetch_schema: true

load from embulk schema?

But, FileOutputPlugin may not be received schema from embulk.
And support for NULLABLE/REQUIRED/REPEATED field is difficult.

out:
  type: bigquery
  auto_create_table: true
  table: target_table
  schema: 
@sakama
Copy link
Contributor Author

sakama commented Apr 1, 2015

load schema from json file was implemented at v0.1.2

@sakama
Copy link
Contributor Author

sakama commented Feb 15, 2016

fetch_schema was implemented at v0.2.2.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

Successfully merging a pull request may close this issue.

1 participant