Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support protobuf in locally defined schema #19

Open
adrdc opened this issue Mar 16, 2021 · 0 comments
Open

Support protobuf in locally defined schema #19

adrdc opened this issue Mar 16, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@adrdc
Copy link
Contributor

adrdc commented Mar 16, 2021

Schema may be defined in a local .json file. avro, and json formats are currently supported. json will have actual field names+types inline. avro can provide a pointer to it's schema.

for example for avro it may look like this - sample.avsc has the actual schema definition

{
  "schemaName": "sensors",
  "tableName": "temperature",
  "streamName": "temperature",
  "event": [
    {
      "dataFormat": "avro",
      "dataSchema": "etc/pravega/sample.avsc"
    }
  ]
}

For protobuf, 'dataSchema' would be a pointer to the protobuf FieldDescriptor.
The only missing piece is that for protobuf we need 1 more piece of information - the fully qualified type name of the class (as a string)

@adrdc adrdc added the enhancement New feature or request label Mar 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant