-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Nested json with JSONSchema value converter DataException: Invalid null value for required STRUCT field #3101
Comments
Shouldn't you be sending |
You are right. The the error message I gave is coming, because I am missing the defined object. My real problem - and the error I got stuck on is when I am sending the message you also suggested is [2024-04-26 06:09:58,625] INFO Kafka startTimeMs: 1714111798620 (org.apache.kafka.common.utils.AppInfoParser)
[2024-04-26 06:09:58,938] INFO [Producer clientId=console-producer] Cluster ID: esaSwPz2R1GpJN7R-ALcIA (org.apache.kafka.clients.Metadata)
{"level0": {"level1": {"level2": 2}}}
|
@rayokota Thanks for chipping in earlier. I solved the {
"type": "object",
"title": "titleA",
"properties": {
"level0": {
"type": "object",
"title": "titleB",
"properties": {
"level1": {
"type": "object",
"properties": {
"level2": {
"type": "integer"
}
}
}
}
}
},
"additionalProperties": false
} As soon as I remove any of the Can you point me to the direction, why this is happening or where can I learn more about mandatory JSON fields for connectors? I can also close the issue, as I found "a solution"TM, but ideally I would also know "why". |
I am trying to send nested JSON messages and sink them using Kafka connect S3sink to parque.
Whenever I nest the object too much the connector gives me the error message below.
To trigger the error I start a producer:
I send this message:
{"level0": {"k": {"i": 2}}}
My connector config:
I can do the nesting with AVRO without any problems.
The text was updated successfully, but these errors were encountered: