Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Getting "JSON to avro conversion failed" error while trying to sync MongoDB data to GCS #52108

Open
1 task done
anshjain-18 opened this issue Jan 23, 2025 · 0 comments
Open
1 task done

Comments

@anshjain-18
Copy link

Connector Name

destination-gcs, source-mongodb

Connector Version

gcs-0.4.8

What step the error happened?

During the sync

Relevant information

  1. Trying to sync a Mongodb collection to GCS in parquet format. In the documents, some fields have boolean types, which are being interpreted as string by Airbyte.
  2. Thus, when trying to sync, it fails with the error "Could not evaluate union, field apply_consistency is expected to be one of these: NULL, STRING. If this is a complex type, check if offending field (path: apply_consistency) adheres to schema: true"

Airbyte version: 1.3.1
MongoDb version: MongoDB 6.0.19 Atlas (edited)

Relevant log output

`"Could not evaluate union, field apply_consistency is expected to be one of these: NULL, STRING. If this is a complex type, check if offending field (path: apply_consistency) adheres to schema: true"`

Contribute

  • Yes, I want to contribute
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants