You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The Events stream in source-amplitude is currently preventing the source from being fully migrated to manifest-only because it requires custom record parsing with the zipfile library. We should create a low-code component that can unzip a response and prepare it to be parsed by an underlying connector-dev-specified parser (e.g. JsonParser).
This will require creating a "Parser" class that unzips BufferIOBase object data and then leverages a specified parsers to parser the decompressed data and yields the data in the same format that the other decoders return data.
Proposed Solution
Create a ZipfileDecoder class
Class should inherit from the Parser class
Class should have an underlying parser
Success Criteria
New ZipfileDecoder in CDK
Implemented in source-amplitude
The text was updated successfully, but these errors were encountered:
pnilan
changed the title
feat(zip decoder) - Create new zip decoder that takes an underlying parser to decoder and parse a response
feat(ZipfileDecoder) - Create new zip decoder that takes an underlying parser to decoder and parse a response
Dec 10, 2024
pnilan
changed the title
feat(ZipfileDecoder) - Create new zip decoder that takes an underlying parser to decoder and parse a response
feat(ZipfileDecoder) - Create new ZipfileParser that takes an inner_parser to further parse a response
Jan 15, 2025
pnilan
changed the title
feat(ZipfileDecoder) - Create new ZipfileParser that takes an inner_parser to further parse a response
feat(ZipfileParser) - Create new ZipfileParser that takes an inner_parser to further parse a response
Jan 15, 2025
pnilan
changed the title
feat(ZipfileParser) - Create new ZipfileParser that takes an inner_parser to further parse a response
feat(ZipfileDecoder) - Create new ZipfileDecoder that takes parser to further parse a response
Jan 16, 2025
Problem
The
Events
stream insource-amplitude
is currently preventing the source from being fully migrated to manifest-only because it requires custom record parsing with the zipfile library. We should create a low-code component that can unzip a response and prepare it to be parsed by an underlying connector-dev-specified parser (e.g. JsonParser).This will require creating a "Parser" class that unzips BufferIOBase object data and then leverages a specified parsers to parser the decompressed data and yields the data in the same format that the other decoders return data.
Proposed Solution
ZipfileDecoder
classParser
classparser
Success Criteria
ZipfileDecoder
in CDKsource-amplitude
The text was updated successfully, but these errors were encountered: