Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[api-sources] Inconsistencies with source > custom report names #52082

Closed
1 task
Rykarix opened this issue Jan 22, 2025 · 2 comments
Closed
1 task

[api-sources] Inconsistencies with source > custom report names #52082

Rykarix opened this issue Jan 22, 2025 · 2 comments
Labels
area/connectors Connector related issues community python Pull requests that update Python code team/connectors-python type/bug Something isn't working

Comments

@Rykarix
Copy link

Rykarix commented Jan 22, 2025

Connector Name

LinkedIn Ads v5.1.1, Facebook Marketing v3.3.26

Connector Version

LinkedIn Ads v5.1.1, Facebook Marketing v3.3.26

What step the error happened?

None

Relevant information

I've set up custom reports for the following Source Connectors.

  • Bing Ads v2.8.10
  • LinkedIn Ads v5.1.1
  • Facebook Marketing v3.3.26
  • Google Ads v3.7.10

Each of these sources has a custom defined report/query/insight. This has been named: paid_budget

For each connection, I've also set up a custom prefix in the settings: linkedinads_, facebookads_, bingads_, googleads_

These are the following outputs in the schema:

  • bingads_paid_budget for Bing Ads
  • googleads_paid_budget for Google Ads
  • linkedin_custom_paid_budget for LinkedIn Ads
  • facebookads_custompaid_budget for Facebook Marketing

Notice the naming convention for linkedin and facebook.

I did not ask you to put custom_ for linkedin, or custom for facebook.

Please fix this

Relevant log output

Contribute

  • Yes, I want to contribute
@Rykarix
Copy link
Author

Rykarix commented Jan 22, 2025

Linkedin Issue location: https://github.com/airbytehq/airbyte/blob/master/airbyte-integrations/connectors/source-linkedin-ads/source_linkedin_ads/manifest.yaml#L1448

      components_mapping:
        - type: ComponentMappingDefinition
          field_path: ["**", "name"]
          value: "custom_{{components_values['name']}}"

Change to:

      components_mapping:
        - type: ComponentMappingDefinition
          field_path: ["**", "name"]
          value: "{{components_values['name']}}"

Facebook ads issue location: https://github.com/airbytehq/airbyte/blob/master/airbyte-integrations/connectors/source-facebook-marketing/source_facebook_marketing/source.py#L309

            stream = AdsInsights(
                api=api,
                account_ids=config.account_ids,
                name=f"Custom{insight.name}",

change to

            stream = AdsInsights(
                api=api,
                account_ids=config.account_ids,
                name=f"{insight.name}",

... probably. I've not done any research into your connector code architecture so I may be wrong

@marcosmarxm marcosmarxm added python Pull requests that update Python code and removed needs-triage autoteam labels Jan 22, 2025
@marcosmarxm marcosmarxm changed the title Inconsistencies with source > custom report names [api-sources] Inconsistencies with source > custom report names Jan 22, 2025
@natikgadzhi
Copy link
Contributor

Generally, PRs with changes like this are welcome, but tricky.

Changing a stream name would result in a schema breaking change, meaning all Airbyte users who already have this setup would have to change how they are querying their data downstream.

You would usually sync raw data and then apply a layer of transformations to build out your dimensions / business tables, so the specific stream names should not be that important.

If you wanted to get clean naming out of Airbyte right away, the easiest path forward is prob dbt transformations.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues community python Pull requests that update Python code team/connectors-python type/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants