Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build an Automated data pipeline #3

Open
imbilalbutt opened this issue Nov 20, 2023 · 0 comments
Open

Build an Automated data pipeline #3

imbilalbutt opened this issue Nov 20, 2023 · 0 comments

Comments

@imbilalbutt
Copy link
Owner

This task requires to build an automation of the data pipeline. This helps the developer to forget about the data flow and all he can assume is that he has the necessary and cleaned data.
This task is perfectly suitable for large datasets from where user pulls them and then further perform analysis on it. In this task I would be writting an automated data pipeline which pulls all the necessary data, cleans it, transforms it, and then store in sqlite database.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant