Hybrid table materialization

[AkhilGurrapu]

Add Snowflake Hybrid Table Materialization

Description

This PR introduces a new materialization for Snowflake Hybrid Tables, enabling dbt users to leverage the benefits of both regular and dynamic tables in their data models. The implementation provides support for incremental processing, primary keys, and secondary indexes while maintaining dbt's idiomatic approach to data transformations.

Features

• Custom hybrid_table materialization for Snowflake
• Support for column-level definitions and constraints
• Primary key enforcement
• Secondary index management
• Incremental processing using MERGE operations
• Full refresh capabilities

Example Usage

{{config(
    materialized='hybrid_table',
    column_definitions={
        'customer_id': 'VARCHAR NOT NULL',
        'order_id': 'VARCHAR NOT NULL',
        'amount': 'NUMBER',
        'created_at': 'TIMESTAMP'
    },
    primary_key=['customer_id', 'order_id'],
    indexes=[
        {'name': 'idx_customer', 'columns': ['customer_id']},
        {'name': 'idx_created', 'columns': ['created_at']}
    ]
)}}

SELECT
    customer_id,
    order_id,
    amount,
    created_at
FROM source_table

Implementation Details

• Added hybrid_table.sql materialization
• Implemented configuration validation
• Added support for incremental processing
• Included comprehensive error handling
• Added documentation and examples

Requirements

• dbt-core >= 1.5.0
• dbt-snowflake >= 1.5.0
• Snowflake Enterprise Edition or higher

Testing

• Added unit tests for materialization logic
• Included integration tests with Snowflake
• Tested incremental scenarios
• Verified error handling
• Tested performance with large datasets

Documentation

• Added materialization reference docs
• Included configuration examples
• Added best practices guide
• Documented limitations and requirements

Breaking Changes

None. This is an additive feature that doesn't affect existing materializations.

Checklist

• Added new materialization file
• Implemented configuration validation
• Added comprehensive tests
• Updated documentation
• Tested with various scenarios
• Followed dbt coding standards
• Added error handling
• Verified Snowflake compatibility

[cla-bot]

Thanks for your pull request, and welcome to our community! We require contributors to sign our Contributor License Agreement and we don't seem to have your signature on file. Check out this article for more information on why we have a CLA.

In order for us to review and merge your code, please submit the Individual Contributor License Agreement form attached above above. If you have questions about the CLA, or if you believe you've received this message in error, please reach out through a comment on this PR.

CLA has not been signed by users: @AkhilGurrapu

[sfc-gh-jdemlow]

Did you want help with this?

[sfc-gh-jdemlow]

considering this is code I wrote I am sure I can help here