Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

Unreleased

Changed

Fixed

3.9.9 - 2023-11-14

Changed

Upgraded sqlglot to versions >= 13.0.0 (#1642)
Improved logging output from settings validation (#1636) and corresponding documentation (#1674)
Emit a warning when using a default (i.e. non-trained) value for probability_two_random_records_match (#1653)

Fixed

Fixed issue causing occasional SQL errors with certain database and catalog combinations (#1558)
Fixed issue where comparison vector grid not synced with corresponding histogram values in comparison viewer dashboard (#1652)
Fixed issue where composing null levels would mistakenly sometimes result in a non-null level (#1672)
Labelling tool correctly works even when offline (#1646)
Explicitly cast values when using the postgres linker (#1693)
Fixed issue where parameters to completeness_chart were not being applied (#1662)
Fixed issue passing boto3_session into the Athena linker (#1733)

3.9.8 - 2023-10-05

Added

Added ability to delete tables with Spark when working in Databricks (#1526)

Changed

Re-added support for python 3.7 (specifically >= 3.7.1) and adjusted dependencies in this case (#1622)

Fixed

Fix behaviour where using to_csv with Spark backend wouldn't overwrite files even when instructed to (#1635)
Corrected path for Spark .jar file containing UDFs to work correctly for Spark < 3.0 (#1622)
Spark UDF damerau_levensthein is now only registered for Spark >= 3.0, as it is not compatible with earlier versions (#1622)