Turn on Terraform Updates for Lambda Layers

[Kamsiy]

Description

Artemis currently ignores changes in the Lambda layers. This brings up the following problems:

1. Ignoring changes makes it difficult to update Layers without a custom script. For example, deploying new Datadog layers is not possible without running a custom script

2. When Terraform has to destroy and recreate a Lambda, the layers that are manually added through a script are also removed from the Lambda.

To fix some of these issues, this PR:

• Removes the ignore_change attribute. This will allow Terraform to make updates to the Lambda layers
• Adds a data source to fetch the latest version of the heimdall-core and artemis-backend-core Lambda layers. This makes it easier to update the lambda layers in Multiple AWS Lambdas.

---

Other Updates:

Renamed terraform variables:

• datadog_lambda_variables -> datadog_environment_variables

Added terraform outputs to share values with other modules:

• backend_core_lambda_layer - This stores the arn for the latest version of the artemis-backend-core Lambda layer
• datadog_secret_arn - This stores the arn for the DATADOG_API_SECRET.

Removed terraform variables:

• extra_lambda_layers_* - Since shifting to having a core lambda layer for all Lambdas, these variables are no longer needed.
• datadog_lambda_layers - These layers will be added to the lambda_layers variables

How Has This Been Tested?

tested in a dev environment

Types of changes

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)
• Documentation change

Checklist

• My code follows conforms to the coding standards.
• My change requires a change to the documentation.
• I have updated the documentation accordingly.
• I have added tests to cover my changes.
• All new and existing tests passed.

Pic