Elastic Memory Provider & Podcast Commands

[hlucco]

Elastic Memory Provider

This PR adds an implementation of an Elastisearch memory provider to the /examples/memoryProvider directory. This memory provider uses the existing implementations based on the filesystem for the object table and the temporal table. In the future we hope to add support for these to the elastic instance as well.

This implementation is built off of the StorageProvider interface defined in the Knowledge Processor package.

In addition to the memory provider, two commands were added for interacting with podcasts that have been indexed.
This pull request introduces significant updates to the memory management system in the chat and podcast examples, primarily by integrating Elasticsearch for enhanced storage capabilities. Additionally, it includes various dependency updates and minor code improvements.

Automatically Generated by GitHub:

Integration of Elasticsearch:

• ts/examples/chat/src/memory/podcastMemory.ts: Added support for Elasticsearch as a storage option in the createPodcastMemory function and introduced a new command podcastEntities to list podcast entities. [1] [2] [3] [4]
• ts/examples/memoryProviders/src/elastic/common.ts: Introduced utility functions to create an Elasticsearch client, delete indices, generate text IDs, and convert strings to valid index names.
• ts/examples/memoryProviders/src/elastic/storageClient.ts: Implemented a storage client for Elasticsearch, providing methods to create object folders, temporal logs, text indices, and key-value indices.
• ts/examples/memoryProviders/src/elastic/keyValueIndex.ts: Added a key-value index implementation for Elasticsearch.
• ts/examples/memoryProviders/src/elastic/index.ts: Exported Elasticsearch-related modules.

Dependency Updates:

• ts/examples/memoryProviders/package.json: Added @elastic/elasticsearch as a dependency.
• ts/pnpm-lock.yaml: Updated to include new dependencies and versions, such as @elastic/elasticsearch, @types/command-line-args, and apache-arrow. [1] [2] [3] [4] [5] [6] [7] [8] [9] [10]

Code Improvements:

• ts/examples/chat/src/memory/chatMemory.ts and ts/examples/chat/src/memory/podcastMemory.ts: Updated copyright comments. [1] [2]
• ts/packages/knowledgeProcessor/src/conversation/entities.ts: Added a safeguard in the toCompositeEntity function to handle undefined entities.

These changes collectively enhance the memory management capabilities by leveraging Elasticsearch, improve code robustness, and ensure dependencies are up to date.