Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[product documentation] adapt semantic_text usages to the new format #205908

Open
pgayvallet opened this issue Jan 8, 2025 · 2 comments
Open
Labels
Feature:AI Product Docs Product Documentation for AI workflows Team:AI Infra AppEx AI Infrastructure Team

Comments

@pgayvallet
Copy link
Contributor

semantic_text will face some breaking changes in 8.18 and 9.0 (see internal issue: https://github.com/elastic/dev/issues/2936)

We need to adapt the product documentation feature (artifact generation + installation) to support the new format.

Given the data changes, we will need to also generate 8.18 artifacts with the new data format. Note that given the 8.18 doc might not be online yet, so we could just generate the 8.17 artifacts again and label them as 8.18.

@pgayvallet pgayvallet added Feature:AI Product Docs Product Documentation for AI workflows Team:AI Infra AppEx AI Infrastructure Team labels Jan 8, 2025
@elasticmachine
Copy link
Contributor

Pinging @elastic/appex-ai-infra (Team:AI Infra)

@pgayvallet
Copy link
Contributor Author

Enabling the new behavior can be done using an index setting:

"index.mapping.semantic_text.use_legacy_format": false

then exporting the embeddings can be done by requesting the _inference_fields metafield:

GET my-index-1/_search
{
  "query": {
    "match_all": {}
  },
  "fields": ["_inference_fields"]
}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature:AI Product Docs Product Documentation for AI workflows Team:AI Infra AppEx AI Infrastructure Team
Projects
None yet
Development

No branches or pull requests

2 participants