Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Delete-all requests for index templates should exclude templates for hidden data streams #78850

Open
danhermann opened this issue Oct 7, 2021 · 1 comment
Labels
>bug :Data Management/Indices APIs APIs to create and manage indices and templates Team:Data Management Meta label for data/management team

Comments

@danhermann
Copy link
Contributor

danhermann commented Oct 7, 2021

Requests to delete * or _all index templates should exclude any templates for hidden data streams. Because of the restriction on deleting templates for data streams and the fact that there are now a number of automatically-created hidden data streams such as ILM history, a high percentage of requests to delete all templates will likely fail. In order to delete the template for a hidden data stream, the data stream itself must first be deleted and then the index template may be deleted either individually or with a wildcard that is more selective than *.

We consider this a tactical solution to the immediate problem. Longer term, a more intuitive and holistic approach to resolving entities in Elasticsearch, perhaps something along the lines of the expand_wildcards option, would be preferred.

@danhermann danhermann added >bug :Data Management/Indices APIs APIs to create and manage indices and templates labels Oct 7, 2021
@elasticmachine elasticmachine added the Team:Data Management Meta label for data/management team label Oct 7, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-data-management (Team:Data Management)

pgomulka added a commit to pgomulka/elasticsearch that referenced this issue Oct 12, 2021
Changing the default for deprecation log indexing to be true.
This commit also overrides this defualt to tests where a deprecation
data stream would intefere - because it uses index template, it would
not be possible to delete with _index_template/*.
The overrides should be removed when elastic#78850 is done.

closes elastic#76292
pgomulka added a commit that referenced this issue Oct 13, 2021
Changing the default for deprecation log indexing to be true.
This commit also overrides this default to tests where a deprecation
data stream would interfere - because it uses index template, it would
not be possible to delete with _index_template/*.
The overrides should be removed when #78850 is done.

closes #76292
pgomulka added a commit to pgomulka/elasticsearch that referenced this issue Oct 13, 2021
Changing the default for deprecation log indexing to be true.
This commit also overrides this default to tests where a deprecation
data stream would interfere - because it uses index template, it would
not be possible to delete with _index_template/*.
The overrides should be removed when elastic#78850 is done.

closes elastic#76292
pgomulka added a commit that referenced this issue Oct 18, 2021
…9035)

Changing the default for deprecation log indexing to be true.
This commit also overrides this default to tests where a deprecation
data stream would interfere - because it uses index template, it would
not be possible to delete with _index_template/*.
The overrides should be removed when #78850 is done.

closes #76292
backport #78991
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>bug :Data Management/Indices APIs APIs to create and manage indices and templates Team:Data Management Meta label for data/management team
Projects
None yet
Development

No branches or pull requests

2 participants