Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DOCS] Adds xpack.ml.max_ml_node_size #66285

Merged
merged 3 commits into from
Dec 16, 2020
Merged

Conversation

lcawl
Copy link
Contributor

@lcawl lcawl commented Dec 14, 2020

Related to #59309 and #66132

Adds xpack.ml.max_ml_node_size to the machine learning settings documentation

@lcawl lcawl added >docs General docs changes :ml Machine learning v8.0.0 v7.11.0 labels Dec 14, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml)

@elasticmachine elasticmachine added the Team:Docs Meta label for docs team label Dec 14, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-docs (Team:Docs)

@lcawl lcawl requested a review from benwtrent December 14, 2020 19:14
Comment on lines 83 to 87
`xpack.ml.max_ml_node_size`::
(<<static-cluster-setting,Static>>)
The maximum node size for {ml} nodes. Defaults to `0b`, which means this value
is ignored.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is an advanced setting that should only be set if the way that ES is deployed allows for automatic cluster scaling. This setting should be set to the maximum possible future node. This way when assigning a ML job to a node (and it is lazily assignable), we can fail quickly as we know that scaling will never support a job of this size.

Copy link
Contributor Author

@lcawl lcawl Dec 14, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, I've taken another crack at adding those details and moved it down to the advanced settings.

@@ -80,6 +80,11 @@ total memory of the machine, not current free memory. Jobs are not allocated to
a node if doing so would cause the estimated memory use of {ml} jobs to exceed
the limit.

`xpack.ml.max_ml_node_size`::
(<<static-cluster-setting,Static>>)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It’s dynamic now (changed earlier today)

@lcawl lcawl merged commit 709068d into elastic:master Dec 16, 2020
@lcawl lcawl deleted the max-ml-node-size branch December 16, 2020 20:56
@lcawl lcawl added the v7.12.0 label Dec 16, 2020
lcawl added a commit to lcawl/elasticsearch that referenced this pull request Dec 16, 2020
@lcawl lcawl restored the max-ml-node-size branch December 16, 2020 20:58
lcawl added a commit to lcawl/elasticsearch that referenced this pull request Dec 16, 2020
@lcawl lcawl deleted the max-ml-node-size branch November 3, 2021 01:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>docs General docs changes :ml Machine learning Team:Docs Meta label for docs team v7.11.0 v7.12.0 v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants