[FEA] Support for Databricks 10.4 ML LTS

[sameerz]

Is your feature request related to a problem? Please describe.
Databricks has a 10.4 ML beta runtime which we anticipate will be a long term support version. We would like to support this in the plugin.

Describe the solution you'd like
A shim layer for Databricks 10.4 ML

Describe alternatives you've considered
N/A

Additional context
Other Databricks versions that will continue to be supported: 9.1 ML LTS.