Skip to content

Commit

Permalink
spark 4.21.1 release (Azure#36558)
Browse files Browse the repository at this point in the history
Co-authored-by: annie-mac <xinlian@microsoft.com>
  • Loading branch information
xinlian12 and annie-mac authored Aug 28, 2023
1 parent 19a7d43 commit d33109b
Show file tree
Hide file tree
Showing 14 changed files with 40 additions and 48 deletions.
8 changes: 4 additions & 4 deletions eng/versioning/version_client.txt
Original file line number Diff line number Diff line change
Expand Up @@ -97,10 +97,10 @@ com.azure:azure-cosmos;4.49.0;4.50.0-beta.1
com.azure:azure-cosmos-benchmark;4.0.1-beta.1;4.0.1-beta.1
com.azure:azure-cosmos-dotnet-benchmark;4.0.1-beta.1;4.0.1-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3_2-12;1.0.0-beta.1;1.0.0-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.21.0;4.22.0-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;4.21.0;4.22.0-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;4.21.0;4.22.0-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;4.21.0;4.22.0-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.21.0;4.21.1
com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;4.21.0;4.21.1
com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;4.21.0;4.21.1
com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;4.21.0;4.21.1
com.azure:azure-cosmos-encryption;2.4.0;2.5.0-beta.1
com.azure:azure-cosmos-test;1.0.0-beta.5;1.0.0-beta.6
com.azure:azure-cosmos-tests;1.0.0-beta.1;1.0.0-beta.1
Expand Down
8 changes: 1 addition & 7 deletions sdk/cosmos/azure-cosmos-spark_3-1_2-12/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,16 +1,10 @@
## Release History

### 4.22.0-beta.1 (Unreleased)

#### Features Added

#### Breaking Changes
### 4.21.1 (2023-08-28)

#### Bugs Fixed
* Fixed an issue where spark job failed due to 409 when `ItemBulkUpdate` is being configured - See [PR 36541](https://github.com/Azure/azure-sdk-for-java/pull/36541)

#### Other Changes

### 4.21.0 (2023-08-09)

#### Features Added
Expand Down
8 changes: 6 additions & 2 deletions sdk/cosmos/azure-cosmos-spark_3-1_2-12/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-1_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|--------------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.21.1 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.\*, 9.\* |
| 4.21.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.\*, 9.\* |
| 4.20.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.\*, 9.\* |
| 4.19.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.\*, 9.\* |
Expand Down Expand Up @@ -76,6 +77,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-2_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.21.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.21.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.20.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.19.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
Expand Down Expand Up @@ -108,6 +110,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-3_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.21.1 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.21.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.20.0 | 3.3.0 | 8 | 2.12 | 11.\* |
| 4.19.0 | 3.3.0 | 8 | 2.12 | 11.\* |
Expand All @@ -122,16 +125,17 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-4_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.21.1 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.21.0 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |

### Download

You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 8 from Maven:
`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.21.0`
`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.21.1`

You can also integrate against Cosmos DB Spark Connector in your SBT project:
```scala
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.21.0"
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.21.1"
```

Cosmos DB Spark Connector is available on [Maven Central Repo](https://search.maven.org/search?q=g:com.azure.cosmos.spark).
Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-spark_3-1_2-12/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
</parent>
<groupId>com.azure.cosmos.spark</groupId>
<artifactId>azure-cosmos-spark_3-1_2-12</artifactId>
<version>4.22.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
<version>4.21.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
<packaging>jar</packaging>
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-1_2-12</url>
<name>OLTP Spark 3.1 Connector for Azure Cosmos DB SQL API</name>
Expand Down
8 changes: 1 addition & 7 deletions sdk/cosmos/azure-cosmos-spark_3-2_2-12/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,16 +1,10 @@
## Release History

### 4.22.0-beta.1 (Unreleased)

#### Features Added

#### Breaking Changes
### 4.21.1 (2023-08-28)

#### Bugs Fixed
* Fixed an issue where spark job failed due to 409 when `ItemBulkUpdate` is being configured - See [PR 36541](https://github.com/Azure/azure-sdk-for-java/pull/36541)

#### Other Changes

### 4.21.0 (2023-08-09)

#### Features Added
Expand Down
8 changes: 6 additions & 2 deletions sdk/cosmos/azure-cosmos-spark_3-2_2-12/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-2_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.21.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.21.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.20.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.19.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
Expand Down Expand Up @@ -60,6 +61,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-3_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.21.1 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.21.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.20.0 | 3.3.0 | 8 | 2.12 | 11.\* |
| 4.19.0 | 3.3.0 | 8 | 2.12 | 11.\* |
Expand All @@ -74,6 +76,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-1_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|--------------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.21.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 8.\*, 9.\* |
| 4.21.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 8.\*, 9.\* |
| 4.20.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 8.\*, 9.\* |
| 4.19.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 8.\*, 9.\* |
Expand Down Expand Up @@ -121,16 +124,17 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-4_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.21.1 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.21.0 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |

### Download

You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 10 from Maven:
`com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12:4.21.0`
`com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12:4.21.1`

You can also integrate against Cosmos DB Spark Connector in your SBT project:
```scala
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-2_2-12" % "4.21.0"
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-2_2-12" % "4.21.1"
```

Cosmos DB Spark Connector is available on [Maven Central Repo](https://search.maven.org/search?q=g:com.azure.cosmos.spark).
Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-spark_3-2_2-12/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
</parent>
<groupId>com.azure.cosmos.spark</groupId>
<artifactId>azure-cosmos-spark_3-2_2-12</artifactId>
<version>4.22.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;current} -->
<version>4.21.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;current} -->
<packaging>jar</packaging>
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-2_2-12</url>
<name>OLTP Spark 3.2 Connector for Azure Cosmos DB SQL API</name>
Expand Down
8 changes: 1 addition & 7 deletions sdk/cosmos/azure-cosmos-spark_3-3_2-12/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,16 +1,10 @@
## Release History

### 4.22.0-beta.1 (Unreleased)

#### Features Added

#### Breaking Changes
### 4.21.1 (2023-08-28)

#### Bugs Fixed
* Fixed an issue where spark job failed due to 409 when `ItemBulkUpdate` is being configured - See [PR 36541](https://github.com/Azure/azure-sdk-for-java/pull/36541)

#### Other Changes

### 4.21.0 (2023-08-09)

#### Features Added
Expand Down
8 changes: 6 additions & 2 deletions sdk/cosmos/azure-cosmos-spark_3-3_2-12/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-3_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.21.1 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.21.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.20.0 | 3.3.0 | 8 | 2.12 | 11.\* |
| 4.19.0 | 3.3.0 | 8 | 2.12 | 11.\* |
Expand All @@ -42,6 +43,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-2_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.21.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.21.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.20.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.19.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
Expand Down Expand Up @@ -74,6 +76,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-1_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|--------------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.21.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.21.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.20.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.19.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
Expand Down Expand Up @@ -121,16 +124,17 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-4_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
| 4.21.1 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.21.0 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |

### Download

You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 11 from Maven:
`com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.21.0`
`com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.21.1`

You can also integrate against Cosmos DB Spark Connector in your SBT project:
```scala
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-3_2-12" % "4.21.0"
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-3_2-12" % "4.21.1"
```

Cosmos DB Spark Connector is available on [Maven Central Repo](https://search.maven.org/search?q=g:com.azure.cosmos.spark).
Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-spark_3-3_2-12/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
</parent>
<groupId>com.azure.cosmos.spark</groupId>
<artifactId>azure-cosmos-spark_3-3_2-12</artifactId>
<version>4.22.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;current} -->
<version>4.21.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;current} -->
<packaging>jar</packaging>
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-3_2-12</url>
<name>OLTP Spark 3.3 Connector for Azure Cosmos DB SQL API</name>
Expand Down
8 changes: 1 addition & 7 deletions sdk/cosmos/azure-cosmos-spark_3-4_2-12/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,16 +1,10 @@
## Release History

### 4.22.0-beta.1 (Unreleased)

#### Features Added

#### Breaking Changes
### 4.21.1 (2023-08-28)

#### Bugs Fixed
* Fixed an issue where spark job failed due to 409 when `ItemBulkUpdate` is being configured - See [PR 36541](https://github.com/Azure/azure-sdk-for-java/pull/36541)

#### Other Changes

### 4.21.0 (2023-08-09)

#### Features Added
Expand Down
8 changes: 6 additions & 2 deletions sdk/cosmos/azure-cosmos-spark_3-4_2-12/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,11 +28,13 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-4_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------| -------------------- | ----------------------- |-------------------------------|
| 4.21.1 | 3.4.0 | 8 | 2.12 | n/a |
| 4.21.0 | 3.4.0 | 8 | 2.12 | n/a |

#### azure-cosmos-spark_3-3_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------| -------------------- | ----------------------- |-------------------------------|
| 4.21.1 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.21.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
| 4.20.0 | 3.3.0 | 8 | 2.12 | 11.\* |
| 4.19.0 | 3.3.0 | 8 | 2.12 | 11.\* |
Expand All @@ -47,6 +49,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-2_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------| ------------------------ | -------------------- | ----------------------- | ----------------------------- |
| 4.21.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.21.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.20.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.19.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
Expand Down Expand Up @@ -79,6 +82,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-1_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|--------------| ------------------------ | -------------------- | ----------------------- | ----------------------------- |
| 4.21.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.21.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.20.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
| 4.19.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
Expand Down Expand Up @@ -126,11 +130,11 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
### Download

You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 11 from Maven:
`com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12:4.21.0`
`com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12:4.21.1`

You can also integrate against Cosmos DB Spark Connector in your SBT project:
```scala
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-4_2-12" % "4.21.0"
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-4_2-12" % "4.21.1"
```

Cosmos DB Spark Connector is available on [Maven Central Repo](https://search.maven.org/search?q=g:com.azure.cosmos.spark).
Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-spark_3-4_2-12/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
</parent>
<groupId>com.azure.cosmos.spark</groupId>
<artifactId>azure-cosmos-spark_3-4_2-12</artifactId>
<version>4.22.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;current} -->
<version>4.21.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;current} -->
<packaging>jar</packaging>
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-4_2-12</url>
<name>OLTP Spark 3.4 Connector for Azure Cosmos DB SQL API</name>
Expand Down
Loading

0 comments on commit d33109b

Please sign in to comment.