[DataFactory] Add synapse spark activities #19769

wonner · 2022-07-14T04:55:19Z

MSFT employees can try out our new experience at OpenAPI Hub - one location for using our validation tools and finding your workflow.

Changelog

Add a changelog entry for this PR by answering the following questions:

What's the purpose of the update?
- new service onboarding
- new API version
- update existing version for new feature
- update existing version to fix swagger quality issue in s360
- Other, please clarify
When are you targeting to deploy the new service/feature to public regions? Please provide the date or, if the date is not yet available, the month.
When do you expect to publish the swagger? Please provide date or, the the date is not yet available, the month.
If updating an existing version, please select the specific language SDKs and CLIs that must be refreshed after the swagger is published.
- SDK of .NET (need service team to ensure code readiness)
- SDK of Python
- SDK of Java
- SDK of Js
- SDK of Go
- PowerShell
- CLI
- Terraform
- No refresh required for updates in this PR

Contribution checklist:

I commit to follow the Breaking Change Policy of "no breaking changes"
I have reviewed the documentation for the workflow.
Validation tools were run on swagger spec(s) and errors have all been fixed in this PR. How to fix?

If any further question about AME onboarding or validation tools, please view the FAQ.

ARM API Review Checklist

Applicability: ⚠️

If your changes encompass only the following scenarios, you should SKIP this section, as these scenarios do not require ARM review.

Change to data plane APIs

Adding new properties

All removals

Otherwise your PR may be subject to ARM review requirements. Complete the following:

Check this box if any of the following appy to the PR so that the label "ARMReview" and "WaitForARMFeedback" will be added by bot to kick off ARM API Review. Missing to check this box in the following scenario may result in delays to the ARM manifest review and deployment.
- Adding a new service
- Adding new API(s)
- Adding a new API version
  -[ ] To review changes efficiently, ensure you are using OpenAPIHub to initialize the PR for adding a new version. More details, refer to the wiki.
Ensure you've reviewed following guidelines including ARM resource provider contract and REST guidelines. Estimated time (4 hours). This is required before you can request review from ARM API Review board.
If you are blocked on ARM review and want to get the PR merged with urgency, please get the ARM oncall for reviews (RP Manifest Approvers team under Azure Resource Manager service) from IcM and reach out to them.

Breaking Change Review Checklist

If any of the following scenarios apply to the PR, request approval from the Breaking Change Review Board as defined in the Breaking Change Policy.

Removing API(s) in a stable version
Removing properties in a stable version
Removing API version(s) in a stable version
Updating API in a stable or public preview version with Breaking Change Validation errors
Updating API(s) in public preview over 1 year (refer to Retirement of Previews)

Action: to initiate an evaluation of the breaking change, create a new intake using the template for breaking changes. Addition details on the process and office hours are on the Breaking change Wiki.

Please follow the link to find more details on PR review process.

openapi-workflow-bot · 2022-07-14T04:55:23Z

Hi @wonner, this service has enabled Shift Left. All spec updates MUST be initiated from service ADO project repo, so that to guarantee it to be the source of truth.

You can refer to Shift Left Solution Introduction for details.

Please contact service focal @Frey-Wang contacts or Shift Left Support Channel if need further help.

openapi-pipeline-app · 2022-07-14T04:55:23Z

Swagger Validation Report

️❌BreakingChange: 5 Errors, 0 Warnings failed [Detail]

compared swaggers (via Oad v0.9.6)]	new version	base version
entityTypes	2018-06-01(eea5dd2)	2018-06-01(main)
entityTypes	2020-12-01(eea5dd2)	2020-12-01(main)

Rule	Message
`❌` 1023 - TypeFormatChanged	The new version has a different format than the previous one. New: stable/2020-12-01/entityTypes/Pipeline.json#L7525:9 Old: stable/2020-12-01/entityTypes/Pipeline.json#L7506:9
`❌` 1045 - AddedOptionalProperty	The new version has a new optional property 'executorSize' that was not found in the old version. New: stable/2020-12-01/entityTypes/Pipeline.json#L7418:7 Old: stable/2020-12-01/entityTypes/Pipeline.json#L7418:7
`❌` 1045 - AddedOptionalProperty	The new version has a new optional property 'conf' that was not found in the old version. New: stable/2020-12-01/entityTypes/Pipeline.json#L7418:7 Old: stable/2020-12-01/entityTypes/Pipeline.json#L7418:7
`❌` 1045 - AddedOptionalProperty	The new version has a new optional property 'driverSize' that was not found in the old version. New: stable/2020-12-01/entityTypes/Pipeline.json#L7418:7 Old: stable/2020-12-01/entityTypes/Pipeline.json#L7418:7
`❌` 1045 - AddedOptionalProperty	The new version has a new optional property 'numExecutors' that was not found in the old version. New: stable/2020-12-01/entityTypes/Pipeline.json#L7418:7 Old: stable/2020-12-01/entityTypes/Pipeline.json#L7418:7

️️✔️Breaking Change(Cross-Version) succeeded [Detail] [Expand]

There are no breaking changes.

️️✔️CredScan succeeded [Detail] [Expand]

There is no credential detected.

️⚠️LintDiff: 0 Warnings warning [Detail]

compared tags (via openapi-validator v1.13.0)	new version	base version
package-2018-06	package-2018-06(eea5dd2)	package-2018-06(main)
package-artifacts-2020-12-01	package-artifacts-2020-12-01(eea5dd2)	package-artifacts-2020-12-01(main)
package-artifacts-composite-v1	package-artifacts-composite-v1(eea5dd2)	package-artifacts-composite-v1(main)
package-artifacts-composite-v4	package-artifacts-composite-v4(eea5dd2)	package-artifacts-composite-v4(main)

The following errors/warnings exist before current PR submission:

Only 30 items are listed, please refer to log for more details.

Rule	Message
`❌` R4013 - IntegerTypeMustHaveFormat	The integer type does not have a format, please add it. Location: stable/2018-06-01/entityTypes/Pipeline.json#L46
`❌` R4013 - IntegerTypeMustHaveFormat	The integer type does not have a format, please add it. Location: stable/2018-06-01/entityTypes/Pipeline.json#L46
`❌` R4013 - IntegerTypeMustHaveFormat	The integer type does not have a format, please add it. Location: stable/2018-06-01/entityTypes/Pipeline.json#L238
`❌` R4013 - IntegerTypeMustHaveFormat	The integer type does not have a format, please add it. Location: stable/2018-06-01/entityTypes/Pipeline.json#L238
`❌` R4013 - IntegerTypeMustHaveFormat	The integer type does not have a format, please add it. Location: stable/2018-06-01/entityTypes/Pipeline.json#L5290
`❌` R4013 - IntegerTypeMustHaveFormat	The integer type does not have a format, please add it. Location: stable/2018-06-01/entityTypes/Pipeline.json#L5290
`❌` R4013 - IntegerTypeMustHaveFormat	The integer type does not have a format, please add it. Location: stable/2018-06-01/entityTypes/Pipeline.json#L6141
`❌` R4013 - IntegerTypeMustHaveFormat	The integer type does not have a format, please add it. Location: stable/2018-06-01/entityTypes/Pipeline.json#L6141
`❌` R4013 - IntegerTypeMustHaveFormat	The integer type does not have a format, please add it. Location: stable/2018-06-01/entityTypes/Pipeline.json#L6561
`❌` R4013 - IntegerTypeMustHaveFormat	The integer type does not have a format, please add it. Location: stable/2018-06-01/entityTypes/Pipeline.json#L6561
`❌` R4037 - MissingTypeObject	The schema 'ControlActivity' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L197
`❌` R4037 - MissingTypeObject	The schema 'ControlActivity' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L197
`❌` R4037 - MissingTypeObject	The schema 'ExecutionActivity' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L207
`❌` R4037 - MissingTypeObject	The schema 'ExecutionActivity' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L207
`❌` R4037 - MissingTypeObject	The schema 'CopyActivity' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L1536
`❌` R4037 - MissingTypeObject	The schema 'CopyActivity' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L1536
`❌` R4037 - MissingTypeObject	The schema 'CopyActivityTypeProperties' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L1575
`❌` R4037 - MissingTypeObject	The schema 'CopyActivityTypeProperties' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L1575
`❌` R4037 - MissingTypeObject	The schema 'HDInsightHiveActivity' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L5220
`❌` R4037 - MissingTypeObject	The schema 'HDInsightHiveActivity' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L5220
`❌` R4037 - MissingTypeObject	The schema 'HDInsightHiveActivityTypeProperties' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L5239
`❌` R4037 - MissingTypeObject	The schema 'HDInsightHiveActivityTypeProperties' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L5239
`❌` R4037 - MissingTypeObject	The schema 'HDInsightPigActivity' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L5309
`❌` R4037 - MissingTypeObject	The schema 'HDInsightPigActivity' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L5309
`❌` R4037 - MissingTypeObject	The schema 'HDInsightPigActivityTypeProperties' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L5328
`❌` R4037 - MissingTypeObject	The schema 'HDInsightPigActivityTypeProperties' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L5328
`❌` R4037 - MissingTypeObject	The schema 'HDInsightMapReduceActivity' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L5367
`❌` R4037 - MissingTypeObject	The schema 'HDInsightMapReduceActivity' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L5367
`❌` R4037 - MissingTypeObject	The schema 'HDInsightMapReduceActivityTypeProperties' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L5386
`❌` R4037 - MissingTypeObject	The schema 'HDInsightMapReduceActivityTypeProperties' is considered an object but without a 'type:object', please add the missing 'type:object'. Location: stable/2018-06-01/entityTypes/Pipeline.json#L5386

️️✔️Avocado succeeded [Detail] [Expand]

Validation passes for Avocado.

️️✔️ApiReadinessCheck succeeded [Detail] [Expand]

️️✔️ModelValidation succeeded [Detail] [Expand]

Validation passes for ModelValidation.

️️✔️SemanticValidation succeeded [Detail] [Expand]

Validation passes for SemanticValidation.

️️✔️PoliCheck succeeded [Detail] [Expand]

Validation passed for PoliCheck.

️⚠️SDK Track2 Validation: 17 Warnings warning [Detail]

The following tags are being changed in this PR

"https://github.com/Azure/azure-rest-api-specs/blob/eea5dd2657072068055a84bb77a51d86e59b3e09/specification/datafactory/resource-manager/readme.md#tag-package-2018-06">datafactory/resource-manager/readme.md#package-2018-06
"https://github.com/Azure/azure-rest-api-specs/blob/eea5dd2657072068055a84bb77a51d86e59b3e09/specification/synapse/data-plane/readme.md#tag-package-artifacts-composite-v4">synapse/data-plane/readme.md#package-artifacts-composite-v4
"https://github.com/Azure/azure-rest-api-specs/blob/eea5dd2657072068055a84bb77a51d86e59b3e09/specification/synapse/data-plane/readme.md#tag-package-artifacts-composite-v3">synapse/data-plane/readme.md#package-artifacts-composite-v3
"https://github.com/Azure/azure-rest-api-specs/blob/eea5dd2657072068055a84bb77a51d86e59b3e09/specification/synapse/data-plane/readme.md#tag-package-artifacts-composite-v2">synapse/data-plane/readme.md#package-artifacts-composite-v2
"https://github.com/Azure/azure-rest-api-specs/blob/eea5dd2657072068055a84bb77a51d86e59b3e09/specification/synapse/data-plane/readme.md#tag-package-artifacts-composite-v1">synapse/data-plane/readme.md#package-artifacts-composite-v1
"https://github.com/Azure/azure-rest-api-specs/blob/eea5dd2657072068055a84bb77a51d86e59b3e09/specification/synapse/data-plane/readme.md#tag-package-artifacts-2020-12-01">synapse/data-plane/readme.md#package-artifacts-2020-12-01

The following errors/warnings are introduced by current PR:

Rule	Message
⚠️ Modeler/MissingType	"readme":"datafactory/resource-manager/readme.md", "tag":"package-2018-06", "details":"The schema 'SynapseSparkJobActivityTypeProperties-argsItem' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/datafactory/resource-manager/Microsoft.DataFactory/stable/2018-06-01/entityTypes/Pipeline.json#/components/schemas/SynapseSparkJobActivityTypeProperties-argsItem"
⚠️ Modeler/MissingType	"readme":"datafactory/resource-manager/readme.md", "tag":"package-2018-06", "details":"The schema 'SynapseSparkJobActivityTypeProperties-filesItem' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/datafactory/resource-manager/Microsoft.DataFactory/stable/2018-06-01/entityTypes/Pipeline.json#/components/schemas/SynapseSparkJobActivityTypeProperties-filesItem"
⚠️ Modeler/MissingType	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v4", "details":"The schema 'NotebookCellOutputItem-text' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/synapse/data-plane/Microsoft.Synapse/stable/2020-12-01/entityTypes/Notebook.json#/components/schemas/NotebookCellOutputItem-text"
⚠️ Modeler/MissingType	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v4", "details":"The schema 'SynapseSparkJobActivityTypeProperties-argsItem' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/synapse/data-plane/Microsoft.Synapse/stable/2020-12-01/entityTypes/Pipeline.json#/components/schemas/SynapseSparkJobActivityTypeProperties-argsItem"
⚠️ Modeler/MissingType	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v4", "details":"The schema 'SynapseSparkJobActivityTypeProperties-filesItem' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/synapse/data-plane/Microsoft.Synapse/stable/2020-12-01/entityTypes/Pipeline.json#/components/schemas/SynapseSparkJobActivityTypeProperties-filesItem"
⚠️ Modeler/MissingType	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v3", "details":"The schema 'NotebookCellOutputItem-text' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/synapse/data-plane/Microsoft.Synapse/stable/2020-12-01/entityTypes/Notebook.json#/components/schemas/NotebookCellOutputItem-text"
⚠️ Modeler/MissingType	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v3", "details":"The schema 'SynapseSparkJobActivityTypeProperties-argsItem' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/synapse/data-plane/Microsoft.Synapse/stable/2020-12-01/entityTypes/Pipeline.json#/components/schemas/SynapseSparkJobActivityTypeProperties-argsItem"
⚠️ Modeler/MissingType	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v3", "details":"The schema 'SynapseSparkJobActivityTypeProperties-filesItem' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/synapse/data-plane/Microsoft.Synapse/stable/2020-12-01/entityTypes/Pipeline.json#/components/schemas/SynapseSparkJobActivityTypeProperties-filesItem"
⚠️ Modeler/MissingType	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v2", "details":"The schema 'NotebookCellOutputItem-text' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/synapse/data-plane/Microsoft.Synapse/stable/2020-12-01/entityTypes/Notebook.json#/components/schemas/NotebookCellOutputItem-text"
⚠️ Modeler/MissingType	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v2", "details":"The schema 'SynapseSparkJobActivityTypeProperties-argsItem' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/synapse/data-plane/Microsoft.Synapse/stable/2020-12-01/entityTypes/Pipeline.json#/components/schemas/SynapseSparkJobActivityTypeProperties-argsItem"
⚠️ Modeler/MissingType	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v2", "details":"The schema 'SynapseSparkJobActivityTypeProperties-filesItem' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/synapse/data-plane/Microsoft.Synapse/stable/2020-12-01/entityTypes/Pipeline.json#/components/schemas/SynapseSparkJobActivityTypeProperties-filesItem"
⚠️ Modeler/MissingType	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v1", "details":"The schema 'NotebookCellOutputItem-text' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/synapse/data-plane/Microsoft.Synapse/stable/2020-12-01/entityTypes/Notebook.json#/components/schemas/NotebookCellOutputItem-text"
⚠️ Modeler/MissingType	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v1", "details":"The schema 'SynapseSparkJobActivityTypeProperties-argsItem' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/synapse/data-plane/Microsoft.Synapse/stable/2020-12-01/entityTypes/Pipeline.json#/components/schemas/SynapseSparkJobActivityTypeProperties-argsItem"
⚠️ Modeler/MissingType	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v1", "details":"The schema 'SynapseSparkJobActivityTypeProperties-filesItem' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/synapse/data-plane/Microsoft.Synapse/stable/2020-12-01/entityTypes/Pipeline.json#/components/schemas/SynapseSparkJobActivityTypeProperties-filesItem"
⚠️ Modeler/MissingType	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-2020-12-01", "details":"The schema 'NotebookCellOutputItem-text' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/synapse/data-plane/Microsoft.Synapse/stable/2020-12-01/entityTypes/Notebook.json#/components/schemas/NotebookCellOutputItem-text"
⚠️ Modeler/MissingType	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-2020-12-01", "details":"The schema 'SynapseSparkJobActivityTypeProperties-argsItem' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/synapse/data-plane/Microsoft.Synapse/stable/2020-12-01/entityTypes/Pipeline.json#/components/schemas/SynapseSparkJobActivityTypeProperties-argsItem"
⚠️ Modeler/MissingType	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-2020-12-01", "details":"The schema 'SynapseSparkJobActivityTypeProperties-filesItem' has no type or format information whatsoever. Location:\n file:///mnt/vss/_work/1/azure-rest-api-specs/specification/synapse/data-plane/Microsoft.Synapse/stable/2020-12-01/entityTypes/Pipeline.json#/components/schemas/SynapseSparkJobActivityTypeProperties-filesItem"

The following errors/warnings exist before current PR submission:

Only 30 items are listed, please refer to log for more details.

Rule	Message
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"datafactory/resource-manager/readme.md", "tag":"package-2018-06", "details":"Schema 'DataFlowSource' has a property 'dataset' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSource"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"datafactory/resource-manager/readme.md", "tag":"package-2018-06", "details":"Schema 'DataFlowSource' has a property 'linkedService' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSource"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"datafactory/resource-manager/readme.md", "tag":"package-2018-06", "details":"Schema 'DataFlowSource' has a property 'flowlet' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSource"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"datafactory/resource-manager/readme.md", "tag":"package-2018-06", "details":"Schema 'DataFlowSink' has a property 'dataset' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSink"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"datafactory/resource-manager/readme.md", "tag":"package-2018-06", "details":"Schema 'DataFlowSink' has a property 'linkedService' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSink"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"datafactory/resource-manager/readme.md", "tag":"package-2018-06", "details":"Schema 'DataFlowSink' has a property 'flowlet' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSink"
⚠️ UnkownSecurityScheme	"readme":"datafactory/resource-manager/readme.md", "tag":"package-2018-06", "details":"Security scheme azure_auth is unknown and will not be processed. Only supported types are AADToken, AzureKey, Anonymous"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v4", "details":"Schema 'DataFlowSource' has a property 'dataset' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSource"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v4", "details":"Schema 'DataFlowSource' has a property 'linkedService' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSource"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v4", "details":"Schema 'DataFlowSource' has a property 'flowlet' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSource"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v4", "details":"Schema 'DataFlowSink' has a property 'dataset' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSink"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v4", "details":"Schema 'DataFlowSink' has a property 'linkedService' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSink"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v4", "details":"Schema 'DataFlowSink' has a property 'flowlet' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSink"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v3", "details":"Schema 'DataFlowSource' has a property 'dataset' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSource"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v3", "details":"Schema 'DataFlowSource' has a property 'linkedService' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSource"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v3", "details":"Schema 'DataFlowSource' has a property 'flowlet' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSource"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v3", "details":"Schema 'DataFlowSink' has a property 'dataset' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSink"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v3", "details":"Schema 'DataFlowSink' has a property 'linkedService' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSink"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v3", "details":"Schema 'DataFlowSink' has a property 'flowlet' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSink"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v2", "details":"Schema 'DataFlowSource' has a property 'dataset' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSource"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v2", "details":"Schema 'DataFlowSource' has a property 'linkedService' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSource"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v2", "details":"Schema 'DataFlowSource' has a property 'flowlet' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSource"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v2", "details":"Schema 'DataFlowSink' has a property 'dataset' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSink"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v2", "details":"Schema 'DataFlowSink' has a property 'linkedService' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSink"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v2", "details":"Schema 'DataFlowSink' has a property 'flowlet' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSink"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v1", "details":"Schema 'DataFlowSource' has a property 'dataset' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSource"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v1", "details":"Schema 'DataFlowSource' has a property 'linkedService' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSource"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v1", "details":"Schema 'DataFlowSource' has a property 'flowlet' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSource"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v1", "details":"Schema 'DataFlowSink' has a property 'dataset' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSink"
⚠️ PreCheck/PropertyRedeclarationWarning	"readme":"synapse/data-plane/readme.md", "tag":"package-artifacts-composite-v1", "details":"Schema 'DataFlowSink' has a property 'linkedService' that is already declared the parent schema 'Transformation' but isn't significantly different. The property has been removed from DataFlowSink"

️️✔️PrettierCheck succeeded [Detail] [Expand]

Validation passes for PrettierCheck.

️️✔️SpellCheck succeeded [Detail] [Expand]

Validation passes for SpellCheck.

️️✔️Lint(RPaaS) succeeded [Detail] [Expand]

Validation passes for Lint(RPaaS).

️️✔️CadlValidation succeeded [Detail] [Expand]

Validation passes for CadlValidation.

_{Posted by Swagger Pipeline | How to fix these errors?}

openapi-pipeline-app · 2022-07-14T04:55:23Z

Swagger Generation Artifacts

️🔄ApiDocPreview inProgress [Detail]

️️✔️SDK Breaking Change Tracking succeeded [Detail] [Expand]

Breaking Changes Tracking

️⌛ azure-sdk-for-net pending [Detail]

️⌛ azure-sdk-for-python-track2 pending [Detail]

️⌛ azure-sdk-for-java pending [Detail]

️⌛ azure-sdk-for-go pending [Detail]

️⌛ azure-sdk-for-js pending [Detail]

️⌛ azure-resource-manager-schemas pending [Detail]

️🔄 azure-powershell inProgress [Detail]

_{Posted by Swagger Pipeline | How to fix these errors?}

openapi-workflow-bot · 2022-07-14T04:55:24Z

Hi, @wonner Thanks for your PR. I am workflow bot for review process. Here are some small tips.

Please ensure to do self-check against checklists in first PR comment.

PR assignee is the person auto-assigned and responsible for your current PR reviewing and merging.

For specs comparison cross API versions, Use API Specs Comparison Report Generator

If there is CI failure(s), to fix CI error(s) is mandatory for PR merging; or you need to provide justification in PR comment for explanation. How to fix?

Any feedback about review process or workflow bot, pls contact swagger and tools team. vscswagger@microsoft.com

openapi-pipeline-app · 2022-07-14T05:01:19Z

Swagger Generation Artifacts

️️✔️ApiDocPreview succeeded [Detail] [Expand]

 Please click here to preview with your @microsoft account.

️❌SDK Breaking Change Tracking failed [Detail]

Breaking Changes Tracking

❌azure-sdk-for-go - armdatafactory - 2.0.0

️✔️azure-sdk-for-python-track2 - track2_azure-mgmt-datafactory - 2.7.0

️❌ azure-sdk-for-net failed [Detail]

❌Failed [Logs]Release - Generate from c424256. SDK Automation 14.0.0

warn	Skip initScript due to not configured
command	sudo apt-get install -y dotnet-sdk-6.0
warn		specification/synapse/data-plane/readme.md skipped due to azure-sdk-for-net not found in swagger-to-sdk
command	autorest --version=2.0.4421 --csharp --reflect-api-versions --license-header=MICROSOFT_MIT_NO_VERSION --use=@microsoft.azure/autorest.csharp@2.3.82 --csharp-sdks-folder=/mnt/vss/_work/1/s/azure-sdk-for-net/sdk ../azure-rest-api-specs/specification/datafactory/resource-manager/readme.md
cmderr	[Autorest] realpath(): Permission denied
cmderr	[Autorest] realpath(): Permission denied
cmderr	[Autorest] realpath(): Permission denied
cmderr	[Autorest] realpath(): Permission denied
cmderr	[Autorest] realpath(): Permission denied
cmderr	[Autorest] realpath(): Permission denied
cmderr	[Autorest] No usable version of the libssl was found
cmderr	[Autorest] FATAL: csharp/simplifier - FAILED
cmderr	[Autorest] FATAL: Error: [Exception] AutoRest extension '@microsoft.azure/autorest.csharp' terminated.
cmderr	[Autorest] Process() cancelled due to exception : [Exception] AutoRest extension '@microsoft.azure/autorest.csharp' terminated.
error	Script return with result [failed] code [1] signal [null] cwd [azure-sdk-for-net]: autorest
warn	Skip package processing as generation is failed

️⚠️ azure-sdk-for-python-track2 warning [Detail]

⚠️Warning [Logs]Release - Generate from c424256. SDK Automation 14.0.0

command	sh scripts/automation_init.sh ../azure-sdk-for-python_tmp/initInput.json ../azure-sdk-for-python_tmp/initOutput.json
cmderr	[automation_init.sh] WARNING: Skipping azure-nspkg as it is not installed.
warn		specification/synapse/data-plane/readme.md skipped due to azure-sdk-for-python-track2 not found in swagger-to-sdk
command	sh scripts/automation_generate.sh ../azure-sdk-for-python_tmp/generateInput.json ../azure-sdk-for-python_tmp/generateOutput.json
cmderr	[automation_generate.sh]  config global `--global`, `--local` are deprecated. Use `--location=global` instead.

️✔️track2_azure-mgmt-datafactory [View full logs] [Release SDK Changes]

info	[Changelog] **Features**
info	[Changelog]
info	[Changelog]   - Added model AzureSynapseArtifactsLinkedService
info	[Changelog]   - Added model BigDataPoolParametrizationReference
info	[Changelog]   - Added model BigDataPoolReferenceType
info	[Changelog]   - Added model NotebookParameter
info	[Changelog]   - Added model NotebookParameterType
info	[Changelog]   - Added model NotebookReferenceType
info	[Changelog]   - Added model SparkJobReferenceType
info	[Changelog]   - Added model SynapseNotebookActivity
info	[Changelog]   - Added model SynapseNotebookReference
info	[Changelog]   - Added model SynapseSparkJobDefinitionActivity
info	[Changelog]   - Added model SynapseSparkJobReference
info	[Changelog]   - Added model Type

️⚠️ azure-sdk-for-java warning [Detail]

⚠️Warning [Logs]Release - Generate from c424256. SDK Automation 14.0.0

command	./eng/mgmt/automation/init.sh ../azure-sdk-for-java_tmp/initInput.json ../azure-sdk-for-java_tmp/initOutput.json
command	./eng/mgmt/automation/generate.py ../azure-sdk-for-java_tmp/generateInput.json ../azure-sdk-for-java_tmp/generateOutput.json
cmderr	[generate.py] [ForkJoinPool-1-worker-3] INFO com.azure.core.test.implementation.TestingHelpers - Environment variable 'AZURE_TEST_MODE' has not been set yet. Using 'Playback' mode.

️✔️azure-resourcemanager-datafactory [View full logs] [Release SDK Changes]

️️✔️ azure-sdk-for-go succeeded [Detail] [Expand]

️✔️Succeeded [Logs]Release - Generate from c424256. SDK Automation 14.0.0

command	sh ./eng/scripts/automation_init.sh ../../../../../azure-sdk-for-go_tmp/initInput.json ../../../../../azure-sdk-for-go_tmp/initOutput.json
warn		specification/synapse/data-plane/readme.md skipped due to azure-sdk-for-go not found in swagger-to-sdk
command	generator automation-v2 ../../../../../azure-sdk-for-go_tmp/generateInput.json ../../../../../azure-sdk-for-go_tmp/generateOutput.json

️✔️armdatafactory [View full logs] [Release SDK Changes] Breaking Change Detected

info	[Changelog] ### Breaking Changes
info	[Changelog]
info	[Changelog] - Type of `LinkedServiceReference.Type` has been changed from `*LinkedServiceReferenceType` to `*Type`
info	[Changelog] - Const `LinkedServiceReferenceTypeLinkedServiceReference` has been removed
info	[Changelog] - Function `PossibleLinkedServiceReferenceTypeValues` has been removed
info	[Changelog]
info	[Changelog] ### Features Added
info	[Changelog]
info	[Changelog] - New const `TypeLinkedServiceReference`
info	[Changelog] - New const `BigDataPoolReferenceTypeBigDataPoolReference`
info	[Changelog] - New const `NotebookParameterTypeFloat`
info	[Changelog] - New const `NotebookParameterTypeInt`
info	[Changelog] - New const `SparkJobReferenceTypeSparkJobDefinitionReference`
info	[Changelog] - New const `NotebookReferenceTypeNotebookReference`
info	[Changelog] - New const `NotebookParameterTypeBool`
info	[Changelog] - New const `NotebookParameterTypeString`
info	[Changelog] - New function `PossibleSparkJobReferenceTypeValues() []SparkJobReferenceType`
info	[Changelog] - New function `PossibleNotebookReferenceTypeValues() []NotebookReferenceType`
info	[Changelog] - New function `PossibleBigDataPoolReferenceTypeValues() []BigDataPoolReferenceType`
info	[Changelog] - New function `PossibleNotebookParameterTypeValues() []NotebookParameterType`
info	[Changelog] - New function `PossibleTypeValues() []Type`
info	[Changelog] - New function `*SynapseNotebookActivity.GetActivity() *Activity`
info	[Changelog] - New function `*AzureSynapseArtifactsLinkedService.GetLinkedService() *LinkedService`
info	[Changelog] - New function `*SynapseSparkJobDefinitionActivity.GetActivity() *Activity`
info	[Changelog] - New function `*SynapseSparkJobDefinitionActivity.GetExecutionActivity() *ExecutionActivity`
info	[Changelog] - New function `*SynapseNotebookActivity.GetExecutionActivity() *ExecutionActivity`
info	[Changelog] - New struct `AzureSynapseArtifactsLinkedService`
info	[Changelog] - New struct `AzureSynapseArtifactsLinkedServiceTypeProperties`
info	[Changelog] - New struct `BigDataPoolParametrizationReference`
info	[Changelog] - New struct `NotebookParameter`
info	[Changelog] - New struct `SynapseNotebookActivity`
info	[Changelog] - New struct `SynapseNotebookActivityTypeProperties`
info	[Changelog] - New struct `SynapseNotebookReference`
info	[Changelog] - New struct `SynapseSparkJobActivityTypeProperties`
info	[Changelog] - New struct `SynapseSparkJobDefinitionActivity`
info	[Changelog] - New struct `SynapseSparkJobReference`
info	[Changelog]
info	[Changelog] Total 3 breaking change(s), 38 additive change(s).

️❌ azure-sdk-for-js failed [Detail]

❌Failed [Logs]Release - Generate from c424256. SDK Automation 14.0.0

command	sh .scripts/automation_init.sh ../azure-sdk-for-js_tmp/initInput.json ../azure-sdk-for-js_tmp/initOutput.json
cmderr	[automation_init.sh] deprecated read-package-tree@5.1.6: The functionality that this package provided is now in @npmcli/arborist
cmderr	[automation_init.sh]  @opentelemetry/types@0.2.0: Package renamed to @opentelemetry/api, see https://github.com/open-telemetry/opentelemetry-js
cmderr	[automation_init.sh] npm WARN deprecated uuid@3.4.0: Please upgrade  to version 7 or higher.  Older versions may use Math.random() in certain circumstances, which is known to be problematic.  See https://v8.dev/blog/math-random for details.
cmderr	[automation_init.sh] deprecated @azure/storage-blob@10.5.0: This version has been deprecated, please upgrade to the version tagged as latest
cmderr	[automation_init.sh] npm WARN @octokit/plugin-request-log@1.0.4 requires a peer of @octokit/core@>=3 but none is installed. You must install peer dependencies yourself.
warn	File azure-sdk-for-js_tmp/initOutput.json not found to read
command	sh .scripts/automation_generate.sh ../azure-sdk-for-js_tmp/generateInput.json ../azure-sdk-for-js_tmp/generateOutput.json

️✔️@azure/arm-datafactory [View full logs] [Release SDK Changes]

azure-arm-datafactory-10.8.0.tgz

Only show 120 items here, please refer to log for details.

info	[Changelog]   - Added Type Alias SapCloudForCustomerLinkedService
info	[Changelog]   - Added Type Alias SapCloudForCustomerResourceDataset
info	[Changelog]   - Added Type Alias SapCloudForCustomerSink
info	[Changelog]   - Added Type Alias SapCloudForCustomerSource
info	[Changelog]   - Added Type Alias SapEccLinkedService
info	[Changelog]   - Added Type Alias SapEccResourceDataset
info	[Changelog]   - Added Type Alias SapEccSource
info	[Changelog]   - Added Type Alias SapHanaLinkedService
info	[Changelog]   - Added Type Alias SapHanaSource
info	[Changelog]   - Added Type Alias SapHanaTableDataset
info	[Changelog]   - Added Type Alias SapOdpLinkedService
info	[Changelog]   - Added Type Alias SapOdpResourceDataset
info	[Changelog]   - Added Type Alias SapOdpSource
info	[Changelog]   - Added Type Alias SapOpenHubLinkedService
info	[Changelog]   - Added Type Alias SapOpenHubSource
info	[Changelog]   - Added Type Alias SapOpenHubTableDataset
info	[Changelog]   - Added Type Alias SapTableLinkedService
info	[Changelog]   - Added Type Alias SapTableResourceDataset
info	[Changelog]   - Added Type Alias SapTableSource
info	[Changelog]   - Added Type Alias ScheduleTrigger
info	[Changelog]   - Added Type Alias ScriptActivity
info	[Changelog]   - Added Type Alias SecureString
info	[Changelog]   - Added Type Alias SelfDependencyTumblingWindowTriggerReference
info	[Changelog]   - Added Type Alias SelfHostedIntegrationRuntime
info	[Changelog]   - Added Type Alias SelfHostedIntegrationRuntimeStatus
info	[Changelog]   - Added Type Alias ServiceNowLinkedService
info	[Changelog]   - Added Type Alias ServiceNowObjectDataset
info	[Changelog]   - Added Type Alias ServiceNowSource
info	[Changelog]   - Added Type Alias ServicePrincipalCredential
info	[Changelog]   - Added Type Alias SetVariableActivity
info	[Changelog]   - Added Type Alias SftpLocation
info	[Changelog]   - Added Type Alias SftpReadSettings
info	[Changelog]   - Added Type Alias SftpServerLinkedService
info	[Changelog]   - Added Type Alias SftpWriteSettings
info	[Changelog]   - Added Type Alias SharePointOnlineListLinkedService
info	[Changelog]   - Added Type Alias SharePointOnlineListResourceDataset
info	[Changelog]   - Added Type Alias SharePointOnlineListSource
info	[Changelog]   - Added Type Alias ShopifyLinkedService
info	[Changelog]   - Added Type Alias ShopifyObjectDataset
info	[Changelog]   - Added Type Alias ShopifySource
info	[Changelog]   - Added Type Alias SmartsheetLinkedService
info	[Changelog]   - Added Type Alias SnowflakeDataset
info	[Changelog]   - Added Type Alias SnowflakeExportCopyCommand
info	[Changelog]   - Added Type Alias SnowflakeImportCopyCommand
info	[Changelog]   - Added Type Alias SnowflakeLinkedService
info	[Changelog]   - Added Type Alias SnowflakeSink
info	[Changelog]   - Added Type Alias SnowflakeSource
info	[Changelog]   - Added Type Alias SparkJobReferenceType
info	[Changelog]   - Added Type Alias SparkLinkedService
info	[Changelog]   - Added Type Alias SparkObjectDataset
info	[Changelog]   - Added Type Alias SparkSource
info	[Changelog]   - Added Type Alias SqlDWSink
info	[Changelog]   - Added Type Alias SqlDWSource
info	[Changelog]   - Added Type Alias SqlMISink
info	[Changelog]   - Added Type Alias SqlMISource
info	[Changelog]   - Added Type Alias SqlServerLinkedService
info	[Changelog]   - Added Type Alias SqlServerSink
info	[Changelog]   - Added Type Alias SqlServerSource
info	[Changelog]   - Added Type Alias SqlServerStoredProcedureActivity
info	[Changelog]   - Added Type Alias SqlServerTableDataset
info	[Changelog]   - Added Type Alias SqlSink
info	[Changelog]   - Added Type Alias SqlSource
info	[Changelog]   - Added Type Alias SquareLinkedService
info	[Changelog]   - Added Type Alias SquareObjectDataset
info	[Changelog]   - Added Type Alias SquareSource
info	[Changelog]   - Added Type Alias SsisEnvironment
info	[Changelog]   - Added Type Alias SsisFolder
info	[Changelog]   - Added Type Alias SsisPackage
info	[Changelog]   - Added Type Alias SsisProject
info	[Changelog]   - Added Type Alias SwitchActivity
info	[Changelog]   - Added Type Alias SybaseLinkedService
info	[Changelog]   - Added Type Alias SybaseSource
info	[Changelog]   - Added Type Alias SybaseTableDataset
info	[Changelog]   - Added Type Alias SynapseNotebookActivity
info	[Changelog]   - Added Type Alias SynapseSparkJobDefinitionActivity
info	[Changelog]   - Added Type Alias TabularSource
info	[Changelog]   - Added Type Alias TabularTranslator
info	[Changelog]   - Added Type Alias TarGZipReadSettings
info	[Changelog]   - Added Type Alias TarReadSettings
info	[Changelog]   - Added Type Alias TeamDeskLinkedService
info	[Changelog]   - Added Type Alias TeradataLinkedService
info	[Changelog]   - Added Type Alias TeradataSource
info	[Changelog]   - Added Type Alias TeradataTableDataset
info	[Changelog]   - Added Type Alias TextFormat
info	[Changelog]   - Added Type Alias TriggerDependencyReference
info	[Changelog]   - Added Type Alias TriggerResource
info	[Changelog]   - Added Type Alias TumblingWindowTrigger
info	[Changelog]   - Added Type Alias TumblingWindowTriggerDependencyReference
info	[Changelog]   - Added Type Alias TwilioLinkedService
info	[Changelog]   - Added Type Alias UntilActivity
info	[Changelog]   - Added Type Alias ValidationActivity
info	[Changelog]   - Added Type Alias VerticaLinkedService
info	[Changelog]   - Added Type Alias VerticaSource
info	[Changelog]   - Added Type Alias VerticaTableDataset
info	[Changelog]   - Added Type Alias WaitActivity
info	[Changelog]   - Added Type Alias WebActivity
info	[Changelog]   - Added Type Alias WebAnonymousAuthentication
info	[Changelog]   - Added Type Alias WebBasicAuthentication
info	[Changelog]   - Added Type Alias WebClientCertificateAuthentication
info	[Changelog]   - Added Type Alias WebHookActivity
info	[Changelog]   - Added Type Alias WebLinkedService
info	[Changelog]   - Added Type Alias WebSource
info	[Changelog]   - Added Type Alias WebTableDataset
info	[Changelog]   - Added Type Alias WranglingDataFlow
info	[Changelog]   - Added Type Alias XeroLinkedService
info	[Changelog]   - Added Type Alias XeroObjectDataset
info	[Changelog]   - Added Type Alias XeroSource
info	[Changelog]   - Added Type Alias XmlDataset
info	[Changelog]   - Added Type Alias XmlReadSettings
info	[Changelog]   - Added Type Alias XmlSource
info	[Changelog]   - Added Type Alias ZendeskLinkedService
info	[Changelog]   - Added Type Alias ZipDeflateReadSettings
info	[Changelog]   - Added Type Alias ZohoLinkedService
info	[Changelog]   - Added Type Alias ZohoObjectDataset
info	[Changelog]   - Added Type Alias ZohoSource
info	[Changelog]   - Added Enum KnownBigDataPoolReferenceType
info	[Changelog]   - Added Enum KnownNotebookParameterType
info	[Changelog]   - Added Enum KnownNotebookReferenceType
info	[Changelog]   - Added Enum KnownSparkJobReferenceType
error	breakingChangeTracking is enabled, but version or changelogItem is not found in output.

️⚠️ azure-resource-manager-schemas warning [Detail]

⚠️Warning [Logs]Release - Generate from c424256. Schema Automation 14.0.0

command	.sdkauto/initScript.sh ../azure-resource-manager-schemas_tmp/initInput.json ../azure-resource-manager-schemas_tmp/initOutput.json
cmderr	[initScript.sh]  old lockfile
cmderr	[initScript.sh] npm WARN old lockfile The package-lock.json file was created with an old version of npm,
cmderr	[initScript.sh] npm WARN old lockfile so supplemental metadata must be fetched from the registry.
cmderr	[initScript.sh] npm WARN old lockfile
cmderr	[initScript.sh] npm WARN old lockfile This is a one-time fix-up, please be patient...
cmderr	[initScript.sh] npm WARN old lockfile
warn	File azure-resource-manager-schemas_tmp/initOutput.json not found to read
command	.sdkauto/generateScript.sh ../azure-resource-manager-schemas_tmp/generateInput.json ../azure-resource-manager-schemas_tmp/generateOutput.json

️✔️datafactory [View full logs] [Release Schema Changes]

️❌ azure-powershell failed [Detail]

❌Failed [Logs]Release - Generate from c424256. SDK Automation 14.0.0

command	sh ./tools/SwaggerCI/init.sh ../azure-powershell_tmp/initInput.json ../azure-powershell_tmp/initOutput.json
warn		specification/synapse/data-plane/readme.md skipped due to azure-powershell not found in swagger-to-sdk
command	pwsh ./tools/SwaggerCI/psci.ps1 ../azure-powershell_tmp/generateInput.json ../azure-powershell_tmp/generateOutput.json

❌Az.datafactory [View full logs] [Release SDK Changes]

_{Posted by Swagger Pipeline | How to fix these errors?}

openapi-workflow-bot · 2022-07-14T05:01:22Z

NewApiVersionRequired reason:

A service’s API is a contract with customers and is represented by using the api-version query parameter. Changes such as adding an optional property to a request/response or introducing a new operation is a change to the service’s contract and therefore requires a new api-version value. This is critically important for documentation, client libraries, and customer support.

EXAMPLE: if a customer calls a service in the public cloud using api-version=2020-07-27, the new property or operation may exist but if they call the service in a government cloud, air-gapped cloud, or Azure Stack Hub cloud using the same api-version, the property or operation may not exist. Because there is no clear relationship between the service api-version and the new property/operation, customers can’t trust the documentation and Azure customer have difficulty helping customers diagnose issues. In addition, each client library version documents the service version it supports. When an optional property or new operation is added to a service and its Swagger, new client libraries must be produced to expose this functionality to customers. Without updating the api-version, it is unclear to customers which version of a client library supports these new features.

openapi-workflow-bot · 2022-07-14T05:03:29Z

Hi @wonner, Your PR has some issues. Please fix the CI sequentially by following the order of Avocado, semantic validation, model validation, breaking change, lintDiff. If you have any questions, please post your questions in this channel https://aka.ms/swaggersupport.

Task	How to fix	Priority
Avocado	Fix-Avocado	High
Semantic validation	Fix-SemanticValidation-Error	High
Model validation	Fix-ModelValidation-Error	High
LintDiff	Fix-LintDiff	high

If you need further help, please feedback via swagger feedback.

openapi-workflow-bot · 2022-07-14T05:50:23Z

Hi @wonner, one or multiple breaking change(s) is detected in your PR. Please check out the breaking change(s), and provide business justification in the PR comment and @ PR assignee why you must have these change(s), and how external customer impact can be mitigated. Please ensure to follow breaking change policy to request breaking change review and approval before proceeding swagger PR review.
Action: To initiate an evaluation of the breaking change, create a new intake using the template for breaking changes. Addition details on the process and office hours are on the Breaking change Wiki.
If you want to know the production traffic statistic, please see ARM Traffic statistic.
If you think it is false positive breaking change, please provide the reasons in the PR comment, report to Swagger Tooling Team via https://aka.ms/swaggerfeedback.
Note: To avoid breaking change, you can refer to Shift Left Solution for detecting breaking change in early phase at your service code repository.

wonner added 2 commits July 14, 2022 11:21

add spark activities into adf

b8f26ac

add reference

e49ea34

wonner requested review from a team, Frey-Wang, zhangyd2015 and davidzhaoyue as code owners July 14, 2022 04:55

wonner requested review from scgbear and rysweet and removed request for a team July 14, 2022 04:55

openapi-assignment-bot bot assigned lmazuel Jul 14, 2022

openapi-workflow-bot bot added the ShiftLeftViolation label Jul 14, 2022

azure-sdk mentioned this pull request Jul 14, 2022

[AutoPR armdatafactory] [DataFactory] Add synapse spark activities azure-sdk/azure-sdk-for-go#1727

Closed

openapi-pipeline-app bot added the NewApiVersionRequired label Jul 14, 2022

openapi-pipeline-app bot added the CI-BreakingChange-Go label Jul 14, 2022

azure-sdk mentioned this pull request Jul 14, 2022

[AutoPR datafactory] [DataFactory] Add synapse spark activities azure-sdk/azure-resource-manager-schemas#603

Closed

openapi-pipeline-app bot added the CI-FixRequiredOnFailure label Jul 14, 2022

.\specification\

eea5dd2

openapi-pipeline-app bot added the BreakingChangeReviewRequired label Jul 14, 2022

JeffreyRichter added the Approved-BreakingChange DO NOT USE! OBSOLETE label. See https://github.com/Azure/azure-sdk-tools/issues/6374 label Jul 14, 2022

lmazuel merged commit c424256 into Azure:main Jul 14, 2022

Jingshu923 mentioned this pull request Sep 5, 2022

[DataFactory]Added new features into 6.4.0 Azure/azure-sdk-for-net#30924

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[DataFactory] Add synapse spark activities #19769

[DataFactory] Add synapse spark activities #19769

wonner commented Jul 14, 2022

openapi-workflow-bot bot commented Jul 14, 2022

openapi-pipeline-app bot commented Jul 14, 2022 •

edited

Loading

openapi-pipeline-app bot commented Jul 14, 2022 •

edited

Loading

Breaking Changes Tracking

openapi-workflow-bot bot commented Jul 14, 2022

openapi-pipeline-app bot commented Jul 14, 2022 •

edited

Loading

Breaking Changes Tracking

openapi-workflow-bot bot commented Jul 14, 2022

openapi-workflow-bot bot commented Jul 14, 2022

openapi-workflow-bot bot commented Jul 14, 2022

[DataFactory] Add synapse spark activities #19769

[DataFactory] Add synapse spark activities #19769

Conversation

wonner commented Jul 14, 2022

Changelog

Contribution checklist:

ARM API Review Checklist

Breaking Change Review Checklist

openapi-workflow-bot bot commented Jul 14, 2022

openapi-pipeline-app bot commented Jul 14, 2022 • edited Loading

Swagger Validation Report

openapi-pipeline-app bot commented Jul 14, 2022 • edited Loading

Swagger Generation Artifacts

Breaking Changes Tracking

openapi-workflow-bot bot commented Jul 14, 2022

openapi-pipeline-app bot commented Jul 14, 2022 • edited Loading

Swagger Generation Artifacts

Breaking Changes Tracking

openapi-workflow-bot bot commented Jul 14, 2022

openapi-workflow-bot bot commented Jul 14, 2022

openapi-workflow-bot bot commented Jul 14, 2022

openapi-pipeline-app bot commented Jul 14, 2022 •

edited

Loading

openapi-pipeline-app bot commented Jul 14, 2022 •

edited

Loading

openapi-pipeline-app bot commented Jul 14, 2022 •

edited

Loading