azure-powershell
azure-powershell copied to clipboard
Azure
Set-AzDataFactoryV2Pipeline - pipelineReturnValue deserialise value json and set setSystemVariable
Description
cmdlet Set-AzDataFactoryV2Pipeline does not deserialize the json structure contained in the value attribute of a SetVariable activity where the variableName is "pipelineReturnValue" as is configured when setting the variable type to pipeline return value.
In addition the setSystemVariable attribute is not published resulting in a "Variable in Set Variable Does Not Exists" error
Configured through UI
{
"name": "Example",
"properties": {
"activities": [
{
"name": "Set SomeValue",
"type": "SetVariable",
"dependsOn": [],
"userProperties": [],
"typeProperties": {
"variableName": "pipelineReturnValue",
"value": [
{
"key": "SomeValue",
"value": {
"type": "String",
"content": "FooBar"
}
}
],
"setSystemVariable": true
}
}
],
"parameters": {},
"variables": {},
"annotations": []
},
"type": "Microsoft.DataFactory/factories/pipelines"
}
Published via Set-AzDataFactoryV2Pipeline
{
"name": "Example",
"properties": {
"activities": [
{
"name": "Set SomeValue",
"type": "SetVariable",
"dependsOn": [],
"userProperties": [],
"typeProperties": {
"variableName": "pipelineReturnValue",
"value": "[{\"key\":\"SomeValue\",\"value\":{\"type\":\"String\",\"content\":\"FooBar\"}}]"
}
}
],
"annotations": [],
"lastPublishTime": "2023-05-02T02:08:29Z"
},
"type": "Microsoft.DataFactory/factories/pipelines"
}
Issue script & Debug output
DEBUG: 12:08:28 PM - SetAzureDataFactoryPipelineCommand begin processing with ParameterSet 'ByFactoryName'.
DEBUG: 12:08:28 PM - using account id '###############'...
DEBUG: 12:08:28 PM - [ConfigManager] Got nothing from [DisplayBreakingChangeWarning], Module = [], Cmdlet = []. Returning default value [True].
DEBUG: [Common.Authentication]: Authenticating using Account: '###############', environment: 'AzureCloud', tenant: '###############'
DEBUG: 12:08:28 PM - [SilentAuthenticator] Calling SharedTokenCacheCredential.GetTokenAsync - TenantId:'###############', Scopes:'https://management.core.windows.net//.default', AuthorityHost:'https://login.microsoftonline.com/', UserId:'###############'
DEBUG: SharedTokenCacheCredential.GetToken invoked. Scopes: [ https://management.core.windows.net//.default ] ParentRequestId:
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] IsLegacyAdalCacheEnabled: yes
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] [Region discovery] Not using a regional authority.
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] [Region discovery] Not using a regional authority.
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] IsLegacyAdalCacheEnabled: yes
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] IsLegacyAdalCacheEnabled: yes
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95] Found 1 cache accounts and 0 broker accounts
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95] Returning 1 accounts
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] MSAL MSAL.NetCore with assembly version '4.39.0.0'. CorrelationId(###############)
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] === AcquireTokenSilent Parameters ===
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] LoginHint provided: False
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] Account provided: True
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] ForceRefresh: False
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############]
=== Request Data ===
Authority Provided? - True
Scopes - https://management.core.windows.net//.default
Extra Query Params Keys (space separated) -
ApiId - AcquireTokenSilent
IsConfidentialClient - False
SendX5C - False
LoginHint ? False
IsBrokerConfigured - False
HomeAccountId - False
CorrelationId - ###############
UserAssertion set: False
LongRunningOboCacheKey set: False
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] === Token Acquisition (SilentRequest) started:
Scopes: https://management.core.windows.net//.default
Authority Host: login.microsoftonline.com
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.97 - ###############] [Region discovery] Not using a regional authority.
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.97 - ###############] Access token is not expired. Returning the found cache entry. [Current time (05/02/2023 02:08:28) - Expiration Time (05/02/2023 03:19:39 +00:00) - Extended Expiration Time (05/02/2023 03:19:39 +00:00)]
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.97 - ###############] Returning access token found in cache. RefreshOn exists ? False
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.97 - ###############] [Region discovery] Not using a regional authority.
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.97 - ###############] Fetched access token from host login.microsoftonline.com.
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.97 - ###############]
=== Token Acquisition finished successfully:
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.97 - ###############] AT expiration time: 2/05/2023 3:19:39 AM +00:00, scopes https://management.core.windows.net//user_impersonation https://management.core.windows.net//.default source Cache from login.microsoftonline.com appHashCode ###############
DEBUG: SharedTokenCacheCredential.GetToken succeeded. Scopes: [ https://management.core.windows.net//.default ] ParentRequestId: ExpiresOn: 2023-05-02T03:19:39.0000000+00:00
DEBUG: [Common.Authentication]: Received token with LoginType 'User', Tenant: '###############', UserId: '###############'
DEBUG: ============================ HTTP REQUEST ============================
HTTP Method:
PUT
Absolute Uri:
https://management.azure.com/subscriptions/###############/resourceGroups/###############/providers/Microsoft.DataFactory/factories/###############/pipelines/Example?api-version=2018-06-01
Headers:
Accept-Language : en-US
x-ms-client-request-id : ###############
Body:
{
"properties": {
"activities": [
{
"type": "SetVariable",
"typeProperties": {
"variableName": "pipelineReturnValue",
"value": [
{
"key": "SomeValue",
"value": {
"type": "String",
"content": "FooBar"
}
}
]
},
"name": "Set SomeValue",
"dependsOn": [],
"userProperties": []
}
],
"parameters": {},
"variables": {},
"annotations": []
}
}
DEBUG: ============================ HTTP RESPONSE ============================
Status Code:
OK
Headers:
Cache-Control : no-cache
Pragma : no-cache
x-ms-correlation-request-id : ###############
Server : Kestrel
x-ms-ratelimit-remaining-subscription-writes: 1199
x-ms-request-id : ###############
x-ms-routing-request-id : ###############
Strict-Transport-Security : max-age=31536000; includeSubDomains
X-Content-Type-Options : nosniff
Date : Tue, 02 May 2023 02:08:29 GMT
Body:
{
"id": "/subscriptions/###############/resourceGroups/###############/providers/Microsoft.DataFactory/factories/###############/pipelines/Example",
"name": "Example",
"type": "Microsoft.DataFactory/factories/pipelines",
"properties": {
"activities": [
{
"type": "SetVariable",
"typeProperties": {
"variableName": "pipelineReturnValue",
"value": [
{
"key": "SomeValue",
"value": {
"type": "String",
"content": "FooBar"
}
}
]
},
"name": "Set SomeValue",
"dependsOn": [],
"userProperties": []
}
],
"parameters": {},
"variables": {},
"annotations": []
},
"etag": "3e005050-0000-1a00-0000-6450709d0000"
}
DEBUG: 12:08:29 PM - [ConfigManager] Got nothing from [EnableDataCollection], Module = [], Cmdlet = []. Returning default value [True].
DEBUG: AzureQoSEvent: Module: Az.DataFactory:1.16.8; CommandName: Set-AzDataFactoryV2Pipeline; PSVersion: 7.3.1; IsSuccess: True; Duration: 00:00:00.7348217
DEBUG: Finish sending metric.
DEBUG: 12:08:29 PM - SetAzureDataFactoryPipelineCommand end processing.
Environment data
Name Value
---- -----
PSVersion 7.3.1
PSEdition Core
GitCommitId 7.3.1
OS Microsoft Windows 10.0.16299
Platform Win32NT
PSCompatibleVersions {1.0, 2.0, 3.0, 4.0…}
PSRemotingProtocolVersion 2.3
SerializationVersion 1.1.0.1
WSManStackVersion 3.0
Module versions
ModuleType Version PreRelease Name ExportedCommands
---------- ------- ---------- ---- ----------------
Script 2.9.0 Az.Accounts {Add-AzEnvironment, Clear-AzConfig, Clear-AzContext, Clear-AzDefault…}
Script 1.16.8 Az.DataFactory {Add-AzDataFactoryV2DataFlowDebugSessionPackage, Add-AzDataFactoryV2TriggerSubscription, Get-AzDataFactory, Get-AzDataFactoryActivityWindow…}
Script 0.110.1 azure.datafactory.tools {Export-AdfToArmTemplate, Get-AdfDocDiagram, Get-AdfFromService, Import-AdfFromFolder…}
Error output
N/A
Thank you for your feedback. This has been routed to the support team for assistance.
@Prefix42 Thanks for your feedback! We will investigate and update as appropriate.
@Prefix42 I am able to reproduce this issue and checking internally on the same. I will get back to you once I have any updates.
Thank you @SaurabhSharma-MSFT, very much appreciated. Eager to get this resolved so we can resume using the pipeline return value feature.
Thank you for your feedback. This has been routed to the support team for assistance.
Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @zhangyd2015, @Frey-Wang, @Jingshu923.
Issue Details
Description
cmdlet Set-AzDataFactoryV2Pipeline does not deserialize the json structure contained in the value attribute of a SetVariable activity where the variableName is "pipelineReturnValue" as is configured when setting the variable type to pipeline return value.
In addition the setSystemVariable attribute is not published resulting in a "Variable in Set Variable Does Not Exists" error
Configured through UI
{
"name": "Example",
"properties": {
"activities": [
{
"name": "Set SomeValue",
"type": "SetVariable",
"dependsOn": [],
"userProperties": [],
"typeProperties": {
"variableName": "pipelineReturnValue",
"value": [
{
"key": "SomeValue",
"value": {
"type": "String",
"content": "FooBar"
}
}
],
"setSystemVariable": true
}
}
],
"parameters": {},
"variables": {},
"annotations": []
},
"type": "Microsoft.DataFactory/factories/pipelines"
}
Published via Set-AzDataFactoryV2Pipeline
{
"name": "Example",
"properties": {
"activities": [
{
"name": "Set SomeValue",
"type": "SetVariable",
"dependsOn": [],
"userProperties": [],
"typeProperties": {
"variableName": "pipelineReturnValue",
"value": "[{\"key\":\"SomeValue\",\"value\":{\"type\":\"String\",\"content\":\"FooBar\"}}]"
}
}
],
"annotations": [],
"lastPublishTime": "2023-05-02T02:08:29Z"
},
"type": "Microsoft.DataFactory/factories/pipelines"
}
Issue script & Debug output
DEBUG: 12:08:28 PM - SetAzureDataFactoryPipelineCommand begin processing with ParameterSet 'ByFactoryName'.
DEBUG: 12:08:28 PM - using account id '###############'...
DEBUG: 12:08:28 PM - [ConfigManager] Got nothing from [DisplayBreakingChangeWarning], Module = [], Cmdlet = []. Returning default value [True].
DEBUG: [Common.Authentication]: Authenticating using Account: '###############', environment: 'AzureCloud', tenant: '###############'
DEBUG: 12:08:28 PM - [SilentAuthenticator] Calling SharedTokenCacheCredential.GetTokenAsync - TenantId:'###############', Scopes:'https://management.core.windows.net//.default', AuthorityHost:'https://login.microsoftonline.com/', UserId:'###############'
DEBUG: SharedTokenCacheCredential.GetToken invoked. Scopes: [ https://management.core.windows.net//.default ] ParentRequestId:
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] IsLegacyAdalCacheEnabled: yes
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] [Region discovery] Not using a regional authority.
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] [Region discovery] Not using a regional authority.
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] IsLegacyAdalCacheEnabled: yes
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] IsLegacyAdalCacheEnabled: yes
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95] Found 1 cache accounts and 0 broker accounts
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95] Returning 1 accounts
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] MSAL MSAL.NetCore with assembly version '4.39.0.0'. CorrelationId(###############)
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] === AcquireTokenSilent Parameters ===
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] LoginHint provided: False
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] Account provided: True
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] ForceRefresh: False
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############]
=== Request Data ===
Authority Provided? - True
Scopes - https://management.core.windows.net//.default
Extra Query Params Keys (space separated) -
ApiId - AcquireTokenSilent
IsConfidentialClient - False
SendX5C - False
LoginHint ? False
IsBrokerConfigured - False
HomeAccountId - False
CorrelationId - ###############
UserAssertion set: False
LongRunningOboCacheKey set: False
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.95 - ###############] === Token Acquisition (SilentRequest) started:
Scopes: https://management.core.windows.net//.default
Authority Host: login.microsoftonline.com
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.97 - ###############] [Region discovery] Not using a regional authority.
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.97 - ###############] Access token is not expired. Returning the found cache entry. [Current time (05/02/2023 02:08:28) - Expiration Time (05/02/2023 03:19:39 +00:00) - Extended Expiration Time (05/02/2023 03:19:39 +00:00)]
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.97 - ###############] Returning access token found in cache. RefreshOn exists ? False
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.97 - ###############] [Region discovery] Not using a regional authority.
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.97 - ###############] Fetched access token from host login.microsoftonline.com.
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.97 - ###############]
=== Token Acquisition finished successfully:
DEBUG: False MSAL 4.39.0.0 MSAL.NetCore .NET 7.0.0 Microsoft Windows 10.0.16299 [05/02 02:08:28.97 - ###############] AT expiration time: 2/05/2023 3:19:39 AM +00:00, scopes https://management.core.windows.net//user_impersonation https://management.core.windows.net//.default source Cache from login.microsoftonline.com appHashCode ###############
DEBUG: SharedTokenCacheCredential.GetToken succeeded. Scopes: [ https://management.core.windows.net//.default ] ParentRequestId: ExpiresOn: 2023-05-02T03:19:39.0000000+00:00
DEBUG: [Common.Authentication]: Received token with LoginType 'User', Tenant: '###############', UserId: '###############'
DEBUG: ============================ HTTP REQUEST ============================
HTTP Method:
PUT
Absolute Uri:
https://management.azure.com/subscriptions/###############/resourceGroups/###############/providers/Microsoft.DataFactory/factories/###############/pipelines/Example?api-version=2018-06-01
Headers:
Accept-Language : en-US
x-ms-client-request-id : ###############
Body:
{
"properties": {
"activities": [
{
"type": "SetVariable",
"typeProperties": {
"variableName": "pipelineReturnValue",
"value": [
{
"key": "SomeValue",
"value": {
"type": "String",
"content": "FooBar"
}
}
]
},
"name": "Set SomeValue",
"dependsOn": [],
"userProperties": []
}
],
"parameters": {},
"variables": {},
"annotations": []
}
}
DEBUG: ============================ HTTP RESPONSE ============================
Status Code:
OK
Headers:
Cache-Control : no-cache
Pragma : no-cache
x-ms-correlation-request-id : ###############
Server : Kestrel
x-ms-ratelimit-remaining-subscription-writes: 1199
x-ms-request-id : ###############
x-ms-routing-request-id : ###############
Strict-Transport-Security : max-age=31536000; includeSubDomains
X-Content-Type-Options : nosniff
Date : Tue, 02 May 2023 02:08:29 GMT
Body:
{
"id": "/subscriptions/###############/resourceGroups/###############/providers/Microsoft.DataFactory/factories/###############/pipelines/Example",
"name": "Example",
"type": "Microsoft.DataFactory/factories/pipelines",
"properties": {
"activities": [
{
"type": "SetVariable",
"typeProperties": {
"variableName": "pipelineReturnValue",
"value": [
{
"key": "SomeValue",
"value": {
"type": "String",
"content": "FooBar"
}
}
]
},
"name": "Set SomeValue",
"dependsOn": [],
"userProperties": []
}
],
"parameters": {},
"variables": {},
"annotations": []
},
"etag": "3e005050-0000-1a00-0000-6450709d0000"
}
DEBUG: 12:08:29 PM - [ConfigManager] Got nothing from [EnableDataCollection], Module = [], Cmdlet = []. Returning default value [True].
DEBUG: AzureQoSEvent: Module: Az.DataFactory:1.16.8; CommandName: Set-AzDataFactoryV2Pipeline; PSVersion: 7.3.1; IsSuccess: True; Duration: 00:00:00.7348217
DEBUG: Finish sending metric.
DEBUG: 12:08:29 PM - SetAzureDataFactoryPipelineCommand end processing.
Environment data
Name Value
---- -----
PSVersion 7.3.1
PSEdition Core
GitCommitId 7.3.1
OS Microsoft Windows 10.0.16299
Platform Win32NT
PSCompatibleVersions {1.0, 2.0, 3.0, 4.0…}
PSRemotingProtocolVersion 2.3
SerializationVersion 1.1.0.1
WSManStackVersion 3.0
Module versions
ModuleType Version PreRelease Name ExportedCommands
---------- ------- ---------- ---- ----------------
Script 2.9.0 Az.Accounts {Add-AzEnvironment, Clear-AzConfig, Clear-AzContext, Clear-AzDefault…}
Script 1.16.8 Az.DataFactory {Add-AzDataFactoryV2DataFlowDebugSessionPackage, Add-AzDataFactoryV2TriggerSubscription, Get-AzDataFactory, Get-AzDataFactoryActivityWindow…}
Script 0.110.1 azure.datafactory.tools {Export-AdfToArmTemplate, Get-AdfDocDiagram, Get-AdfFromService, Import-AdfFromFolder…}
Error output
N/A
| Author: | Prefix42 |
|---|---|
| Assignees: | - |
| Labels: |
|
| Milestone: | - |
I'm having this exact same issue. I was really excited to implement the pipeline return values, now that they are GA. However, It greatly reduces the appeal when I have to manually fix those variables after every deployment.
There is also no easy fix post-deployment. If I enter the set variable activity and change the selection to pipeline return variable, any of the existing JSON gets cleared out and I have to completely enter everything in again. If I decide to update the JSON manually, besides fixing the JSON formatting, I also need to track down the "setSystemVariable": true property since leaving that missing still prevents the ADF from correctly interpreting the JSON.
The "best" solution I've found to date is to either copy the JSON from my repo (and make any environment relevant changes) or copy the JSON with my key names and values, then go to the activity and fill out all the info again.
I'm hoping that the solution to this can be found quickly since I really was hoping to take advantage of returning variable values to the parent pipelines.
Hello,
Is there a fix for this? If not, what is the timeline for the fix to be pushed to production? Set Pipeline Return Value feature is quite effective and it's a shame we can't use it.
As of now, my data factory is configured with git. This means, I can't fix the pipeline return value issue after deployment in the Data Factory Mode. Basically, I will have to abandon the use of it completely.
Let us know when it will be fixed.
Thanks
"I'm having this exact same issue. I was really excited to implement the pipeline return values, now that they are GA. However, It greatly reduces the appeal when I have to manually fix those variables after every deployment."
I am facing this exact issue - unforunately spent days trying to fix it, only to realise it's a bug in ADF/Synapse.
Hi, @SaurabhSharma-MSFT are there any work arounds we can use to achieve the same feature while we await for a fix?
My case is just as simple:
why is azure data factory editor forcefully converting this:
"variableName": "pipelineReturnValue",
"value": [
{
"key": "exists",
"value": {
"type": "Expression",
"content": "@contains(variables(\u0027aggregatedResultForExistingData\u0027), true)"
}
}
]
to:
"variableName": "pipelineReturnValue",
"value": "[{\"key\":\"exists\",\"value\":{\"type\":\"Expression\",\"content\":\"@contains(variables('aggregatedResultForExistingData'), true)\"}}]"
which breaks the pipelineReturnValue logic for returning a value from a pipeline run
Hi @SaurabhSharma-MSFT Can we please get an update on this issue and an ETA (even a rough one to give us some hope)
@zhangyd2015, @Frey-Wang, @Jingshu923 - Can you please look into this issue and provide updates this thread.
@SaurabhSharma-MSFT @zhangyd2015, @Frey-Wang, @Jingshu923 Can we please get some response on this issue?
@zhangyd2015 , @Frey-Wang , @Jingshu923 , @SaurabhSharma-MSFT This seems like such a promising feature. Can we please get an update on when we may be able to start using it with deployed data factories?
@isra-fel , @zhangyd2015 , @Frey-Wang , @Jingshu923 , @SaurabhSharma-MSFT Can we please get an update on this issue?
@isra-fel , @zhangyd2015 , @Frey-Wang , @Jingshu923 , @SaurabhSharma-MSFT Any update? It's now been over a year since the feature went GA.