5,321 questions with Azure Synapse Analytics tags

Sort by: Updated
0 answers

Deltalake change data feed on synapse notebook

Hi Team, Could you please help us we are looking to enable change data feed to existing delta file but it is not working, we have used below steps to enable. set spark.databricks.delta.properties.defaults.enableChangeDataFeed =…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-05-02T06:06:55.0233333+00:00
commented 2025-05-09T12:08:11.1266667+00:00
Dileep Raj Narayan Thumula 15 Reputation points Microsoft External Staff Moderator
1 answer

How to pass parameter from pipeline to synapse notebook ?

Hi, I have added based parameter on my notebook from pipeline but I am unsure how I can use them in the notebook. May I know is there a way to use it ? Thanks in advance.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-05-09T10:31:01.6366667+00:00
Lotus88 156 Reputation points
answered 2025-05-09T11:05:25.6933333+00:00
Nandan Hegde 35,026 Reputation points MVP Moderator
0 answers

Copy Dataverse data into Azure SQL - Cannot read metadata

Hi, I've followed this guide: https://learn.microsoft.com/en-us/power-apps/maker/data-platform/azure-synapse-link-pipelines?tabs=synapse-analytics and I get the error below when running the pipelines. When I investigate the storage account, I can see…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-05-08T04:17:58.81+00:00
Nick 0 Reputation points
commented 2025-05-09T01:23:32.48+00:00
Krupal Bandari 170 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Common location for source and destination DB & server names for all Synapse notebooks to access?

Hi, I have a few Synapse notebooks running concurrently and I have been repeatedly writing the same DB and Server names in different notebooks. Is there a way to enter a common location for the same DB and Server names for all notebooks to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-05-06T01:49:37.8566667+00:00
Lotus88 156 Reputation points
accepted 2025-05-08T06:08:12.3066667+00:00
Lotus88 156 Reputation points
1 answer

Pipeline to wait until spark cluster is available

Hello, We have a very small node cluster and due to multiple spark notebooks running at the same time the notebooks or pipeline fails with 6002 timedout error. Some notebooks do not start at all and fails. Is there a way we can queue the notebooks or…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-04-23T15:31:40.7533333+00:00
Kumar, Arun 336 Reputation points
commented 2025-05-07T11:37:03.4533333+00:00
Dileep Raj Narayan Thumula 15 Reputation points Microsoft External Staff Moderator
2 answers

How to allow an integration pipeline to access a view in the serverless SQL Pool Built-in

I'm trying to build a pipeline. I want to use as the source dataset - data from the external table created against the parquet files stored in the Gen2 blob. I have the external tables and views setup and can access them in PowerBI via the Azure Synapse…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-04-30T22:06:49.91+00:00
Steve McMasters 0 Reputation points
commented 2025-05-07T11:33:03.9933333+00:00
Dileep Raj Narayan Thumula 15 Reputation points Microsoft External Staff Moderator
1 answer

How to retrieve azure lost data

I lost all of my data and develop code. It was there but now i can not see it

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-05-05T05:44:19.5466667+00:00
Ratnika Saxena (NON EA SC ALT) 0 Reputation points Microsoft Employee
edited an answer 2025-05-07T08:23:59.9933333+00:00
Amira Bedhiafi 31,416 Reputation points Moderator
1 answer

Github interaction with synapse

We have github repo which is connected to our synapse environment, anytime someone configure git it makes a commit to master branch, actually we want to pull the updates from github rather than updating from synapse to git

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-02-11T06:16:22.45+00:00
Tailor, Anurag 0 Reputation points
edited the question 2025-05-06T10:51:23.31+00:00
VarunTha 14,015 Reputation points Microsoft External Staff Moderator
1 answer

Version control (GitHub) in Azure Synapse

Hello, I am trying to integrate Azure Synapse analytics with my GitHub account, and while I managed to do that following this guide: https://learn.microsoft.com/en-us/azure/synapse-analytics/cicd/source-control#connect-with-github, I don't understand…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-02-04T15:04:24.2066667+00:00
Anya Pasko 0 Reputation points
edited the question 2025-05-06T10:50:40.74+00:00
VarunTha 14,015 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

In Azure Synapse monitor Apache Spark Applications who or what is the submitter GUID?

In Synapse studio monitor Apache Spark Applications the same GUID - 2864980c-2195-47d6-bc42-d8b4ff8e3e11 - appears many times as the submitter and I cannot find out who or what this is. I have tried >az ad sp show --id…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-04-14T13:28:23.2+00:00
Cooke, Richard (Allianz UK) 20 Reputation points
accepted 2025-05-06T08:04:27.6666667+00:00
Cooke, Richard (Allianz UK) 20 Reputation points
1 answer One of the answers was accepted by the question author.

Getting Error while publishing changes to Synapse release branch: Failed to getFolderInSingleRequest, folder: <synapse-dev-workspace-name>. Reason: Cannot read properties of undefined (reading 'repository')

I am getting the following error while publishing the latest changes from a branch to release branch: Publishing error Error while publishing: Failed to getFolderInSingleRequest, folder: cs-vn-uset2-syn-ecrm. Reason: Cannot read properties of undefined…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-04-29T01:55:11.3766667+00:00
PATEL, SACHIN KUMAR 20 Reputation points
accepted 2025-05-05T20:00:22.9+00:00
PATEL, SACHIN KUMAR 20 Reputation points
0 answers

When I'm trying to add a table in an existing synapse link, my new table in waiting for snapshot state for long, after I check the log, I got the error message.Error 22724 severity 16 Error occurred while exporting initial snapshot to landing zone.

When I'm trying to add a table in an existing synapse link, my new table in waiting for snapshot state for long, after I check the log, I got the error message. Error 22724 severity 16 Error occurred while exporting initial snapshot to landing zone.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-04-29T07:34:44.83+00:00
Vignesh K 20 Reputation points
commented 2025-05-05T07:32:29.6566667+00:00
Vignesh K 20 Reputation points
0 answers

errorCode": "2402 unable to load bulk data using COPY command to table

I am unable to execute COPY command to table . COPY INTO stg.Temp_FctSOSTracking_TPS_India FROM 'https://mfgdasynapseprod01sa.dfs.core.windows.net/landing/RSA/2024-02/2024-02-07/2024-02-07_00:00/fct_sos_details_*.csv' WITH ( FILE_TYPE='CSV', FIRSTROW=2,…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2024-02-07T16:14:10.38+00:00
GUPTA, Mayank 5 Reputation points
commented 2025-05-05T01:38:11.7333333+00:00
Shelly Chen 0 Reputation points
2 answers

Stored Procedure Activity getting failed

Hi, I have got to use couple of external tables(parquet) in dedicated sql pool. when I run stored procedures in dedicated sql pool using those external tables, its running successfully. But when I started running stored procedure using stored procedure…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2024-04-22T11:45:55.77+00:00
Anirudh Govardhanam 0 Reputation points
commented 2025-05-05T01:24:35.5833333+00:00
Shelly Chen 0 Reputation points
0 answers

How to fix an established connection was aborted by the server error while making SFTP connection using Azure Synapse?

Hello Team, While we are trying to connect SFTP using SSH public key authentication we are getting following error. Established connection was aborted by the server let me share the steps which we followed so far to connect the sftp. [1] Open PuttyGen…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,486 questions
asked 2023-02-22T19:41:13.66+00:00
Nikunj Patel 61 Reputation points
commented 2025-05-02T18:02:28.6566667+00:00
JKU 0 Reputation points
1 answer One of the answers was accepted by the question author.

I am unable to publish changes in my Synapse workspace

M workspace is integrated with github. We've successfully published changes hundreds of times. Now we are getting an error "Error while publishing: Failed to getFolderInSingleRequest, folder: [workspace-name]. Reason: ae.data is undefined". …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-04-25T18:26:32.3766667+00:00
Jason Cox 40 Reputation points
accepted 2025-05-02T15:29:50.6733333+00:00
Jason Cox 40 Reputation points
2 answers

Azure Synapse CI/CD Pipeline Spark Pool Parameterization Issue

A Synapse Project with three notebooks is set up, each utilizing a Spark cluster, e.g., sparkuksdev. The notebooks are part of a pipeline where the Spark cluster is parameterized through a SQL Data Warehouse's Parameters table using…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-04-24T11:09:51.4433333+00:00
Debbie Edwards 521 Reputation points
commented 2025-05-02T10:58:03.94+00:00
Venkat Reddy Navari 1,585 Reputation points Microsoft External Staff Moderator
0 answers

Create DB identity in synapse notebook

Hi, I want to create a Synapse notebook where can read data from Azure SQL server DB. So I need to connect the DB via jdbc and enter the user name and password like code below. Is there a way where I can store this username and password somewhere so that…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-04-24T03:06:32.7566667+00:00
Lotus88 156 Reputation points
commented 2025-05-02T08:48:13.6666667+00:00
Dileep Raj Narayan Thumula 15 Reputation points Microsoft External Staff Moderator
1 answer

Azure Synapse Link for Dataverse Spark issues

I have set up a Azure Synapse Linked Service for Dataverse and the Lake Database got auto created in the Synapse workspace. I can also run a SQL script on any of the Dataverse tables that I included in the Link by right clicking them and using the select…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-04-25T23:35:21.93+00:00
Broomfield, Darrien 0 Reputation points
commented 2025-05-02T03:23:05.8666667+00:00
Singireddi JagadishKumar 0 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Local timestamp issue with Synpase notebook

Hi, I am using Synapse notebook to write a record with system update timestamp. I wrote the following code in the beginning of the notebook code to adjust timestamp to UTC+8. # Adjust timestamps to Asia/Singapore…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,321 questions
asked 2025-04-29T10:04:43.4766667+00:00
Lotus88 156 Reputation points
accepted 2025-05-02T00:58:54.2266667+00:00
Lotus88 156 Reputation points