Saturday, February 27, 2021
  • Setup menu at Appearance » Menus and assign menu to Top Bar Navigation
Advertisement
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News
No Result
View All Result
NikolaNews
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News
No Result
View All Result
NikolaNews
No Result
View All Result
Home Big Data

A closer look at Azure Synapse Link

May 28, 2020
in Big Data
A closer look at Azure Synapse Link
590
SHARES
3.3k
VIEWS
Share on FacebookShare on Twitter

According to Mary Jo Foley, this years’ digital version of Microsoft Build provided a return to the basics, refocusing on developers. Scanning through ZDnet’s saturation coverage last week, gone were the avatars of Microsoft 365, with instead, a renewed focus on the core developer audience. We’re not going to repeat covering the waterfront, but we want to take a second look at the highlight data announcement from last week: Microsoft’s extending of its still-new Azure Synapse Analytics platform with a new feature to bring in operational data: Azure Synapse Link.

To recap, the new Azure Synapse Link feature extends Synapse footprint, starting with Azure Cosmos DB; Microsoft intends to extend the capability to the SQL side later on including Azure SQL Database and Azure Database for PostgreSQL. While Synapse’s original mission was to unite the data warehouse and the data lake, the new Link feature extends that out to operational data.

You might also like

DataStax Astra goes serverless | ZDNet

Off-chain reporting: Toward a new general purpose secure compute framework by Chainlink

Cutting-edge Katana Graph scores $28.5 million Series A Led by Intel Capital

As Azure’s newest data service (it was only announced for preview last fall), it’s now is taking the lion’s share of the spotlight regarding new announcements. And actually, aside from core features, such as the core data warehouse with provisioned compute; workload isolation within a single cluster; and materialized views, most of the differentiating features of Azure Synapse Analytics are still in public preview. In that group are Azure Synapse workspaces, the new web development studio; SQL Serverless; Apache Spark for Synapse; and pipelines that leverage existing technology for Azure Data Factory. This is by no means a finished production product, yet.

Although technically a rebrand of the old Azure SQL Data Warehouse, Azure Synapse Analytics is actually a different platform, as it reengineers the predecessor offering. As we’ve stated previously, Azure Synapse Analytics is part of a broader trend for cloud data warehouses to spread their footprint both upstream, for ingesting and transforming data, and downstream, for delivering analytics. It’s a pattern that we’re seeing SAP and Oracle also following.

Big on Data bro Andrew Brust post provided a good blow-by-blow description of the new release, but after reading the account, we still had a core question nagging us: How does Azure Synapse Link pull operational data without impacting the performance of Cosmos DB?

We originally thought that Synapse Link connected to Cosmos DB through federated query, where the query is submitted on Synapse, and the is processing pushed down to data at the source, with the tables in the remote database represented as virtual (or external) tables. That’s how a number of data warehouses work when they reach out to other data sources, such as Amazon Redshift Spectrum querying data in S3, or how Microsoft SQL Server PolyBase, Oracle Big Data SQL, IBM Big SQL connect to data in cloud storage or other data stores, and so on.

But Azure Synapse Link is a different creature – it extends the data warehouse to include data that is populated from Cosmos DB via the equivalent of a change-data-capture stream. To activate it, once you have Synapse operational, you go into Cosmos DB and check the option to enable analytics.

That is, as operations are made to data in Cosmos DB, these changes are automatically pushed into a columnar optimized format for analytics without impacting the performance of the source system. Synapse can then query over this data entirely independent of Cosmos DB, but effectively in real-time since changed operational data is kept in sync with minimal latency.

The automatic change data feed approach taken by Azure Synapse Link is not that unusual – for on-premises databases. For instance, MariaDB’s X4 platform automatically replicates row-based transaction to the column store, while Oracle database in-memory and IBM Db2 BLU acceleration let customers replicate to in-memory column stores selectively. But surprisingly, it’s not yet widely done in the cloud; AWS and GCP require building of data pipelines to feed transaction data into BigQuery.

So, until AWS and Google respond, that’s where Azure Synapse Link differentiates. The upside is that Azure Synapse Link makes the data warehouse an operational system that can generate analytics on historical and current data. The flipside, however, is that you wind up paying to store the same data at least twice – not counting the number of replicas that are routinely maintained by each service. That makes Link well-suited for operational analytics, but not as cost-effective for ad hoc use cases where you might only want to pay by the query (e.g., how Amazon Athena works when running SQL queries against S3). That’s where we’d like to see Microsoft add an option down the road for ad hoc query for scenarios that don’t always require constant updating, or where data changes are not all that frequent.

Credit: Zdnet

Previous Post

The White House Has a Plan to Revive the Economy: Don’t Talk About it

Next Post

Researchers Uncover Brazilian Hacktivist's Identity Who Defaced Over 4800 Sites

Related Posts

DataStax Astra goes serverless | ZDNet
Big Data

DataStax Astra goes serverless | ZDNet

February 25, 2021
Off-chain reporting: Toward a new general purpose secure compute framework by Chainlink
Big Data

Off-chain reporting: Toward a new general purpose secure compute framework by Chainlink

February 25, 2021
Cutting-edge Katana Graph scores $28.5 million Series A Led by Intel Capital
Big Data

Cutting-edge Katana Graph scores $28.5 million Series A Led by Intel Capital

February 24, 2021
Hasura connects GraphQL to the REST of the world
Big Data

Hasura connects GraphQL to the REST of the world

February 23, 2021
As Power BI aces Gartner’s new Magic Quadrant, what’s the story behind Microsoft’s success?
Big Data

As Power BI aces Gartner’s new Magic Quadrant, what’s the story behind Microsoft’s success?

February 19, 2021
Next Post
Researchers Uncover Brazilian Hacktivist’s Identity Who Defaced Over 4800 Sites

Researchers Uncover Brazilian Hacktivist's Identity Who Defaced Over 4800 Sites

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Recommended

Plasticity in Deep Learning: Dynamic Adaptations for AI Self-Driving Cars

Plasticity in Deep Learning: Dynamic Adaptations for AI Self-Driving Cars

January 6, 2019
Microsoft, Google Use Artificial Intelligence to Fight Hackers

Microsoft, Google Use Artificial Intelligence to Fight Hackers

January 6, 2019

Categories

  • Artificial Intelligence
  • Big Data
  • Blockchain
  • Crypto News
  • Data Science
  • Digital Marketing
  • Internet Privacy
  • Internet Security
  • Learn to Code
  • Machine Learning
  • Marketing Technology
  • Neural Networks
  • Technology Companies

Don't miss it

Future Tech: Artificial Intelligence and the Singularity | by Jason Sherman | Feb, 2021
Neural Networks

Future Tech: Artificial Intelligence and the Singularity | by Jason Sherman | Feb, 2021

February 27, 2021
Chrome will soon try HTTPS first when you type an incomplete URL
Internet Security

Chrome will soon try HTTPS first when you type an incomplete URL

February 27, 2021
Cisco Releases Security Patches for Critical Flaws Affecting its Products
Internet Privacy

Cisco Releases Security Patches for Critical Flaws Affecting its Products

February 27, 2021
Levels of Measurement (Nominal, Ordinal, Interval, Ratio) in Statistics
Data Science

Levels of Measurement (Nominal, Ordinal, Interval, Ratio) in Statistics

February 27, 2021
An Epic cognitive computing platform primer
Machine Learning

An Epic cognitive computing platform primer

February 27, 2021
Tackling ethics in AI algorithms: the case of Salesforce | by Iflexion | Feb, 2021
Neural Networks

Tackling ethics in AI algorithms: the case of Salesforce | by Iflexion | Feb, 2021

February 27, 2021
NikolaNews

NikolaNews.com is an online News Portal which aims to share news about blockchain, AI, Big Data, and Data Privacy and more!

What’s New Here?

  • Future Tech: Artificial Intelligence and the Singularity | by Jason Sherman | Feb, 2021 February 27, 2021
  • Chrome will soon try HTTPS first when you type an incomplete URL February 27, 2021
  • Cisco Releases Security Patches for Critical Flaws Affecting its Products February 27, 2021
  • Levels of Measurement (Nominal, Ordinal, Interval, Ratio) in Statistics February 27, 2021

Subscribe to get more!

© 2019 NikolaNews.com - Global Tech Updates

No Result
View All Result
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News

© 2019 NikolaNews.com - Global Tech Updates