Snowflake Data Cloud Summit 2020

Snowflake Data Cloud Summit 2020 is a virtual and free conference this year showcasing exciting set of new capabilities, features and improvements to existing services.

Highlights

  1. SnowPark — New Data Engineering service that enables developers to innovate more on Data Modelling, Data Preparation (ETL/ELT) and Data Analytics with multi language support of their choice like Python, Scala or Java.
  2. Unstructured Data — Snowflake currently supports Structured and Semi-Structured Data, now support for Unstructured data support is introduced and snowflake will start supporting PDF, Audio, View and Image files.
  3. Query Acceleration Service — New service that is built to reduce query run times against large data sets
  4. Data Governance — Introduction of Enhanced Object Tagging Capabilities
  5. External Functions — External functions are user-defined functions that are stored and executed outside of Snowflake with integration like AWS Lambda or Azure Functions

Public Preview Mode

Search Optimization Service

  1. The search optimization service can significantly improve the performance of point lookup queries.
  2. The feature is available only in Enterprise Edition
  3. Additional Information: https://docs.snowflake.com/en/user-guide/search-optimization-service.html

Geospatial Support

  1. Geography Data Type support in Snowflake in preview mode available to all accounts
  2. Additional Information: https://docs.snowflake.com/en/sql-reference/data-types-geospatial.html

External Functions

  1. External functions are user-defined functions that are stored and executed outside of Snowflake
  2. In AWS, external function integration works using a Lambda
  3. In Azure, Azure Functions is leveraged for integration in Snowflake
  4. Additional Information: https://docs.snowflake.com/en/sql-reference/external-functions.html

Masking policies

  1. Snowflake supports Column Level security using Dynamic Data Masking or using External Tokenization which again leverages External Functions
  2. Additional Information: https://docs.snowflake.com/en/user-guide/security-column.html

Snowsight

  1. Snowsight replaces SQL worksheets in the new interface that is in public preview mode
  2. Snowsight makes it easy to write SQL Queries, Views as well visualize the data returned by the Queries
  3. Additional Information: https://docs.snowflake.com/en/user-guide/ui-snowsight.html

Other Features that have been in private preview from early this year are now available in public preview

  1. Data Marketplace — https://docs.snowflake.com/en/user-guide/data-marketplace.html
  2. Data Exchange — https://docs.snowflake.com/en/user-guide/data-exchange.html

Private Preview Mode

Snowpark

  1. New Data Engineering service that enables developers to innovate more on Data Modelling, Data Preparation (ETL/ELT) and Data Analytics with multi language support of their choice like Python, Scala or Java.

Data Governance

  1. Dynamic Data Masking was already announced in June 2020, Snowflake now extended the Data Governance features with introduction of Enhanced Object Tagging Capabilities. This feature can be leveraged in Metadata management, Data Classification and also for resource utilization/tracking.

Unstructured Data Support

  1. Snowflake currently supports Structured and Semi-Structured Data, now support for Unstructured data support is introduced and snowflake will start supporting PDF, Audio, View and Image files.

Pattern Matching

  1. New feature that will be added to Search Optimization Service, looking forward to more details on this from Snowflake

Query Acceleration Service — Automatic Scaling

  1. New service that is built to reduce query run times against large data sets.
  2. This feature leverages Sub Query Parallelization if there are sub queries in the submitted query.

I’m an Hands On Cloud Data Architect, Solution Architect and Engineering manager, with Certifications in AWS, GCP, Snowflake and Confluent Kafka

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store