Apache Iceberg

Fivetran Expands Snowflake Partnership with Iceberg Table Support and Enterprise-Ready Native Applications

Retrieved on: 
Mittwoch, Juni 5, 2024

Fivetran , the global leader in data movement, today announced an expanded partnership with Snowflake , the AI Data Cloud company, including Iceberg Table Support and a commitment to build Native Connectors for Snowflake at Snowflake Data Cloud Summit 2024 .

Key Points: 
  • Fivetran , the global leader in data movement, today announced an expanded partnership with Snowflake , the AI Data Cloud company, including Iceberg Table Support and a commitment to build Native Connectors for Snowflake at Snowflake Data Cloud Summit 2024 .
  • Fivetran’s support of Iceberg Tables provides Snowflake customers the ability to create a lakehouse architecture with Apache Iceberg, all within the Snowflake AI Data Cloud.
  • Fivetran Native Connectors for Snowflake will only share metadata between Fivetran and the Snowflake customer account.
  • “Offering Iceberg Table Support and new Native Connectors for Snowflake customers to leverage in the AI Data Cloud marks a significant advancement in our partnership,” said George Fraser, Fivetran CEO.

Snowflake Doubles Down on Developers with End-to-End Capabilities for Building Enterprise-Grade Pipelines, Models, and AI-Powered Apps

Retrieved on: 
Dienstag, Juni 4, 2024

Snowflake is also unveiling Snowflake Trail, a rich set of observability capabilities that provide enhanced visibility into data quality, pipelines, and applications, empowering developers to monitor, troubleshoot, and optimize their workflows with ease.

Key Points: 
  • Snowflake is also unveiling Snowflake Trail, a rich set of observability capabilities that provide enhanced visibility into data quality, pipelines, and applications, empowering developers to monitor, troubleshoot, and optimize their workflows with ease.
  • Application developers can build their AI-powered Snowflake Native Apps once, and then deploy and distribute them across clouds and regions to thousands of Snowflake customers through Snowflake Marketplace , with over 160 total Snowflake Native Apps 3 already available today.
  • Read more about how developers are building data pipelines, applications, and ML models in this blog post .
  • Learn how Snowflake is expanding the types of applications that can be built, deployed, and distributed in the AI Data Cloud in this blog post .

Snowflake Furthers Leadership as the Best Data Foundation for Enterprises

Retrieved on: 
Dienstag, Juni 4, 2024

With Iceberg Tables, organizations can work with their data on their terms, gaining increased flexibility and support over their open data to drive value.

Key Points: 
  • With Iceberg Tables, organizations can work with their data on their terms, gaining increased flexibility and support over their open data to drive value.
  • This includes an EU-only data boundary that keeps all customer data, alongside relevant service and usage data, within regional borders to provide European customers with stronger data residency and data sovereignty assurances to meet regional regulatory requirements.
  • Based on internal Snowflake data, query duration for customers’ stable workloads improved by 26% from August 25, 2022 to April 30, 2024.
  • Snowflake, the Snowflake logo, and all other Snowflake product, feature and service names mentioned herein are registered trademarks or trademarks of Snowflake Inc. in the United States and other countries.

Snowflake Brings Industry-Leading Enterprise AI to Even More Users with New Advancements to Snowflake Cortex AI and Snowflake ML

Retrieved on: 
Dienstag, Juni 4, 2024

Cortex Analyst, built with Meta’s Llama 3 and Mistral Large models, allows businesses to securely build applications on top of their analytical data in Snowflake.

Key Points: 
  • Cortex Analyst, built with Meta’s Llama 3 and Mistral Large models, allows businesses to securely build applications on top of their analytical data in Snowflake.
  • What I’m most excited about is we're just getting started, and we're looking forward to unlocking more value with Snowflake Cortex AI."
  • With Cortex Guard, Snowflake is further unlocking trusted AI for enterprises, helping customers ensure that available models are safe and usable.
  • These fine-tuned models can then be easily used through a Cortex AI function, with access managed using Snowflake role-based access controls.

Fivetran Announces New Managed Data Lake Service to Support Large Data Volumes and AI Workloads

Retrieved on: 
Dienstag, Juni 4, 2024

Fivetran , the global leader in data movement, today announced the general availability of the Fivetran Managed Data Lake Service , designed to automate and simplify data lake management for businesses of all sizes.

Key Points: 
  • Fivetran , the global leader in data movement, today announced the general availability of the Fivetran Managed Data Lake Service , designed to automate and simplify data lake management for businesses of all sizes.
  • Fivetran’s Managed Data Lake Service is currently available on Amazon S3, Azure Data Lake Storage (ADLS) and Microsoft OneLake.
  • The Fivetran Managed Data Lake Service simplifies data lake management by automatically converting customer data to popular open formats (i.e.
  • The new Fivetran Managed Data Lake Service differentiates itself by not only converting data and centralizing it in the lake but also providing an end-to-end data lake management service that automates low-level data management tasks entirely.

Snowflake Unveils Polaris Catalog and Emphasizes Commitment to Interoperability with AWS, Google Cloud, Microsoft Azure, Salesforce, and More

Retrieved on: 
Montag, Juni 3, 2024

With Polaris Catalog, users now gain a single, centralized place for any engine to find and access an organization’s Iceberg tables with full, open interoperability.

Key Points: 
  • With Polaris Catalog, users now gain a single, centralized place for any engine to find and access an organization’s Iceberg tables with full, open interoperability.
  • Since Polaris Catalog’s backend implementation will be open source, organizations can freely swap the hosting infrastructure while eliminating vendor lock-in.
  • This comes on the heels of Snowflake and Microsoft’s recent partnership expansion , which creates more seamless interoperability between Snowflake and Fabric.
  • Snowflake also recently announced Snowflake Arctic , one of the most open, enterprise-grade large language models (LLM) on the market.

Dremio Reinforces Ongoing Commitment to Open Lakehouses with New Support for Apache Iceberg REST Catalog Specification

Retrieved on: 
Donnerstag, Mai 30, 2024

The Iceberg REST Catalog Specification is the agreed upon foundation for metadata accessibility across Iceberg catalogs.

Key Points: 
  • The Iceberg REST Catalog Specification is the agreed upon foundation for metadata accessibility across Iceberg catalogs.
  • With this new capability, Dremio is able to seamlessly read from, and write to, any REST-compatible Iceberg catalog, and provide customers with the open, flexible ecosystem needed for enterprise interoperability at scale.
  • Lakehouses create a new open architecture for analytics by completely separating metadata from compute and storage, and externalizing transactional semantics.
  • This news emphasizes Dremio's focus on fostering an open community around Apache Iceberg, the open standard for data lakehouse tables.

Informatica Unveils Blueprint for Enterprise Generative AI Applications for Snowflake Cortex AI

Retrieved on: 
Dienstag, Mai 21, 2024

Informatica (NYSE: INFA), an enterprise cloud data management leader, unveiled new innovations for the Snowflake Data Cloud: Native SQL ELT to deliver better performance for data pipeline workloads and provide access to 250+ native Snowflake functions and a Blueprint for enterprise-grade generative AI application development for Snowflake Cortex AI based on a foundation of rich metadata, trusted data and no-code orchestration.

Key Points: 
  • Informatica (NYSE: INFA), an enterprise cloud data management leader, unveiled new innovations for the Snowflake Data Cloud: Native SQL ELT to deliver better performance for data pipeline workloads and provide access to 250+ native Snowflake functions and a Blueprint for enterprise-grade generative AI application development for Snowflake Cortex AI based on a foundation of rich metadata, trusted data and no-code orchestration.
  • Blueprint for Enterprise-Grade Generative AI Applications with Cortex AI provides customers with a template architecture to develop generative AI applications that are contextualized with enterprise metadata, grounded with high-quality, trusted data and scaled through no-code development and orchestration.
  • The blueprint combines Snowflake’s Cortex AI generative AI service with key IDMC services including Cloud Data Integration, Cloud Data Quality, Cloud Data Cataloging and Governance, Cloud Data Access Management, Master Data Management and Cloud Application Integration orchestration delivering a retrieval augmented generation (RAG) solution that grounds generative AI applications with trusted data and metadata while ensuring appropriate data access controls.
  • These are the latest Snowflake integrations since Informatica launched four new product capabilities at Snowflake Summit 2023, including Informatica Superpipe, Enterprise Data Integrator Private Preview, Cloud Data Integration-Free and support for Apache Iceberg on Snowflake.

Teradata Embraces Open Table Formats, Iceberg and Delta Lake, to Deliver the Most Open and Connected Ecosystem for Trusted AI

Retrieved on: 
Dienstag, April 30, 2024

Teradata’s fully open and connected approach is designed to be future-ready and allow enterprises to employ a modern data strategy with unmatched agility and flexibility for executing Trusted AI at scale.

Key Points: 
  • Teradata’s fully open and connected approach is designed to be future-ready and allow enterprises to employ a modern data strategy with unmatched agility and flexibility for executing Trusted AI at scale.
  • Teradata’s agnostic OTF support and open catalog integration is designed to enable the platform to read various catalogs with predictable execution.
  • “In today’s data landscape, we’re seeing wide adoption of open table formats with 51% of organizations actively adopting Delta tables and 27% adopting Apache Iceberg.
  • Forward-looking statements in this release include the availability, capabilities, and benefits provided by the integration of open table formats with Teradata’s VantageCloud platform and Teradata AI Unlimited.

Salesforce Unveils Zero Copy Partner Network, an Ecosystem Committed to Secure, Bidirectional Zero Copy Integration with Salesforce Data Cloud

Retrieved on: 
Donnerstag, April 25, 2024

Salesforce (NYSE: CRM) today announced the Salesforce Zero Copy Partner Network, a global ecosystem of technology and solution providers building secure, bidirectional zero copy integrations with Salesforce Data Cloud so that data can be actioned across the Salesforce Einstein 1 Platform .

Key Points: 
  • Salesforce (NYSE: CRM) today announced the Salesforce Zero Copy Partner Network, a global ecosystem of technology and solution providers building secure, bidirectional zero copy integrations with Salesforce Data Cloud so that data can be actioned across the Salesforce Einstein 1 Platform .
  • Salesforce previously introduced the concept of zero copy bidirectional integrations with Data Cloud via partnerships with Amazon Redshift , Databricks , Google Cloud’s BigQuery , and Snowflake .
  • Salesforce and Microsoft are jointly working to give customers the ability to access their critical business data in Azure Synapse and bidirectional zero copy data access with Microsoft Fabric and Salesforce Data Cloud.
  • Data Kits enable ISVs to distribute their high-value datasets to Data Cloud customers and land that data in Data Cloud pre-mapped into the Data Cloud customer data model, with no transformations required.