Can Hive Metastore ride the wave of table formats and data modernization?Hive Metastore has remained an important aspect of the Hadoop ecosystem. Since the beginning, Hive Metastore held the promise of an…Sep 4Sep 4
Why Iceberg requires a Catalog for ACID while Delta doesn’tBoth Apache Iceberg and Delta Lake offer ACID guarantees for Parquet files, each using different mechanisms to achieve this. Data lakes on…Aug 18Aug 18
Moving Away from Age-Old ‘Partitioning’: A New Era of Data ManagementIn the world of big data, traditional partitioning has long been the cornerstone of efficient query performance. However, as data volumes…Aug 13Aug 13
Polaris vs. Unity Catalog: Clearing Up the ConfusionThe month of June 2024 has been particularly confusing for data and AI professionals, especially those trying to understand the evolving…Jun 30Jun 30
Published inAnalytics VidhyaPipeline JunglesThis word came to my mind after I had numerous workloads running in production and I couldn't guarantee the SLA of my machine learning…Apr 26, 2021Apr 26, 2021
How I cleared my Confluent Kafka Developer for Apache Kafka(CCDAK)There are not many articles online which help in the exam preparation for CCDAK exam. I have churned out a quick article on my journey…Apr 12, 2021Apr 12, 2021