Rahul Joshi
Distinguished Data Engineer specializing in cloud-native data platforms for financial services. M.Tech, IIT Kharagpur. I write about lakehouse architecture, data engineering at scale, and building AI-ready data platforms.
Data-Centric AI: Engineering Platforms for Pre-Model Intelligence
Journal article on why data platform architecture — not model architecture — is the primary determinant of AI system reliability.
Lakehouse Convergence: Delta Lake & Iceberg
Analysis of format convergence between Delta Lake and Apache Iceberg — what it means for lakehouse architecture.
Delta Lake Transaction Logs Explained
Deep dive into Delta Lake’s transaction log internals — how ACID transactions work on object storage.
Understanding the Evolution of Data Lakes
From Hadoop to modern lakehouse — tracing the architectural evolution of data lakes.
Displacement Based Unsupervised Metric for Evaluating Rank Aggregation
Proposes a variant of Kendall-Tau distance metric for evaluating rank aggregation — published in Springer PReMI 2011.