Subject
32 entries
SQL
Bookmarks
Dequery: The SQL Debugger
Dequery is a SQL debugger that traces data lineage step-by-step through CTEs, subqueries, JOINs, and window functions — showing which source rows contributed to each result. Fills the long-standing gap between SQL query execution and traditional debugging.
Numbers Station: AI-Powered Data Stack Automation
Numbers Station is an AI co-pilot for data workers that automates data-intensive workflows — transformations, SQL generation, pipeline building — without requiring Python or engineering involvement. Targets the gap between BI tools and data engineering.
Definite: 10x Faster AI Analytics
Definite is an AI-assisted analytics frontend for the modern data stack — natural language to SQL, auto-generated charts, and collaborative dashboards on top of your existing data warehouse. Positioned as a 10x faster alternative to traditional BI tools like Looker or Mode.
BetterBrain: Natural Language to SQL with Schema Awareness
BetterBrain converts natural language to SQL while correctly handling schema constraints — an early 2022 demo of LLM-powered text-to-SQL that understood the database schema rather than generating syntactically-valid but semantically-wrong queries.
Luabase: Web3 Data Stack
Luabase is a blockchain data platform that ETLs on-chain data into queryable SQL tables — 'we ETL blockchains so you don't have to.' An early attempt to give analysts standard SQL access to blockchain activity without dealing with raw node data.
Flipside Crypto — Blockchain Analytics Platform
Flipside Crypto is a blockchain analytics platform providing SQL-queryable on-chain data across Ethereum, Solana, Terra, and other chains. Notable for its bounty model where analysts earn FLOW tokens for producing quality dashboards — crowdsourcing blockchain data analysis.
Dune Analytics SQL Snippets
A GitHub collection of SQL query snippets for Dune Analytics and Google BigQuery targeting on-chain Ethereum data. Practical reference for blockchain data analysts who want reusable queries for common DeFi analytics tasks.
Querying Live Crypto Trades with SQL in Real-Time
QuestDB tutorial showing how to query live cryptocurrency trade data in real-time with SQL — ingesting from Coinbase's WebSocket feed into QuestDB and running time-series queries. A practical demo of time-series SQL for financial market data.
Free Data Engineering Learning Resources
Pipeline Data Engineering Academy's curated list of free data engineering learning resources — covering SQL, Python, Spark, Airflow, dbt, and cloud data platforms. A structured entry point for engineers transitioning into data engineering roles.
Practical SQL for Data Analysis
Haki Benita's essay showing how SQL can replace Pandas for a surprising range of data analysis tasks — window functions, aggregations, pivoting, and data quality checks. Makes the case that analysts often reach for Python when SQL would be faster and simpler.
Building a Data Lake with AWS S3 and Athena
A tutorial on replacing a costly Redshift cluster with a serverless data lake using AWS S3 and Athena — demonstrating 16-minute queries reduced to 11 seconds at 10 cents a run using Parquet, partitioning, and Glue ETL. Practical architectural migration case study.
Kickstarter SQL Style Guide
Kickstarter's SQL style guide — conventions for formatting, naming, CTEs, joins, and documentation that prioritize reproducibility and shareability across a data team. A practical reference for writing SQL others can read and maintain.
The Lazy Analyst's Guide to Amazon Redshift
Periscope Data's practical guide to Amazon Redshift — covering the distribution and sort key mechanics that determine query performance, plus common gotchas for analysts who know SQL but not columnar databases. Still one of the clearest explanations of why Redshift behaves differently from Postgres.
MySQL INSERT Speed Optimization
MySQL 5.0 reference manual section on optimizing INSERT performance — covering bulk inserts, transaction batching, and buffer sizing. The reference for squeezing write throughput out of MySQL when ingestion speed matters.
HyperLogLog in Pure SQL
Periscope Data's post implementing HyperLogLog in pure SQL — a probabilistic cardinality estimator that counts distinct values using a fixed amount of memory regardless of dataset size. Clever engineering that demonstrates how probabilistic algorithms can be embedded in SQL-only environments.
Zipfian Academy: Week 1 — Or: "Window Functions on Day 3?!"
A Zipfian Academy student's week 1 blog post, titled 'Window Functions on Day 3?!' — capturing the intense pace of the data science bootcamp curriculum. A primary source document for the Zipfian Academy experience circa spring 2014.
Scaling SQL with Redis
David Cramer's post on using Redis to scale SQL databases — covering caching patterns, read replica offloading, and where Redis fits in a stack that can't abandon SQL entirely. Practical patterns from the Disqus/Sentry engineering blog at production scale.
Presto: Interacting with Petabytes of Data at Facebook
Hacker News discussion on Facebook's newly open-sourced Presto SQL engine, capable of querying petabytes of data interactively. A watershed moment — before Presto, interactive SQL at Facebook scale wasn't possible.
Rolling Average in Hive
Brent Ozar's walkthrough of computing rolling averages in Hive — a problem that looks like a simple SQL query but requires window functions or self-joins in Hive's then-limited SQL dialect. A practical data engineering puzzle from the Hadoop era.
Naive Bayes Classification in SQL at Zipfian Academy
A Zipfian Academy student's tweet about implementing Naive Bayes classification in SQL, categorizing the New York Times corpus one word at a time. A striking demonstration that ML concepts can be expressed in unexpected substrate.
Why Data Virtualization Is Good for Big Data Analytics
Data-Informed's case for data virtualization in big data analytics — querying data in-place across Hadoop, relational databases, and other sources without physical ETL. A precursor to the 'data fabric' and 'data mesh' concepts that would emerge years later.
Hadoop Meets SQL
IBM Big Data Hub's overview of SQL-on-Hadoop approaches in 2013 — Hive, Impala, and the broader push to make Hadoop queryable by the vast majority of analysts who knew SQL but not MapReduce. The SQL interface became the primary adoption driver for Hadoop in the enterprise.
Crunching NYC Subway Data: A New Yorker's Busiest Stations
A data analysis post combining Node.js and SQL to parse MTA turnstile data and identify New York City's busiest subway stations. An early example of civic data journalism: public transit data as a lens on urban density and movement.
A Visual Explanation of SQL Joins
Jeff Atwood's Coding Horror post using Venn diagrams to explain SQL JOIN types visually. One of the most-referenced SQL explanations on the web — the mental model that finally makes INNER, LEFT, RIGHT, and FULL OUTER joins click.
How I Write SQL
Craig Kerstiens' SQL style guide — uppercase keywords, meaningful aliases, explicit JOINs, and consistent formatting. A practitioner-written standard that became influential in the PostgreSQL and analytics communities.
Metrica — Finding Your One Metric That Matters Using SQL
Metrica's post on using SQL to identify your One Metric That Matters — the single KPI that best captures a startup's core health. A practical guide to distilling complex product data into a focus metric.
Future of Apache Hive — SQL PASS BA 2013
Carter Shanklin's 2013 talk on the future of Apache Hive — covering the push to make Hive's HiveQL a proper SQL dialect with ACID semantics, better query planning, and sub-second latency. A snapshot of the war between SQL-on-Hadoop and traditional data warehouses.
Shark: Real-time Queries and Analytics for Big Data
O'Reilly Strata article on Shark — the precursor to Spark SQL that brought real-time interactive queries to Hadoop/Spark in 2012. Part of the wave of tools (Impala, Shark, Drill) that challenged Hive's batch-query dominance.
SQL vs. NoSQL
Linux Journal's SQL vs. NoSQL comparison from the height of the NoSQL hype cycle — a useful grounding piece that distinguished the different NoSQL categories (document, key-value, column-family, graph) and when each made sense. The pendulum has since swung back toward SQL for most use cases.
Google Opens BigQuery Data Analytics to All
GigaOM coverage of Google opening BigQuery to all developers in 2012 — the productization of Dremel as a cloud service. The moment when interactive SQL over petabyte datasets became a commercial product rather than a Google-internal tool.
Dremel: Interactive Analysis of Web-Scale Datasets
Google's Dremel paper — the system that enabled sub-second SQL queries over petabyte datasets via columnar storage and a multi-level serving tree. The direct precursor to BigQuery, and the inspiration behind Apache Parquet's nested record encoding.
Apache Hive
Apache Hive's homepage from 2012 — the SQL-on-Hadoop layer that made big data accessible to analysts who knew SQL but not Java MapReduce. Hive translated HiveQL queries into MapReduce jobs, trading latency for familiarity.