Subject
222 entries
Open Source
Bookmarks
Miasma: AI scraper honeypot that serves poisoned training data
Lightweight server that traps AI scrapers in an endless loop of poisoned data. A honeypot for the bot era.
Claw-Code: cleanroom agent harness reimplementation in Rust
Cleanroom Rust reimplementation of an AI agent harness, built from reverse-engineered architecture. Hit 50K GitHub stars in 2 hours.
Remind: generalized memory consolidation for AI agents
Remind consolidates raw AI experiences into generalized concepts stored in a knowledge graph, rather than dumping everything into a vector database. The distinction matters: instead of retrieving raw transcripts, it surfaces patterns like 'user prefers statically typed languages.'
Just Put It on a Map: land value visualization tools
The Center for Land Economics released five free GIS tools for visualizing land values, including a 3D mapper showing how Manhattan's assessed values tower above the rest of NYC combined. The case: geographic visualization makes land economics arguments visceral in ways that text and tables can't.
Fabro: AI agent workflow graph orchestrator
Fabro defines AI agent workflows as Graphviz DOT graphs with git checkpointing, cloud sandboxes, and human-in-the-loop gates. It occupies the space between micromanaging an agent line-by-line and blindly accepting a 500-line diff.
NVIDIA Agent Toolkit: enterprise AI agent platform
NVIDIA launched an open-source Agent Toolkit with a runtime, enterprise data blueprint, and open models that cut query costs by 50%+. The company frames this as an 'industrial revolution in knowledge work' — which is either accurate or marketing, depending on how the next few years go.
Axe: lightweight CLI for single-purpose AI agents
Axe is a minimal CLI for single-purpose LLM agents defined in TOML — composable like Unix pipes, triggerable from git hooks or cron, supporting Anthropic/OpenAI/Ollama. The anti-chatbot: each agent does one thing.
Difftastic: structural diff that understands syntax
Difftastic is a structural diff tool that parses code with tree-sitter and compares syntax trees rather than lines, filtering out reformatting noise. Essential for anyone who's debugged a reformatted file in a unified diff.
The Architecture of Open Source Applications
Four-volume series where experienced developers explain the architecture of major open-source applications — Git, nginx, Firefox, and 80+ others. One of the best resources for seeing how real systems are actually designed.
zclaw: ESP32-resident AI assistant
zclaw is an AI assistant that runs on an ESP32 microcontroller within a strict 888 KiB firmware budget. Handles natural language scheduling, GPIO control, memory, and tool calling — written in C with ESP-IDF.
The Open Anonymity Project: AI user privacy infrastructure
The Open Anonymity Project builds tools and infrastructure for AI user privacy — an open-source effort to give users anonymity options when interacting with AI systems. Still early, but addresses a real gap as AI becomes more central to daily life.
Cronboard: terminal dashboard for cron job management
Cronboard is a terminal dashboard for managing cron jobs locally and on remote servers over SSH. Built with Python/Textual, supports smart scheduling expressions and case-insensitive search.
cmux: native macOS terminal for parallel AI coding agents
cmux is a native macOS terminal built on Ghostty specifically for running multiple AI coding agents in parallel. Sidebar tabs show which agents need attention, with notification rings and desktop alerts when an agent is waiting for input.
Agent Swarm: persistent multi-agent coding framework
Agent Swarm is a lead/worker AI coding agent framework with persistent identity files, session memory extraction, and Docker isolation. Each agent accumulates expertise across sessions through SOUL.md, IDENTITY.md, TOOLS.md, CLAUDE.md.
Zvec: in-process vector database from Alibaba
Zvec is Alibaba's in-process vector database built on Proxima, their production search engine. No server to run — embed it directly in your app for billion-vector similarity search in milliseconds.
AI Design Components: 76 Claude skills across full-stack development
76 production-ready Claude skills across frontend, backend, DevOps, security, cloud, and AI/ML — organized as 19 plugin groups with a Skillchain v3.0 guided workflow system. One of the larger open-source Claude skill collections.
LangExtract: Gemini-powered structured information extraction
LangExtract is Google's open-source Python library for structured information extraction from unstructured text using Gemini's controlled generation. Maps every extracted element back to exact character positions in source text.
IronClaw: secure personal AI assistant from NEAR AI
IronClaw is a privacy-focused personal AI assistant from NEAR AI, implemented in Rust with WASM sandboxing for untrusted tools, credential protection at the host boundary, and hybrid search memory. Your data never leaves your control.
Ethos: Hacker News analysis with vector embeddings
Ethos analyzes Hacker News discussions using vector embeddings to surface concepts, entities, sentiment, and discourse patterns. Open-source, from devrupt.io.
Hive: production runtime harness for AI agents
Hive (by Aden, YC-backed) is a production runtime harness for AI agents: state management, checkpoint-based crash recovery, cost enforcement, and self-healing through graph evolution. 102 MCP tools.
The Companion: web UI for Claude Code and Codex
The Companion is a web UI for Claude Code and Codex sessions — parallel agents, full tool call timeline, permission gating, and session recovery. Replaces terminal tab management for multi-agent workflows.
Claude Code Templates (aitmpl.com): marketplace for Claude Code components
Claude Code Templates is a CLI tool and marketplace (aitmpl.com) for installing agents, commands, hooks, MCPs, and settings into Claude Code. 100+ pre-built components installable with a single npx command.
Pi Messenger: file-based multi-agent coordination for Pi
Pi Messenger turns multiple AI coding agents in different terminals into a chat room — agents can see who's online, claim tasks, reserve files, and send messages. Coordination via plain files, no daemon required.
Learning World Model Learning: inverse dynamics
Inverse dynamics learning as part of a 'learning world model learning from scratch' series — teaches robots to infer what actions produced observed state transitions. A ground-up educational approach to the robotics data problem.
Agentboard: web-based tmux GUI for AI agent sessions
Agentboard is a web GUI for tmux optimized for AI agent TUIs — run Claude Code or Codex on your server and interact from your phone via iOS Safari. Status inference, session pinning, and a shared workspace across devices.
OpenWorkflow: durable resumable workflows in TypeScript
OpenWorkflow is an open-source TypeScript framework for durable, resumable workflows — state survives process crashes, deployments, and restarts. Targets the same problem space as Temporal and Inngest but as an open-source alternative.
Skyll: runtime skill discovery for AI agents
Skyll is a REST API and MCP server that lets any AI agent discover and learn skills at runtime, without pre-installation. Aggregates SKILL.md files from GitHub and returns structured JSON for context injection.
Dash: self-learning data agent with 6-layer context
Dash is a self-learning data agent from Agno that grounds answers in 6 layers of context, inspired by OpenAI's in-house implementation. Each query improves the agent's performance via adaptive memory.
sandbox-agent: universal sandbox API for coding agents
sandbox-agent is a universal API for running coding agents in sandboxes — works with Claude Code, Codex, OpenCode, and Amp with a single interface. Rivet's contribution to the fragmented coding agent sandbox space.
Executive: human-centered AI agent control
Executive is a GitHub app for maximizing developer control over AI agents — human executive control, not agent autonomy. Developer directs, agents execute, and the human stays in strategic command.
Open-Inspect: open-source background coding agent system
Open-Inspect is an open-source background coding agent system inspired by Ramp's internal Inspect tool — agents work in full dev environments while you're elsewhere, then create PRs. Supports multiplayer sessions and Anthropic or OpenAI models.
Qwen3-TTS-12Hz-1.7B-CustomVoice: open custom voice TTS
Qwen3-TTS-12Hz-1.7B-CustomVoice is Alibaba's compact open TTS model with custom voice cloning capability — 1.7B parameters, 12Hz token rate, available on Hugging Face. Part of the Qwen3 model family.
Hex: press-and-hold voice transcription for macOS
Hex is an open-source macOS press-and-hold voice transcription app — hold a hotkey, speak, release, and the text is pasted wherever you're typing. Uses Parakeet TDT v3 or WhisperKit for on-device transcription.
Documentor: documentation aggregator for AI assistants
Documentor is a tool for aggregating external documentation into a format optimized for LLM consumption — crawling docs sites, building search indexes, and storing structured outputs that AI assistants can query during development work.
Wealthfolio: offline open-source portfolio tracker
Wealthfolio is an open-source, offline-first desktop portfolio tracker that stores all financial data locally. No subscriptions, no cloud sync, no account required — just a standalone app for tracking investments privately.
Dexto: intelligence layer for AI agents
Dexto is an open-source AI agent orchestration platform that adds stateful memory, tool management, and error recovery to LLMs — supporting 50+ models, 30+ MCP tools, and deployment across web UI, CLI, REST API, and Discord. A production-oriented agent infrastructure layer.
Folk Computer: Tangible Computing for the Real World
Folk Computer is an open-source project building a tangible, physical computing environment for the real world — practical, hands-on, community-driven. Backed by Ink & Switch and NYU ITP, it embodies the 'folk' computing philosophy of accessible, improvised tools.
Handy: Local Push-to-Talk Speech-to-Text
Handy is a free, open-source, cross-platform push-to-talk speech-to-text app that transcribes locally and pastes into any text field. No cloud, no accounts — just press, speak, release.
How to Build an Agent: Minimal Code-Editing Agent in <400 Lines
A practical tutorial showing how to build a fully functional code-editing agent in under 400 lines of code. Worth reading as a minimal reference implementation that strips the problem down to its essential loop.
ChezWizper
ChezWizper is a GitHub project by silvabyte, likely a local Whisper-based speech transcription tool. Part of the growing ecosystem of local AI tools that run OpenAI's Whisper model on-device for private transcription.
RsyncUI: SwiftUI GUI for rsync on macOS
RsyncUI is a SwiftUI macOS GUI for rsync that makes the powerful but intimidating CLI tool accessible without touching the terminal. Requires macOS Sonoma or later.
Sim Studio: Visual Agent Workflow Builder
Sim Studio is an open-source visual agent workflow builder — connect LLMs, tools, and vector stores on a canvas, then deploy immediately. An AI copilot generates nodes and fixes errors from natural language, and 1000+ integrations are supported.
Docs (suitenumerique): Open-Source Collaborative Editor
Docs is an open-source collaborative text editor built with Django and React, designed as a Notion or Google Docs alternative for organizations that want self-hosted data ownership. MIT licensed, real-time with live cursors and offline editing, with optional AI writing assistance.
Mathematical Foundations of Reinforcement Learning
Mathematical Foundations of Reinforcement Learning by Shiyu Zhao is an open-access textbook covering RL theory rigorously — Bellman equations, value functions, policy gradient methods — with a mathematical depth missing from most applied RL courses. Free on GitHub.
Topography Explorer: interactive terrain visualization
Topography Explorer is a web tool for visualizing topographic elevation data interactively — browse terrain, contours, and elevation gradients across the globe using open elevation datasets.
OpenAuth
OpenAuth is a universal, standards-based auth provider from the SST team — framework-agnostic, runs on any JS runtime, and follows OAuth 2.0 spec rather than inventing custom auth patterns. An alternative to Auth.js, Clerk, and hosted auth services for teams who want standards compliance without vendor lock-in.
Bjorn: Raspberry Pi Network Scanner with e-Paper Display
Bjorn is a network scanning and offensive security tool for Raspberry Pi with a 2.13-inch e-Paper HAT display — discovers targets, identifies open ports and vulnerable services, and shows results on the tiny screen. A self-contained portable pentesting device for the hobbyist security researcher.
TensorZero
TensorZero is a self-hosted LLMOps platform that unifies gateway, observability, evaluation, optimization, and A/B testing in one Rust-built system. The feedback loop: production inference data flows back into prompt and model improvement automatically.
dotenvx
dotenvx is an improved dotenv from the original creator — adding encrypted .env files, multi-environment support, and a CLI that works across any language or stack. Lets you commit encrypted .env files to git without a secrets server.
wat: Deep Inspection of Python Objects
wat is a Python deep inspection tool for exploring objects at runtime — type, value, methods, parent classes, source code, and signatures, all with one expression. Fills the gap between dir() and a full debugger.
Onlook: Open-Source Visual Editor for React
Onlook is an open-source visual editor for React that lets you edit your running app and writes changes back to code in real-time — Webflow-style design control for your own codebase, without leaving the local-first desktop environment.
SketchyBar: Highly Customizable macOS Status Bar Replacement
SketchyBar is a highly customizable macOS status bar replacement that lets you build a fully custom top bar with scripts, widgets, and plugins. The starting point for anyone who wants a custom macOS desktop setup.
Piku: The Tiniest PaaS You've Ever Seen
Piku is a tiny self-hosted PaaS that lets you git-push to deploy to your own servers — a minimal Heroku-style experience with no containers required. Under 2000 lines of Python, runs on any Linux server.
Inspectus: LLM Analytics and Visualization
Inspectus is labml.ai's tool for visualizing LLM internals — attention maps, token distributions, and model analytics rendered as interactive visualizations in Jupyter notebooks. Makes transformer attention patterns inspectable without custom code.
Eidolon: open-source agent service framework
Eidolon is an open-source agent service framework that treats AI agents as first-class services with defined APIs, not just Python scripts — enabling agents to communicate with each other and be composed into larger systems. Targets production deployment of multi-agent architectures.
WunderGraph: open-source GraphQL federation
WunderGraph is an open-source, Apache 2.0 licensed GraphQL federation solution with schema registry, composition checks, analytics, and routing — deployable on-premises or as a managed service. Targets teams building federated GraphQL APIs who want to avoid vendor lock-in.
Memoria: structured memory management for AI agents
Memoria is a memory manager for AI agents that routes information to appropriate memory types (episodic, semantic, procedural) to enable dynamic, context-aware responses. An attempt to implement a structured cognitive architecture for LLM memory.
FastUI: Python-Defined React UIs
FastUI is a Pydantic framework for building React-based web UIs entirely in Python — no JavaScript required. The backend defines UI structure as Pydantic models, and matching TypeScript interfaces render them. Now inactive.
iauto: Low-Code LLM + RPA Automation Engine
iauto is a low-code automation engine that combines LLMs with RPA tools (Appium, Playwright) in YAML-defined workflows. Bridges AI reasoning with traditional robotic process automation for adaptive task execution.
ReadySet: Transparent Database Caching Layer
ReadySet is a Rust-built wire-compatible caching proxy for MySQL and PostgreSQL that sits between your app and database, incrementally maintaining cached query results via the replication stream. Drop-in deployment with no application code changes.
Mazzle: Pipelines as Code for DevOps
Mazzle is a pipelines-as-code tool for building large, complicated, consistent environments — define infrastructure and build pipelines declaratively, run them as a server. An early-generation IaC-adjacent tool predating Terraform's dominance.
txtai: All-in-One Embeddings Database
txtai is an all-in-one open-source embeddings database combining semantic search, LLM orchestration, and language model workflows. Positions itself as the engine underneath an AI application rather than a standalone vector database.
AirLLM: 70B LLMs on a 4GB GPU
AirLLM runs 70B LLMs on a single 4GB GPU and 405B Llama3.1 on 8GB VRAM — without quantization, distillation, or pruning. It optimizes inference memory usage itself rather than compressing the model, preserving full model quality on consumer hardware.
macOSpilot: Voice + Vision AI Assistant for macOS
macOSpilot is an open-source macOS AI assistant that combines voice input and screen vision to answer questions about any application in context — it sees what you're looking at and hears your question, then responds in audio. An early demonstration of multimodal desktop AI assistance.
Lobe Chat: Open-Source High-Performance Chat Framework
Lobe Chat is a high-performance open-source ChatGPT framework with speech synthesis, multimodal support, and an extensible plugin system — one-click self-deployable to Vercel. More production-ready and feature-complete than basic ChatGPT clones, with an active plugin ecosystem.
Internet of Agents: Browser Agent Swarms via MultiOn
Internet of Agents is an open-source framework for building swarms of internet-browsing AI agents using MultiOn, enabling autonomous web tasks at scale. An early demonstration of multi-agent browser automation coordinated through a single API.
Danswer: Natural Language Q&A Over Private Sources
Danswer (now Onyx) is an open-source enterprise Q&A system that connects to Slack, GitHub, Confluence, and other internal tools to answer natural language questions over private knowledge. Self-hosted with strong access-control enforcement — a production-ready alternative to building RAG from scratch.
Ava: All-in-One Desktop App for Running LLMs Locally
Ava is an all-in-one desktop app for running LLMs locally — chat, image generation, and model management in a single native application. An alternative to LM Studio targeting users who want everything bundled together without CLI setup.
CopilotKit: In-App AI Chatbots and AI Textareas for React
CopilotKit is a React library for embedding AI chatbots and AI-powered text areas into web apps — with the app's own context injected automatically. Makes it straightforward to add a context-aware AI assistant to an existing React app without building the RAG layer yourself.
SuperDuperDB: Bring AI to Your Database
SuperDuperDB integrates AI models and APIs directly with existing databases — train, manage, and query models where your data already lives rather than moving data to a separate vector database. A database-native alternative to building a separate AI data pipeline.
Bulktag: Batch Image Tagging with GPT-4 Vision
Bulktag uses GPT-4 Vision to batch-tag images automatically — send a folder of images, get back descriptive tags for each. An early practical application of GPT-4V for metadata generation and image library organization.
Lato: Python Microframework for Modular Monoliths
Lato is a Python microframework for building modular monoliths and loosely coupled applications — explicit module boundaries, dependency injection, and event-driven communication within a single process. A structured alternative to ad-hoc Django app organization.
Outlines: Guided Text Generation
Outlines is a Python library for guided LLM text generation — constraining model outputs to match JSON schemas, regex patterns, or context-free grammars. It was one of the first production-quality structured generation libraries before OpenAI's own structured outputs feature.
OpenGPTs: Open-Source Custom AI Assistants
OpenGPTs is LangChain's open-source alternative to OpenAI's GPT builder — create custom AI assistants with configurable tools, instructions, and memory backends. Released the same week as OpenAI's GPT Store announcement.
SvelteFlow: Node-Based UI for Svelte
SvelteFlow is the Svelte equivalent of React Flow — a customizable component library for building node-based editors and interactive flow diagrams in Svelte applications. Maintained by the same team as React Flow (xyflow).
Memgraph Odin
Odin is a Memgraph project — likely a monitoring, schema management, or operational tooling layer for the Memgraph in-memory graph database. Part of Memgraph's ecosystem of tools built around their Cypher-compatible graph DB.
agentaction: Action Chaining and History for LLM Agents
agentaction is a Python library for action chaining and history management in LLM agents — a lightweight abstraction for defining, executing, and tracking sequences of agent actions with persistent history. An early building block for agent frameworks.
Gorilla CLI: LLMs for Your CLI
Gorilla CLI is an LLM-powered tool that converts natural language commands into correct shell commands — type what you want to do, get the right command. Built by the team behind the Gorilla LLM model for API function calling.
ayb: Multi-Tenant Database for Data Ownership
ayb is a multi-tenant database server built on SQLite that lets individuals own and control their own data — each user gets their own database instance. A philosophical statement about data ownership as much as a technical product.
AnythingLLM: Documents to Chatbot
AnythingLLM is a full-stack open-source application for turning any document collection into a chatbot — with a polished UI, workspace management, and multi-model support. The self-hosted alternative to ChatGPT Enterprise for teams wanting document Q&A over their own files.
OpenChat: LLM Custom Chatbot Console
OpenChat is an open-source LLM chatbot console with document ingestion and custom bot creation — an early self-hosted alternative to ChatGPT for teams wanting to deploy domain-specific chatbots over their own data.
Democratizing AI with Open-Source Language Models
LWN's coverage of the democratizing AI discussion around open-source language models — examining the tension between open-source access enabling innovation and the risks of unguarded deployment. A useful 2023 snapshot of the open vs. closed AI debate from the Linux community perspective.
Leaked Google Document: "We Have No Moat, And Neither Does OpenAI"
Simon Willison's commentary on the leaked Google 'We Have No Moat' document, providing context and links to the SemiAnalysis publication. Willison frames the memo as significant for its candor about open-source AI's rapid quality trajectory.
Google "We Have No Moat, And Neither Does OpenAI"
A leaked internal Google document arguing that open-source AI will outcompete both Google and OpenAI — the thesis being that open-source models iterate faster, require no API fees, and are already approaching proprietary quality. One of the most influential strategic memos of the 2023 AI boom.
OpenLLaMA: Open Reproduction of LLaMA
OpenLLaMA is an open-source reproduction of Meta's LLaMA model trained on the RedPajama dataset, released under permissive Apache 2.0 licenses. It was one of the first serious attempts to produce a fully open LLaMA-quality model that anyone could use commercially.
MLC-LLM: LLMs on Every Device
MLC-LLM enables running large language models natively on any device — laptops, phones, browsers — without a server, by compiling models through the Apache TVM compiler stack. One of the earliest frameworks to make on-device LLM inference practical across diverse hardware.
Cube: The Semantic Layer for Data Applications
Cube is an open-source semantic layer for building data applications — it sits between your data sources and your frontend, defining metrics, dimensions, and access control in a single place. Eliminates duplicated metric logic across BI tools, APIs, and embedded analytics.
EditAnything: Segment Anything + Stable Diffusion for Image Editing
EditAnything combines Meta's Segment Anything Model with Stable Diffusion to enable precise region-based image editing — click to select any object, then replace or transform it with a text prompt. One of the first practical applications of SAM.
Refine: Open-Source Enterprise Application Platform
Refine is an open-source React-based framework for building enterprise internal tools, admin panels, and dashboards — providing authentication, CRUD operations, and data provider abstractions out of the box. A serious alternative to custom admin panel builds.
Horace: Self-Hosted LLM Chatbot with ChatGPT Plugin Support
Horace is an open-source LLM chatbot server that supports ChatGPT plugins — letting you run a self-hosted chatbot that can use the growing ecosystem of ChatGPT plugin tools. An early attempt to bring plugin-based tool use outside of OpenAI's walled garden.
ChatArena: Multi-Agent Language Game Environments for LLMs
ChatArena provides multi-agent game environments for LLMs — structured settings where multiple LLMs interact, debate, negotiate, or play games with defined rules and roles. A research framework for studying emergent multi-agent behavior.
Alpaca LoRA: Instruct-Tuning LLaMA on Consumer Hardware
Alpaca LoRA applies Low-Rank Adaptation to fine-tune LLaMA on consumer GPUs — making instruction-following fine-tuning accessible without data center hardware. Part of the March 2023 democratization wave that showed open LLM development didn't require massive compute.
nextjs-chatgpt-app: Open-Source GPT-4 Chat Interface
An open-source ChatGPT web app built with Next.js and React featuring response streaming, code highlighting, and developer-focused presets — a template for building GPT-4-powered interfaces before this became commoditized.
Dalai: Run LLaMA Locally with One Command
Dalai is a one-command installer for running LLaMA models locally — npm install to set up, then query models via CLI or socket server. One of the first tools to make local LLM inference accessible to developers without ML expertise.
Colossal-AI: Open-Source ChatGPT Training Replication
Colossal-AI released an open-source implementation of the ChatGPT training process (SFT + RLHF) that runs on a single GPU with 1.6GB memory — 7.73x faster than naive implementations. Made the ChatGPT training pipeline accessible to researchers without multi-GPU clusters.
Llama Hub: LlamaIndex Data Connector Marketplace
Llama Hub is the LlamaIndex community marketplace for data loaders — connectors that pull data from Notion, Slack, GitHub, databases, APIs, and more into LlamaIndex for RAG pipelines. The npm registry equivalent for LLM data connectors.
Promptable.js: TypeScript Library for LLM Apps
Promptable.js is an early TypeScript library for building LLM apps with Prompt, Search, Chain, and Trace primitives — a TypeScript analogue to LangChain that appeared in February 2023 before LangChain's own TypeScript support matured. Historically significant as one of the first LLM frameworks for TypeScript developers.
tldraw: Infinite Canvas Drawing App
tldraw is a tiny, open-source infinite canvas drawing app with a clean developer SDK — excellent for whiteboarding, diagrams, and embedding collaborative drawing into your own applications. Later gained prominence for its 'make it real' GPT-4V integration demo.
Cognosis AI Platform
Cognosis AI's open-source platform repository — an early AI agent platform from 2023. Content not available but saved as a reference to an early-stage AI infrastructure company working on agent platforms before the space became crowded.
backend-GPT: Natural Language Backend Generation
backend-GPT is an early experiment in using GPT to generate backend code from natural language descriptions — part of the wave of GPT-powered code generation tools that emerged before GitHub Copilot popularized the category. Represents the early exploration of LLMs as backend architects.
ChatRWKV: ChatGPT Powered by an RNN
ChatRWKV is a ChatGPT-like chatbot built on the RWKV architecture — a language model that achieves transformer-level performance using an RNN design, enabling constant memory inference regardless of sequence length. A significant architectural alternative to attention-based transformers.
microfeed: Self-Hosted CMS on Cloudflare
microfeed is a lightweight self-hosted CMS that runs entirely on Cloudflare's free tier — Workers, R2, D1 — for publishing podcasts, blogs, photos, videos, and curated links. An elegant example of serverless CMS architecture with near-zero hosting costs.
Replicate Cog: Containers for Machine Learning
Cog is Replicate's open-source tool for packaging machine learning models into standardized Docker containers with automatic HTTP APIs. It's the packaging layer that powers Replicate's model hosting platform — define inputs/outputs in Python, get a container that serves the model.
Automerge: CRDTs for Collaborative Applications
Automerge is a CRDT (Conflict-free Replicated Data Type) library for building collaborative applications that work offline and sync automatically without conflicts. The technical foundation of the local-first software movement.
Tailscale golink: Private Shortlinks for Tailnets
golink is Tailscale's open-source private URL shortener for tailnets — lets your team use short go/links (like go/slack, go/docs) that resolve inside your Tailscale network. A small but sharp internal productivity tool.
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
The BLOOM paper introducing a 176-billion parameter open-access multilingual language model trained by the BigScience collaborative on 46 natural languages and 13 programming languages. It demonstrated that a community-organized research effort could produce a frontier-scale LLM without proprietary infrastructure.
D2 — Diagram Scripting Language
D2 is a modern diagram scripting language that compiles text to diagrams — like Graphviz but with a cleaner syntax, built-in layouts, and themes. Treats diagrams as code, enabling version control and programmatic generation.
Automatic Prompt Engineer (APE)
Automatic Prompt Engineer (APE) is a research implementation that automatically generates and selects optimal prompts for LLMs using a generate-then-score approach. An early automated prompt optimization method predating DSPy.
Foundry Template for Solidity Smart Contracts
A production-ready Foundry project template for Solidity smart contract development — opinionated defaults for testing, linting, and CI. Foundry replaced Hardhat as the preferred Solidity toolchain for many developers around 2022.
SOANM — Shell Of A New Machine
SOANM (Shell Of A New Machine) is a minimal shell script for quickly configuring new environments — bootstrapping dotfiles and core tooling without a heavy framework. The anti-Ansible approach to machine setup.
ROOTS Search Tool — BigScience
A Hugging Face Space for searching ROOTS — the massive multilingual dataset used to train BLOOM, the BigScience open LLM. Lets researchers trace which training documents a model might have learned from.
redframes — Python Data Manipulation Library
redframes is a general-purpose Python data manipulation library that wraps pandas with a more consistent, readable API — aimed at making common data wrangling tasks less verbose without abandoning the pandas ecosystem.
Self-Hosting Guide
A comprehensive GitHub reference covering self-hosted alternatives to cloud services — NAS, media servers, home automation, password managers, and more. The definitive starting point for anyone building a home server setup.
Canarytokens Docker — Self-Hosted Honeytokens
Thinkst's Canarytokens Docker setup lets you self-host your own canarytoken server — tripwires that alert you when someone accesses a file, URL, or credential they shouldn't know about. The DIY version of Thinkst's hosted canary service.
Obsidian Omnisearch
Omnisearch is an Obsidian plugin that replaces the native search with full-text search that 'just works' — ranking results intelligently based on match quality, note size, and recency. Solves Obsidian's long-standing weak native search with BM25-style relevance scoring.
Logseq: A Privacy-First, Open-Source Knowledge Base
Logseq is a privacy-first, open-source knowledge base and daily journaling tool built around outliner-style pages with bidirectional linking. It positions itself as a local-first alternative to Roam Research and Notion, with all data stored in plain text on your own machine.
OpenBB Terminal: Open-Source Investment Research
OpenBB Terminal is an open-source Python-based investment research platform that brings Bloomberg Terminal-style capabilities to retail investors and developers. A community-built alternative to expensive financial data terminals.
NatBot: GPT-3-Driven Browser Automation
NatBot is an early LLM-driven browser automation bot by Nat Friedman — it takes a natural language task, drives a Chromium browser via Playwright, and completes multi-step web tasks. A 2022 proof-of-concept for what later became the AI browser agent category.
Reactive Resume
Reactive Resume is a free, open-source resume builder focused on making creation, updating, and sharing easy. No proprietary lock-in — you own your data, export to PDF, and can self-host the instance.
MagicPrompt-Stable-Diffusion
MagicPrompt-Stable-Diffusion is a GPT-2-based model fine-tuned to generate effective prompts for Stable Diffusion. It solves the prompt engineering problem for image generation: given a simple idea, it produces elaborate prompt text that reliably produces better images.
YunoHost: Self-Hosted Server for Everyone
YunoHost is an open-source server OS that makes self-hosting web apps as simple as clicking install — Nextcloud, Gitea, Mastodon, and 100+ others available in one catalog. It handles DNS, SSL, user management, and backups automatically, dramatically lowering the barrier to self-hosting.
ONNX Stable Diffusion Exporter for Hugging Face Diffusers
The pull request adding ONNX export and an ONNX inference pipeline to Hugging Face Diffusers — enabling Stable Diffusion to run via ONNX Runtime on hardware accelerators beyond CUDA, including DirectML for Windows GPUs and optimized CPU inference.
Textual Inversion for Stable Diffusion
A patch enabling textual inversion in Stable Diffusion — the technique of learning a new text token that represents a custom concept (a person, style, or object) from just 3-5 example images. Textual inversion was the first practical method for personalizing Stable Diffusion without full fine-tuning.
Upscayl: Free and Open-Source AI Image Upscaler
Upscayl is a free, open-source AI image upscaler for Linux, macOS, and Windows built with a Linux-first philosophy. It wraps Real-ESRGAN and similar super-resolution models in a polished desktop UI, making AI upscaling accessible without command-line knowledge.
Stable Diffusion: CompVis Open-Source Release
The CompVis open-source release of Stable Diffusion — the text-to-image model that democratized AI image generation. This marked the moment state-of-the-art image synthesis left the walled gardens of DALL-E 2 and Midjourney and became freely runnable on consumer hardware.
Stable Diffusion Initial Release Announcement
The announcement tweet for Stable Diffusion's initial model checkpoint release in August 2022 — weights available for research upon request, with a more permissive release and inpainting coming. Captures the moment the open-source AI image generation era began.
Craiyon (formerly DALL-E mini)
Craiyon, formerly DALL-E mini, is a free web-based text-to-image generator that went viral before Stable Diffusion's release. It gave millions their first hands-on experience with AI image generation, despite producing lower-quality images than commercial alternatives.
Sematic: Python-First ML Pipeline Orchestration
Sematic is an open-source ML pipeline orchestration framework using Python decorators — no YAML, seamless local-to-cloud execution, built-in artifact tracking dashboard. Competes with MLflow and Kubeflow but stays in pure Python.
FauxPilot: Open-Source GitHub Copilot Server
FauxPilot is an open-source, self-hosted alternative to GitHub Copilot that runs Salesforce's CodeGen models locally via Triton Inference Server. Built in response to privacy concerns about Copilot sending code to OpenAI's servers.
RethinkDNS: Serverless DNS Resolver
RethinkDNS is an open-source, serverless DNS resolver with built-in ad and tracker blocking that deploys to Cloudflare Workers, Deno Deploy, or Fly.io — giving you a private, self-hosted DNS-over-HTTPS endpoint for free on serverless infrastructure.
Refinery: Open-Source Data-Centric IDE for NLP
Refinery is an open-source data-centric IDE for NLP — combining programmatic labeling, data management, and neural search in one tool. The code-kern-ai take on Snorkel's programmatic labeling approach, extended with neural search for exploration.
Colossal-AI: Distributed Deep Learning System
Colossal-AI is an open-source distributed deep learning framework that makes training very large models more accessible — cutting GPU memory requirements by up to 10x versus standard PyTorch. One of several systems research projects responding to the GPU memory wall problem in 2022.
BLOOM: Open Multilingual Large Language Model
BLOOM is the first open, multilingual large language model trained transparently by a global coalition of AI researchers — 176B parameters, 46 languages, trained on the Jean Zay supercomputer in France. A direct counterpoint to GPT-3's closed access.
Unidata: Open Web3 Data Aggregation Protocol
Unidata is an open protocol for aggregating and standardizing user activity data across Web3 — social posts, NFT collections, token holdings, DeFi positions — into a unified queryable graph. Designed as a data portability layer for decentralized applications.
Prisma Engines: parser-database Source
The parser-database module inside Prisma's Rust engine — where Prisma Schema Language (PSL) is parsed and validated into a semantic model. Useful reference for understanding how Prisma's schema compiler works internally.
YaLM-100B: Yandex 100B Parameter Language Model
Yandex opensourced YaLM-100B, a 100-billion-parameter GPT-like language model trained on Russian and English text. One of the first non-Western frontier-scale language models released openly, notable both for its scale and its Russian-language capabilities.
Web Scraping Open Project
A GitHub repository collecting open knowledge about web scraping in Python — covering tools, techniques, anti-scraping countermeasures, and best practices. Community-built reference for practitioners building data collection pipelines.
Datasette: Architecture Notes on Simon Willison's Tool
Architecture Notes' deep dive on Datasette by Simon Willison — covering how a SQLite-based tool for instantly publishing databases as explorable web APIs became a beloved tool and a case study in opinionated small-tool philosophy. Willison's approach to software design is worth studying independently.
Dashy: Self-Hosted Personal Dashboard
Dashy is an open-source, self-hosted personal homepage and service dashboard — a customizable start page for your homelab or self-hosted services with widgets, status checks, and icon integration. Popular in the homelab and self-hosted communities.
py-caskdb: Educational Disk-Based Key-Value Store
py-caskdb is an educational Python implementation of the Bitcask storage model — a log-structured, append-only disk-based key-value store. A hands-on way to understand how real KV stores like Riak's Bitcask backend achieve fast writes with crash safety.
OPT Training Chronicles
Meta's OPT-175B training logbook — a day-by-day record of hardware failures, instabilities, loss spikes, and interventions during a ~2 month distributed training run. Rare public documentation of what large language model training actually looks like at scale.
abcdesktop.io: Cloud Native Desktop
abcdesktop.io is a cloud-native desktop environment running on Kubernetes — a full web-accessible desktop with Linux applications delivered via browser. Think VDI built on containers rather than VMs.
cleanlab 2.0: Automatically Find Errors in ML Datasets
cleanlab 2.0 is an open-source Python framework for automatically finding and fixing errors in ML datasets — mislabeled examples, out-of-distribution samples, near-duplicates. Built on the 'confident learning' statistical framework for label noise estimation.
Warpgate: Smart SSH Bastion
Warpgate is an open-source SSH bastion server written in Rust — sits in front of your SSH targets, handles authentication centrally, and records sessions. Unlike traditional bastion hosts, it works with any standard SSH client without requiring a custom client or VPN.
DISCO: Decentralized Privacy-Preserving ML Training
DISCO (from EPFL) is a decentralized, privacy-preserving ML training framework using peer-to-peer networking — no central server, nodes train locally and share model updates directly. Extends federated learning to remove the trusted aggregator requirement.
OpenRefine
OpenRefine is an open-source desktop tool for cleaning and transforming messy data — originally Google Refine, now community-maintained. Handles clustering, deduplication, format normalization, and reconciliation against external databases like Wikidata.
Nikita Voloboev's Knowledge Wiki
Nikita Voloboev's public knowledge wiki — a massive, open personal knowledge base covering programming, math, physics, tools, and philosophy. One of the most ambitious public examples of building a second brain as a living document.
Yet Another GitHub Profile Generator
A meta-post about the proliferation of GitHub profile README generators — a lighthearted survey of an ecosystem that emerged after GitHub enabled profile READMEs in 2020. Reflects how developer tooling communities respond to new features.
Haystack: Question Answering at Scale
Haystack by deepset is an open-source NLP framework for building question-answering and search systems at scale — Retriever-Reader pipelines over large document corpora. An early entrant in what became the RAG ecosystem.
ABX: Blind Audio Comparison Testing
ABX by jaakkopasanen is an open-source tool for conducting blind A/B/X audio comparison tests — the gold standard for objectively evaluating whether two audio signals are perceptibly different. Used for testing headphone EQ curves, codecs, and audio processing.
GPT-J: Self-Hosted Open-Source LLM
A guide to running GPT-J, EleutherAI's open-source GPT-3 analog, in Docker — a 2022 snapshot of what self-hosting a large language model looked like before the Llama era democratized this further. Early example of the open-weight model movement.
Metarank: ML-Powered Ranking Engine
Metarank is an open-source ML-powered ranking engine — takes user feedback signals (clicks, purchases, bookmarks) and trains a Learn-to-Rank model to personalize product listings and search results. Low-code alternative to building a custom LTR pipeline.
Smart Home Components: A Systems Engineer's Setup
Michael Stapelberg's deep-dive into his home automation setup — a systems engineer's perspective on choosing components for a local-first, open smart home without cloud dependencies. Covers protocols, hubs, and the tradeoffs between ecosystems.
kindleServer: Serve Local Files to Kindle
kindleServer serves local HTML files with a Kindle-friendly UI and a Read Mode powered by ReadabiliPy — a simple self-hosted solution for reading long-form web content on a Kindle without relying on Pocket or Send to Kindle.
SEPIA: Open-Source Voice Assistant
SEPIA is an open-source, self-hosted voice assistant framework — a privacy-preserving alternative to Alexa, Google Assistant, and Siri. Runs entirely on your own server, with custom skill development support.
Swarm Training
Shawn Presser's Swarm Training explores distributed ML training across many commodity machines with low-bandwidth interconnects — democratizing large model training beyond clusters with expensive NVLink. Part of the broader open-source effort to train large models outside of big lab infrastructure.
Scalene: High-Performance Python Profiler
Scalene is a high-performance Python profiler that measures CPU time, GPU time, and memory simultaneously with very low overhead — and attributes memory allocation and copy costs line-by-line. The best profiler for Python if you care about both speed and memory.
OrioleDB: Modern Cloud-Native PostgreSQL Storage Engine
OrioleDB is a PostgreSQL table access method (storage engine) built to solve PostgreSQL's wicked scalability problems — bloat, vacuum overhead, lock contention — by using a copy-on-write B-tree and row-level WAL. Aims to make PostgreSQL cloud-native without forking it.
Grist: Open-Source Spreadsheet-Database
Grist is an open-source spreadsheet-database hybrid — like Airtable or Notion Database but self-hostable, with Python formulas and a relational data model. Fills the gap between rigid spreadsheets and heavyweight databases for structured data work.
Hacker News Clone with Remix and React
A Hacker News clone built with Remix and React in universal TypeScript — same codebase runs on server and client. A clean reference architecture for modern full-stack React apps using the Remix framework at a time when it was newly open-sourced.
Awesome OSS Alternatives to SaaS
A curated GitHub awesome list of open-source alternatives to well-known SaaS products, maintained by Runa Capital. The go-to reference when you want to self-host rather than pay for a specific commercial service.
PipelineDP: Differentially Private Data Aggregation
PipelineDP is an open-source framework from Google and OpenMined for differentially private data aggregation at scale — extract insights from large datasets while provably protecting individual privacy. Brings differential privacy out of academia and into data pipeline tooling.
Kibitzr: Self-Hosted Web Page Monitoring
Kibitzr is a self-hosted web monitoring and notification tool — watch pages for changes, parse content with CSS/XPath, run bash/Python transforms, and route alerts to Slack or email. Configured in YAML and deployable on minimal hardware.
Ploomber: Data Pipelines from Dev to Production
Ploomber is a Python framework for building data pipelines that can develop in Jupyter notebooks and deploy to Kubernetes, Airflow, or AWS Batch without rewriting code. Solves the notebook-to-production gap by treating notebooks as first-class pipeline tasks.
Kedro: Production-Ready Data Science Pipelines
Kedro is an open-source Python framework for building reproducible, maintainable, and modular data science pipelines — applying software engineering principles (catalogs, pipelines, project templates) to ML workflows. The answer to 'how do data science teams write production-grade code.'
Netmaker: WireGuard Network Automation
Netmaker automates the creation of fast, secure, distributed virtual networks using WireGuard — with an admin UI, access control, private DNS, and support for mesh, site-to-site, and Kubernetes networking. More featureful than Headscale, trades simplicity for capability.
Headscale: Self-Hosted Tailscale Control Server
Headscale is an open-source, self-hosted implementation of the Tailscale control server — the missing piece that lets you run a fully private Tailscale network without depending on Tailscale's managed infrastructure. The self-sovereignty option for Tailscale users.
Cogment Verse: Human-in-the-Loop Reinforcement Learning
Cogment Verse is an SDK for training and validating AI agents in human-in-the-loop learning (HITL) and multi-agent reinforcement learning environments. Provides a web UI for human participation in training alongside standard RL algorithms like A2C and PPO.
Radicle: Peer-to-Peer Code Collaboration
Radicle is a peer-to-peer code collaboration stack built on Git — no central server, no platform dependency, repositories hosted on a distributed network. The decentralized alternative to GitHub for sovereign code hosting.
AltTab — Windows-style alt-tab for macOS
AltTab is an open-source macOS utility that replaces the default Cmd+Tab app switcher with a Windows-style window previewer showing actual window thumbnails. Fixes the longstanding macOS pain point where Cmd+Tab cycles apps rather than windows.
AltTab: Windows-style alt-tab for macOS
AltTab brings Windows-style alt-tab window switching to macOS — full window previews, keyboard navigation, and extensive customization. The missing window manager feature that Apple never added.
virtual-builders: VM Environment Builder Scripts
virtual-builders is a collection of scripts for building various virtual machine environments — QEMU/KVM-based VMs for development and testing. Useful for quickly spinning up reproducible Linux environments without Docker.
Openby.design: Open-Source Design Resources
Openby.design is a collection of open-source design resources curated for practitioners — fonts, icons, illustrations, and UI components available for free use. A useful bookmark for finding high-quality open-source design assets.
Backup Tool Alternatives: HN Thread
Hacker News thread cataloging backup tool alternatives — attic, borg, restic, and others — with practitioner perspectives on which holds up at scale. The comment thread is where the real comparison happens.
Berkeley Document Summarizer
The Berkeley Document Summarizer is a learning-based extractive summarization system that uses syntactic compression and coreference constraints. Academic research code from Greg Durrett, representing the pre-neural era of NLP summarization work.
How to Make an Awesome Python Package in 2021
Anton Zhiyanov's practical guide to creating a well-structured Python package in 2021 — covering pyproject.toml, setup.cfg, versioning, testing, and publishing to PyPI. A concise alternative to piecing together the official documentation.
Rich: Python Library for Beautiful Terminal Output
Rich is Will McGugan's Python library for beautiful terminal output — syntax highlighting, markdown rendering, tables, progress bars, and formatted logging. Became the standard for making Python CLI tools and scripts look professional.
Deep Daze: Text to Image with CLIP and Siren
Deep Daze is Phil Wang's early text-to-image tool combining OpenAI's CLIP with Siren (implicit neural representations) — one of the first accessible open-source implementations of text-guided image generation, predating DALL-E and Stable Diffusion by over a year.
GPT-Neo: Open Source GPT-3 Scale Language Models
GPT-Neo is EleutherAI's open-source implementation of GPT-style language models at GPT-3 scale — the first serious open attempt to replicate GPT-3's capabilities before open-weight models became common. Historically significant as the origin of the open LLM movement.
Shapash: Making Machine Learning Models Transparent
Shapash is MAIF's Python library for making ML models interpretable to non-technical stakeholders — wrapping SHAP and LIME with better visualizations and business-friendly explanations. Targets the gap between data scientists and decision-makers.
FACET: Human-Explainable AI
FACET is BCG Gamma's Python library for human-explainable AI — extending SHAP with interaction effects and redundancy-aware feature importance, plus simulation tools for model-based what-if analysis. More sophisticated than vanilla SHAP for understanding feature relationships.
SHAP: SHapley Additive exPlanations
SHAP (SHapley Additive exPlanations) is the standard Python library for explaining individual predictions from any ML model using game-theoretic Shapley values. It works across tree models, deep neural networks, and linear models, and produces both local and global interpretability.
OSSU Data Science Curriculum
OSSU Data Science is a free, community-curated curriculum for self-teaching data science to the equivalent of a university degree — structured sequence from linear algebra and statistics through machine learning and specialization. A roadmap for going deep without a formal program.
Running Elasticsearch: Fun & Profit
A free online book on running Elasticsearch in production — cluster sizing, index design, mapping, query optimization, and operational concerns like snapshots and upgrades. Practitioner-focused with real-world configuration guidance rather than API documentation.
grep.app — Fast Code Search Across GitHub
grep.app is a fast regex code search engine across public GitHub repositories — half a million repos indexed, results in milliseconds. Useful for finding real-world usage examples of APIs, patterns, and idioms that GitHub's own search can't handle.
Flowy: The Simple Flowchart Engine
Flowy is a minimal JavaScript library for creating drag-and-drop flowchart UIs in the browser — designed to be embedded in web apps, not as a standalone tool. Lightweight alternative to React Flow or jsPlumb for simple workflow builder features.
GOMP: Git Branch Comparison Tool
GOMP (Git COMPare) is a CLI tool for visually comparing files that differ between two Git branches — a focused alternative to git diff for branch comparison workflows.
Awesome GitHub Profile README Templates
A curated collection of GitHub profile README templates — saved when GitHub profile READMEs launched in mid-2020. Reference gallery for designing a developer profile page with stats, badges, and custom layouts.
Test Driving Elasticsearch Learning to Rank with a Linear Model
OpenSource Connections' hands-on tutorial for the Elasticsearch Learning to Rank plugin with a linear model — walks through feature logging, model training, and deployment. The entry point for adding ML-powered ranking to an existing Elasticsearch stack.
Solr-LTR: From Zero to Learning to Rank in Apache Solr
A practical guide and reference implementation for setting up learning-to-rank in Apache Solr from scratch — covers the Solr LTR plugin, feature extraction, model training, and deployment. Complement to the Elasticsearch LTR tutorials for Solr shops.
Tufte CSS
Tufte CSS brings Edward Tufte's book typography principles to the web — wide margins for sidenotes, clean serif typography, and minimal chrome. A CSS library for anyone who wants their web writing to read like a well-designed book.
PRML: Pattern Recognition and Machine Learning Algorithms in Python
Python implementations of algorithms from Bishop's 'Pattern Recognition and Machine Learning' — the canonical probabilistic ML textbook. Bridges the gap between the math in the book and working code.
LexVec
LexVec is a Go implementation of a word embedding model that factorizes the PPMI matrix with position-dependent weighting, outperforming Word2Vec on several NLP benchmarks at the time. An interesting mid-2010s data point in the race to improve on Word2Vec before attention-based models took over.
Google Open-Sources Its Artificial Intelligence Engine
Wired's coverage of Google open-sourcing TensorFlow on November 9, 2015 — the moment that made production-grade deep learning infrastructure freely available to the world. A historical inflection point in the commoditization of AI tooling.
Mapbox Series B: Building the Whole Mapping Stack
Mapbox's 2015 Series B announcement — $52.55M to build the full mapping stack from vector tiles to SDK. At the time Mapbox was the most serious challenger to Google Maps for developers who wanted control over map styling and data.
Introducing Practical and Robust Anomaly Detection in a Time Series
Twitter's 2015 release of AnomalyDetection — an open-source R library using STL decomposition and the Generalized ESD test to find anomalies in time series. One of the first production-grade anomaly detection tools to be open-sourced by a major tech company.
Yelp Pyleus — Apache Storm Topologies in Pure Python
Yelp open-sources Pyleus — a framework for writing Apache Storm stream processing topologies in pure Python. Solved the JVM barrier that kept Python data engineers from using Storm's real-time streaming capabilities.
Dat Project — Open Data Infrastructure
Wired profile of Max Ogden and the Dat Project — a decentralized, versioned data sharing protocol designed to make scientific and public datasets as easy to share and update as code on GitHub. An ambitious vision for open data infrastructure that was ahead of its time.
Raneto — Markdown-Powered Knowledgebase for Node.js
Raneto is an open-source, flat-file knowledgebase for Node.js that stores all content as Markdown files — no database required. A 2014 example of the then-emerging pattern of Markdown-as-content-store that later influenced tools like Obsidian and Notion.
C3.js — D3-Based Reusable Chart Library
C3.js is a reusable chart library built on top of D3.js that provides a higher-level API for common chart types. It removes the need to write D3 directly while still exposing D3 objects for customization.
The PourOver Book — NYT's In-Browser Filtering Library
PourOver is an NYT-open-sourced JavaScript library for fast in-browser filtering and sorting of large collections. Built for news apps that need to let users slice thousands of items without server round-trips.
Announcing Portia — Open Source Visual Web Scraper
Scrapinghub's Portia is an open-source visual web scraper — a point-and-click interface on top of Scrapy that lets you build scrapers without writing code. It made web scraping accessible to non-programmers while keeping Scrapy's power underneath.
Clojure for the Brave and True
Daniel Higginbotham's free online book for learning Clojure — covers functional programming, the JVM, macros, and concurrency with a humor-forward style. One of the most recommended Clojure introductions for programmers coming from imperative languages.
Stanford CoreNLP: Free Text Analysis Pipeline
Stanford's CoreNLP — the Java-based NLP pipeline from Stanford's NLP Group offering tokenization, POS tagging, NER, parsing, coreference resolution, and sentiment analysis in one tool. The dominant academic NLP pipeline before deep learning NLP models took over.
Apache Hadoop 2 Is Now GA
Hortonworks announcement that Apache Hadoop 2 reached general availability in October 2013 — introducing YARN as the cluster resource manager. A landmark release that decoupled compute from MapReduce and made Hadoop a general-purpose cluster platform.
Netflix Genie: Hadoop Platform-as-a-Service
Netflix open-sourced Genie in mid-2013 — a REST-based Hadoop Platform-as-a-Service that abstracted job submission across multiple Hadoop clusters. A key piece of Netflix's data platform that became an influential pattern for multi-cluster job routing.
Introducing Tabula
Tabula is an open-source tool for extracting tabular data from PDFs — a specific but critical pain point for data journalists and researchers working with government and scientific publications that publish data as PDFs instead of structured files.
Vega — A Visualization Grammar
Vega is a declarative visualization grammar built on D3.js by Trifacta (Jeffrey Heer's group) — JSON specifications describe charts rather than imperative D3 code, making visualizations more composable and shareable. The foundation for what later became Vega-Lite and Altair.
Airbnb Open Sources Chronos: A Distributed Cron Replacement
Airbnb's open-sourcing of Chronos, a distributed cron replacement built on Apache Mesos. A notable moment in the early days of the Mesos ecosystem, showing how Twitter-era infrastructure patterns were spreading across Silicon Valley companies.
Proprietary Hadoop Is a Losing Strategy
ReadWrite's 2013 argument that commercial Hadoop vendors who added proprietary lock-in would lose to those who contributed everything upstream — a prescient thesis that proved partly right, partly wrong over the following decade.
EveryBlock Source Code — Google Code
EveryBlock's source code released publicly after MSNBC shut down the service — a civic data aggregation platform that combined neighborhood-level crime, restaurant inspections, permits, and news. Adrian Holovaty's landmark local journalism experiment.
Timeline JS — Beautifully Crafted Timelines
Timeline JS by Veríte — an open-source tool for building interactive timelines from a Google Spreadsheet. Widely adopted by journalists and educators in 2012-2014 for its zero-code approach to narrative data visualization.
TodoMVC
TodoMVC is a project that implements the same Todo application across every major JavaScript framework, letting developers compare syntax and architecture side by side. It became the de facto benchmark for evaluating JS frontend frameworks.
Kittydar: JavaScript Cat Face Detection
Kittydar is a JavaScript library for cat face detection in images — a real implementation of neural-network-based object detection in the browser, released in 2012 when running ML in JavaScript was novel and this kind of project showed what was becoming possible.
GitHub Archive: Daily Repo Reports
GitHub Archive's daily repo reports newsletter from 2012 — an early attempt to surface trending repositories and developer activity from the GitHub firehose. A predecessor to the modern 'GitHub trending' feature and developer discovery tools.
Legit: Git Workflow for Humans
Legit is a Python-based git extension by Kenneth Reitz that wraps git branch management in more human-friendly commands. It fills a real gap: git's branch model is powerful but the command interface is notoriously user-hostile.
AVRQueue: Task Scheduler and Watchdog for Arduino
AVRQueue is a cooperative task scheduler and watchdog for Arduino/AVR microcontrollers — lets you run multiple pseudo-concurrent tasks without an RTOS. Useful when polling multiple sensors or peripherals in a loop without blocking.
Twitter to Open Source Hadoop-Like Tool (Storm)
GigaOM coverage of Twitter's plans to open-source Storm — their real-time stream processing system. The moment the Hadoop-for-streaming gap became a major industry conversation, and Nathan Marz's Storm became the answer.
nginx Architecture (AOSA Vol. 2)
The nginx chapter from Architecture of Open Source Applications — Andrew Alexeev's deep dive into how nginx achieves high concurrency through event-driven, asynchronous I/O rather than the Apache thread-per-connection model. The clearest explanation of why nginx's design matters and what C10K forced people to rethink.
DIYHarappaWorld: Population Genetics for Personal Genomes
DIYHarappaWorld let people run the Harappa Ancestry Project's South Asian population genetics analysis on their own genetic data. An early example of citizen science genomics — taking academic ADMIXTURE tools and making them accessible to personal genome hobbyists.
Coding Horror: Learn to Read the Source, Luke
Jeff Atwood's Coding Horror post arguing that reading source code directly — not documentation, not Stack Overflow — is the highest-leverage skill for programmers. The ability to trace behavior to its root in code is what separates competent from exceptional developers.
Netflix to Open Source Army of Cloud Monkeys
Wired's report on Netflix open-sourcing the Simian Army — a suite of tools including Chaos Monkey that deliberately broke production systems to test resilience. The foundational document of chaos engineering as a discipline.