Founding Software Engineer · AI-Native Systems
Justin Rhinesmith
REV 2026-07SHEET 1 OF 1
Founding engineer with 20 years of experience building and scaling backend systems, now building production LLM application infrastructure — document ingestion and schema-constrained extraction, agentic workflows, eval gates, model routing, and LLM observability — plus the reliability, developer tooling, and CI that ship it to production.
Founding Software Engineer · Boon
Jul 2023 – Present · SF Bay Area
First engineering hire at Boon (getboon.ai), the AI intelligence layer for construction — agents that run preconstruction workflows from blueprint to bid. Built core platform systems across two product generations (freight automation → construction estimation), partnering directly with the CEO and early customers.
- Architected the workflow engine (Rails, Sidekiq, PostgreSQL) for LLM-powered document ingestion — PDF parsing, structured extraction against enforced schemas, retries, and human-in-the-loop review — used across both freight automation and construction estimation, including semantic mapping from customer-specific catalogs into canonical bid/takeoff data.
- Core engineer on the AI Takeoff platform: collaborative multi-user annotation with an offline mutation queue and server-side conflict reconciliation, a server-side PDF pipeline handling 300+ page drawing sets, and the V1→V2 canvas migration — adding deterministic canvas test hooks and Playwright fixtures that drove the canvas in CI and caught migration regressions.
- Built the agent-native engineering harness — CI eval gates, acceptance-criteria-driven verification, architectural fitness tests, and autonomous maintenance workflows — that let the team ship at high volume (1,400+ reviewed PRs in 12 months) without loosening regression coverage or release-health gates.
- Own production reliability and observability: OpenTelemetry (Grafana, Loki, Tempo, Prometheus), release-health-gated progressive rollouts, and a chaos-engineering harness that surfaced and fixed real resilience bugs (unbounded queries, error-classification faults, third-party-outage worker hangs) before they reached customers.
- Shipped self-serve monetization end to end: Stripe subscriptions and token top-up billing, plus automated per-org trial provisioning for the Boon Agent product.
- Hardened the LLM gateway: model routing, provider circuit breaker with mid-stream fallback, and Bedrock prompt caching; cost work eliminated the single largest line item of third-party model spend.
Staff Engineer · DoorDash
Nov 2019 – Jul 2023 · SF Bay Area
Joined pre-IPO and helped scale through the December 2020 public offering and pandemic-era hypergrowth. Tech lead across Category Expansion (Pharmacy → Convenience & Health).
- Led the HIPAA-compliant DoorDash Pharmacy pilot: isolated identity and data boundaries, restricted access paths, and auditability, coordinated across engineering, product, and legal.
- Architected Inventory Service and co-designed the Restriction Rules Service for eligibility and compliance constraints used across Alcohol/Health.
- Drove HSA/FSA eligibility & reimbursement features; coordinated cross-functional delivery and scoping across Category Expansion.
- Ran Category Expansion design reviews and mentored engineers through architecture reviews.
Tech Lead · Square (Caviar Team)
Jun 2019 – Nov 2019 · SF Bay Area
Tech lead on the Caviar engineering team, driving scalability, data privacy, and post-acquisition integration work between Caviar and DoorDash.
- Led the Caviar-to-DoorDash user migration for millions of accounts: owned the runbook — data migration, identity reconciliation, backfill validation, and rollback plan — for a low-downtime acquisition cutover.
- Helped implement CCPA compliance features across customer data services, ensuring secure data export and deletion flows in alignment with privacy regulations.
- Diagnosed and resolved scaling bottlenecks across core Rails and Postgres systems, improving throughput and API reliability during peak ordering windows.
Director of Engineering · Opportunity Education
Jun 2015 – Jun 2019 · SF Bay Area
Promoted from Lead Dev; managed Android & React products backed by Rails.
- Led a 7-person team; introduced CI/CD and versioned APIs; scaled Rails/Postgres/Redis.
Co-founder / CTO · MoveMeFit
2014 – 2015
Built and launched a subscription fitness platform — Swift iOS app featured in Apple's Best New Apps and Health & Fitness, backed by a Rails API I architected end to end.
- Designed a versioned JSON API (OAuth2) powering the iOS app: streaming workout video, social following, and scheduled group workouts.
- Shipped dual-rail subscription billing (Stripe + Apple in-app purchase receipt validation) with gifts, vouchers, and referral credits.
- Integrated Fitbit, Jawbone, and Spotify; Elasticsearch-backed discovery; Sidekiq/Redis background processing — with RSpec + Cucumber coverage and CI.
Senior Engineering Manager · Kabam
2011 – 2014
Led engineering on live-service mobile/social games across iOS, Facebook, and Google platforms.
- Led 10 engineers; kept sub-250ms latency while serving 180k+ RPM; scaled Rails/Node backends to 1M+ MAU.
- Built high-throughput game backends (Rails, MySQL, Redis) with cross-platform in-app-purchase validation, tournament/leaderboard systems, and a StatsD-instrumented live-ops and analytics pipeline.
Director of Development · Three Stage Media
2006 – 2011
Multiple Rails apps for content/document delivery; introduced testing, code reviews, CI/CD.
Associate Software Engineer · Liberty Mutual
2005 – 2006
Led migration from Lotus Notes to Mantis within Agency Markets.
Ball State University — B.S. Computer Science; B.S. Mathematical Sciences
2005 · Muncie, IN
- Generating Individual Play Bases in a Virtual Space Using Markup Information
- Using Crowd-Sourcing to Verify the Accuracy of Results of Client-Side Determinations
- Core
- Ruby/Rails, TypeScript/React, Python, PostgreSQL, Redis, Sidekiq, Kafka, Elasticsearch
- AI / LLM
- Claude/OpenAI/Bedrock, agentic systems & tool use, MCP, structured outputs, model routing, evals, LLM observability, prompt caching
- Observability
- OpenTelemetry, Grafana, Loki, Tempo, Prometheus, Sentry
- Infra
- AWS, Terraform, Docker, GitHub Actions, Render, Playwright