For teams hiring a Senior Data Engineer
I build pipelines where every number names its source.
I turn messy public and commercial data into records people make career decisions on. Each stage writes output a person can read, and each figure says where it came from.
What you get
- 4,455military job codes parsed and indexed across five service branches
- 8keyed datasets produced by one staged pipeline
- 3 tiersof salary data, with the tier recorded on every row
- $0in API keys for the O*NET and BLS scoring chain
The three artifacts to read
-
MOS Translator
A staged, resumable pipeline: parse job codes, generate schema-validated records, join them to a role taxonomy and salary data, publish static pages and a gap report.
-
AI-Era Job Kit
Ingests O*NET database files, BLS tables and the BLS API, and public job board APIs with the standard library alone. It stops when a source is unavailable.
-
J0DI3 AI backend
PostgreSQL with pgvector as the system of record, migrations tested down and back up in CI, field-level encryption, access audit logging and 30-day retention.
How I work with data
- Label the source on the row. Salary records carry a
dataSourcefield, so a reader can tell a live Lightcast figure from a Census estimate or a curated value. - Validate at the boundary. Generated records must match a schema before they are written. A quote that is not in the source text is rejected.
- Refuse stale data. Postings older than 14 days and O*NET data older than 30 are rejected, and scripts stop when a live source is down.
- One definition per number. Each published outcome statistic is defined once, with its source and date, and pinned by a test.
- Make runs resumable. Batches are small and merge into existing output, so a failed run continues where it stopped.
The reasoning behind each of these is in the decision records.
Data experience beyond these artifacts
- Senior Data Engineer, Serket-Tech Cyber Security. Designed the risk taxonomy and star schema data model behind an enterprise GRC Risk Register for a Fortune 500 healthcare company, and delivered Power BI dashboards with real-time filtering and drill-through.
- Vets Who Code. Firebase and GCP engagement data pipelines on Apache Kafka and Spark.
- Microsoft. React and Python BI dashboards for Starbucks that cut retrieval time by about 50%.
Dates and detail are on the résumé.
Skills
Logistics
I am based in Atlanta, Georgia, and work remotely. I am open to Senior Data Engineer roles, especially on teams building data for AI products.