Jobs ETL
Mar 4, 2025
·
1 min read
A dashboard served by a pipeline orchestrated using Dagster to extract job postings from various job boards, deduplicate them, load into a PostgreSQL database, and transform via dbt and OpenAI each night. Additionally, a containerized FastAPI service behind NGINX provides secure RESTful endpoints exposing the pipeline outputs.
