Hiring cafe extractor (#192)

* feat(hiringcafe): register new source across shared/server/client enums

* feat(hiringcafe-extractor): add browser-backed Hiring Cafe dataset extractor

* feat(orchestrator): integrate Hiring Cafe discovery service into pipeline

* feat(orchestrator-ui): add Hiring Cafe to source availability and run estimates

* chore(hiringcafe): wire CI/docker and add extractor documentation

* chore(format): apply biome formatting for Hiring Cafe integration

* add original websites

* coomints

* number or null

docs-site/docs/extractors/adzuna.md

@@ -7,6 +7,8 @@ sidebar_position: 6
 
 ## What it is
 
+Original website: [adzuna.com](https://www.adzuna.com)
+
 Adzuna is an API-backed extractor implemented in two lean pieces:
 
 1. `extractors/adzuna/src/main.ts` fetches paginated Adzuna search results and writes `jobs.json`.

docs-site/docs/extractors/gradcracker.md

@@ -7,6 +7,8 @@ sidebar_position: 2
 
 A plain-English walkthrough of the Gradcracker extractor in `extractors/gradcracker`.
 
+Original website: [gradcracker.com](https://www.gradcracker.com)
+
 ## Big picture
 
 The crawler builds search URLs, scrapes listing pages, then opens job details for descriptions and apply URLs.

docs-site/docs/extractors/hiring-cafe.md

@@ -0,0 +1,74 @@
+---
+id: hiring-cafe
+title: Hiring Cafe Extractor
+description: Browser-backed Hiring Cafe extraction integrated into the pipeline source selector.
+sidebar_position: 7
+---
+
+## What it is
+
+Original website: [hiring.cafe](https://hiring.cafe)
+
+Special thanks: Initial implementation inspiration came from [umur957/hiring-cafe-job-scraper](https://github.com/umur957/hiring-cafe-job-scraper).
+
+Hiring Cafe is a browser-backed extractor that queries Hiring Cafe search APIs and maps results into the orchestrator `CreateJobInput` shape.
+
+Implementation split:
+
+1. `extractors/hiringcafe/src/main.ts` builds search state, calls Hiring Cafe APIs, and writes dataset JSON.
+2. `orchestrator/src/server/services/hiring-cafe.ts` runs the extractor, streams progress events, and maps rows for pipeline import.
+
+## Why it exists
+
+Hiring Cafe adds another non-credentialed source that can be enabled from the existing source picker, without adding new settings UI.
+
+It also supports term-by-term search and country-aware search state using the same pipeline knobs you already set for automatic runs.
+
+## How to use it
+
+1. Open **Run jobs** and choose **Automatic**.
+2. **Hiring Cafe** is enabled by default in **Sources** (toggle it off if you do not want it for this run).
+3. Set your existing automatic run knobs:
+   - `searchTerms` drive per-term Hiring Cafe `searchQuery`.
+   - selected country maps into Hiring Cafe location search state.
+   - run budget path (`jobspyResultsWanted`) is reused as the max jobs-per-term cap.
+4. Start the run and watch progress in the pipeline progress card.
+
+Defaults and constraints:
+
+- No new Hiring Cafe settings fields were added.
+- `worldwide` and `usa/ca` run in broad mode without a strict country location filter.
+- Hiring Cafe is enabled by default in source selection.
+- `HIRING_CAFE_DATE_FETCHED_PAST_N_DAYS` controls recency window when running extractor directly (default `7`).
+
+Local run example:
+
+```bash
+HIRING_CAFE_SEARCH_TERMS='["backend engineer"]' \
+HIRING_CAFE_COUNTRY='united kingdom' \
+HIRING_CAFE_MAX_JOBS_PER_TERM='50' \
+npm --workspace hiringcafe-extractor run start
+```
+
+## Common problems
+
+### Hiring Cafe returns 429 / Vercel security checkpoint
+
+- The extractor first attempts Camoufox-backed Firefox and falls back to vanilla Firefox startup if Camoufox is unstable locally.
+- If upstream blocks continue, retry later or reduce run concurrency at the pipeline level by selecting fewer sources.
+
+### Hiring Cafe does not appear in sources
+
+- Check that client is running on latest build containing the new source list.
+- Hiring Cafe is source-only and does not require credentials, so it should appear once the new build is loaded.
+
+### Results are lower than expected
+
+- Cap is tied to automatic run budget path (`jobspyResultsWanted`) and search term count.
+- Country mapping can narrow results when a strict country location is applied.
+
+## Related pages
+
+- [Extractors Overview](/docs/next/extractors/overview)
+- [Pipeline Run](/docs/next/features/pipeline-run)
+- [Settings](/docs/next/features/settings)

docs-site/docs/extractors/jobspy.md

@@ -7,6 +7,11 @@ sidebar_position: 3
 
 A walkthrough of the JobSpy extractor for Indeed, LinkedIn, and Glassdoor.
 
+Original websites:
+- [indeed.com](https://www.indeed.com)
+- [linkedin.com/jobs](https://www.linkedin.com/jobs)
+- [glassdoor.com](https://www.glassdoor.com)
+
 ## Big picture
 
 JobSpy runs as a Python script per search term, writes JSON, then orchestrator ingests and normalizes into internal job shape.

docs-site/docs/extractors/overview.md

@@ -14,6 +14,7 @@ This page helps you choose the right extractor for your run, understand key cons
 | [Gradcracker](/docs/next/extractors/gradcracker) | UK graduate roles from Gradcracker | Crawling stability depends on page structure and anti-bot behavior; tuned for low concurrency | `GRADCRACKER_SEARCH_TERMS`, `GRADCRACKER_MAX_JOBS_PER_TERM`, `JOBOPS_SKIP_APPLY_FOR_EXISTING` | Scrapes listing metadata, then detail pages and apply URL resolution |
 | [JobSpy](/docs/next/extractors/jobspy) | Multi-source discovery (Indeed, LinkedIn, Glassdoor) | Requires Python wrapper execution per term; source availability and quality vary by site/location | `JOBSPY_SITES`, `JOBSPY_SEARCH_TERMS`, `JOBSPY_RESULTS_WANTED`, `JOBSPY_HOURS_OLD`, `JOBSPY_LINKEDIN_FETCH_DESCRIPTION` | Produces JSON per term, then orchestrator normalizes and de-duplicates by `jobUrl` |
 | [Adzuna](/docs/next/extractors/adzuna) | API-based multi-country discovery with low scraping overhead | Requires valid App ID/App Key; country must be in Adzuna-supported list | `ADZUNA_APP_ID`, `ADZUNA_APP_KEY`, `ADZUNA_MAX_JOBS_PER_TERM` | API pagination to dataset output; orchestrator maps progress and de-duplicates by `sourceJobId`/`jobUrl` |
+| [Hiring Cafe](/docs/next/extractors/hiring-cafe) | Browser-backed discovery using Hiring Cafe search APIs | Subject to upstream anti-bot checks; uses browser context and encoded search-state payloads | `HIRING_CAFE_SEARCH_TERMS`, `HIRING_CAFE_COUNTRY`, `HIRING_CAFE_MAX_JOBS_PER_TERM`, `HIRING_CAFE_DATE_FETCHED_PAST_N_DAYS` | Uses existing pipeline term/country/budget knobs and maps directly to normalized jobs |
 | [UKVisaJobs](/docs/next/extractors/ukvisajobs) | UK visa sponsorship-focused roles | Requires authenticated session and periodic token/cookie refresh | `UKVISAJOBS_EMAIL`, `UKVISAJOBS_PASSWORD`, `UKVISAJOBS_MAX_JOBS`, `UKVISAJOBS_SEARCH_KEYWORD` | API pagination + dataset output; orchestrator de-dupes and may fetch missing descriptions |
 | [Manual Import](/docs/next/extractors/manual) | One-off jobs not covered by scrapers | Inference quality depends on model/provider and input quality; some URLs cannot be fetched reliably | App/API endpoints (`/api/manual-jobs/infer`, `/api/manual-jobs/import`) | Accepts text/HTML/URL, runs inference, then saves and scores job after review |
 
@@ -21,6 +22,7 @@ This page helps you choose the right extractor for your run, understand key cons
 
 - Use **JobSpy** for broad first-pass sourcing across common boards.
 - Use **Adzuna** when you want API-first discovery in supported non-UK markets.
+- Use **Hiring Cafe** when you want another term/country-driven source without adding credentials.
 - Use **Gradcracker** when targeting graduate pipelines in the UK.
 - Use **UKVisaJobs** for sponsorship-specific UK searches.
 - Use **Manual Import** when you already have a specific posting and need direct import.
@@ -32,5 +34,6 @@ Many runs combine sources: broad discovery first, then manual import for high-pr
 - [Gradcracker](/docs/next/extractors/gradcracker)
 - [JobSpy](/docs/next/extractors/jobspy)
 - [Adzuna](/docs/next/extractors/adzuna)
+- [Hiring Cafe](/docs/next/extractors/hiring-cafe)
 - [UKVisaJobs](/docs/next/extractors/ukvisajobs)
 - [Manual Import](/docs/next/extractors/manual)

docs-site/docs/extractors/ukvisajobs.md

@@ -7,6 +7,8 @@ sidebar_position: 5
 
 UKVisaJobs is the most complex extractor because authenticated sessions are required.
 
+Original website: [my.ukvisajobs.com](https://my.ukvisajobs.com)
+
 ## Big picture
 
 Two layers:

docs-site/sidebars.ts

@@ -45,6 +45,7 @@ const sidebars: SidebarsConfig = {
         "extractors/gradcracker",
         "extractors/jobspy",
         "extractors/adzuna",
+        "extractors/hiring-cafe",
         "extractors/manual",
         "extractors/ukvisajobs",
       ],