Aller au contenu
Toutes les missions
Veille marché · Dev-to Publiée il y a 5 jours

New jobs from any company's Workday career site, every morning, in Python

A large share of big employers, from banks and insurers to pharma, hospitals and universities, post their openings on a Workday career site: the company.wd3.myworkdayjobs.com/... pages behin...

Entreprise ching ten banks
Mode Remote

Résumé

A large share of big employers, from banks and insurers to pharma, hospitals and universities, post their openings on a Workday career site: the company.wd3.myworkdayjobs.com/... pages behind many "Careers" links. Each one has a public job search, but there is no feed across them and no "what's new since yesterday" view. A recruiter watching ten banks, a job board adding employer postings, or an analyst tracking where a company hires ends up opening the same pages every day. This post pulls those jobs into Python, filters them by country, remote and title, and sets up a daily feed of only the new postings. Disclosure: I'm Aurelix, and I built the Workday Job Postings Scraper. It's a paid tool (prices below). What each row holds One row per job, with the details read from the job's own page: job_id (stable, for joins and dedupe), company, company_token (the Workday tenant and site, e.g. td/TD_Bank_Careers), title. locations (every location the job lists), countries as ISO codes, provinces as Canadian province codes, and is_canada. remote, workplace_type where the site publishes it, employment_type normalised (FULL_TIME, PART_TIME...) and employment_type_raw as the site words it. posted_at (Workday's posting start date, YYYY-MM-DD). apply_url, source_url, description_text and description_html. Jobs from a few employers, as a sheet pip install apify-client import csv import os from apify_client import ApifyClient client = ApifyClient(os.environ["APIFY_TOKEN"]) run = client.actor("aurelix/workday-jobs-scraper").call( run_input={ "sites": ["https://nvidia.wd5.myworkdayjobs.com/NVIDIAExternalCareerSite"], "companies": ["Wells Fargo", "Pfizer"], "countries": ["US", "CA"], "titleKeywords": ["engineer", "analyst"], "maxJobsPerSite": 50, } ) jobs = list(client.dataset(run["defaultDatasetId"]).iterate_items()) fields = ["company", "title", "locations", "countries", "remote", "employment_type", "posted_at", "apply_url"] with open("workday_jobs.csv", "w", newline="", encoding="utf-8") as f: w = csv.DictWriter(f, fieldnames=fields, extrasaction="ignore") w.writeheader() for j in jobs: w.writerow({**j, "locations": "; ".join(j["locations"]), "countries": " ".join(j["countries"])}) sites takes career-site links exactly as you see them in the browser. companies looks names up in a bundled list of 141 verified Workday employers (banks, pharma, tech, hospitals, universities); case and punctuation are ignored. For any other company, paste its career-site link. starterList adds a curated list: canada for 15 Canadian-headquartered employers, all for all 27. titleKeywords are sent to Workday's own search, and the job title is then checked for the word, so engineer also finds "Engineering" titles. Use whole words. Where an employer is hiring Turn descriptions off for small rows and count: from collections import Counter run = client.actor("aurelix/workday-jobs-scraper").call( run_input={"companies": ["Pfizer", "Novartis", "Sanofi"], "includeDescription": False, "maxJobsPerSite": 100} ) rows = list(client.dataset(run["defaultDatasetId"]).iterate_items()) by_country = Counter((r["company"], c) for r in rows for c in r["countries"]) for (company, country), n in by_country.most_common(15): print(f"{company:20} {country} {n}") print(Counter(r["workplace_type"] for r in rows)) Rerun it on a schedule and save each run's counts to compare hiring over time. Only new postings, every morning run_input = { "companies": ["TD Bank", "BMO", "CIBC"], "canadaOnly": True, "titleKeywords": ["analyst", "manager"], "maxJobsPerSite": 50, "incremental": True, "stateKey": "banks-canada", "slackWebhookUrl": "https://hooks.slack.com/services/...", } With incremental on, the first run returns every matching job. Each later run with the same stateKey returns only jobs not returned before; job IDs are remembered for 60 days after they were last seen. Save the input as a task in the Apify Console and schedule it daily: the Slack URL gets the count and the top 10 new jobs with links, and nothing is sent on a quiet day. webhookUrl posts the same digest as JSON to Zapier, Make or n8n. provinces lets you route each Canadian job to the right regional recruiter. One table with other job boards Rows have the same 27 fields as our Greenhouse Jobs Scraper, which reads Greenhouse, Lever, Ashby and SmartRecruiters boards, so the two datasets append into one sheet with no remapping. The ats column says which system each job came from and job_id stays unique. Why this tool Any Workday career site by link, or 141 verified employers by name. Canada only, countries, remote only and title keywords, with Canadian province codes on every row. An only-new mode with a Slack or webhook digest, so a daily schedule pays only for new postings. No proxy needed, so there is no proxy cost. What it doesn't cover: salary. Workday's public job pages have no structured pay field; where an employer states pay, it is in the description text. Limits At most 30 career sites per run, links, names and starter list together; split longer lists across runs. 2,000 jobs per search. Workday returns at most that per site query; on very large sites use countries, Canada only or title keywords, each keyword being its own search. A date, not a time. posted_at is a date, and department, team and the salary fields are always empty. Sites whose robots.txt disallows their career pages are skipped, and the run's status message names them. Cost $1.50 per 1,000 jobs ($1.05 on paid Apify plans), plus a $0.009 start fee per run. Jobs dropped by your filters or already returned in only-new mode are not charged, and neither are sites that could not be read. The current prices are on the Store page; Apify's free plan includes $5 of credit a month, about 3,300 jobs. Links Workday Job Postings Scraper on the Apify Store Example repo