JobSpy

JobSpy 是一个职位抓取库，可通过一个工具汇总热门招聘网站上的职位：

• 并发抓取 LinkedIn、Indeed、Glassdoor、ZipRecruiter、Bayt、Naukri、BDJobs 和 HelloWork 上的职位信息
• 将职位信息汇总到数据框中
• 支持代理，以绕过屏蔽

安装

pip install -U python-jobspy

需要 Python 版本 >= 3.10

用法

from jobspy import scrape_jobs

jobs = scrape_jobs(
    site_name=["indeed", "linkedin", "zip_recruiter", "glassdoor"],  # also "bayt", "naukri", "bdjobs", "hellowork"
    search_term="software engineer",
    location="San Francisco, CA",
    results_wanted=20,
    hours_old=72,
    country_indeed="USA",
    # fetch_description=True,  # read each job's page on boards whose search results have no description (slower)
    # proxies=["user:pass@host:port", "localhost"],
)
print(f"Found {len(jobs)} jobs")
print(jobs.head())
jobs.to_csv("jobs.csv", index=False)

输出

SITE           TITLE                             COMPANY           LOCATION                JOB_TYPE  INTERVAL  MIN_AMOUNT  MAX_AMOUNT  JOB_URL                                            DESCRIPTION
indeed         Software Engineer                 AMERICAN SYSTEMS  Arlington, VA, USA      None      yearly    150000      200000      https://www.indeed.com/viewjob?jk=5e409e577046...  THIS POSITION COMES WITH A 10K SIGNING BONUS!...
indeed         Senior Software Engineer          TherapyNotes.com  Philadelphia, PA, USA   fulltime  yearly    110000      135000      https://www.indeed.com/viewjob?jk=da39574a40cb...  About Us TherapyNotes is the national leader i...
linkedin       Software Engineer - Early Career  Lockheed Martin   Sunnyvale, CA, USA      fulltime  yearly    None        None        https://www.linkedin.com/jobs/view/3693012711      Description:By bringing together people that u...
linkedin       Full-Stack Software Engineer      Rain              New York, NY, USA       fulltime  yearly    None        None        https://www.linkedin.com/jobs/view/3696158877      Rain’s mission is to create the fastest and ea...
zip_recruiter  Software Engineer - New Grad      ZipRecruiter      Santa Monica, CA, USA   fulltime  yearly    130000      150000      https://www.ziprecruiter.com/jobs/ziprecruiter...  We offer a hybrid work environment. Most US-ba...
zip_recruiter  Software Developer                TEKsystems        Phoenix, AZ, USA        fulltime  hourly    65          75          https://www.ziprecruiter.com/jobs/teksystems-0...  Top Skills' Details• 6 years of Java developme...

命令行

此软件包会安装一个 jobspy 命令，其选项与下方 scrape_jobs() 的参数一致；运行 jobspy -h 可查看选项、输出字段和退出代码。

uv tool install python-jobspy

jobspy "software engineer" --site indeed,linkedin --location Chicago -n 20
jobspy nurse --site indeed,linkedin --hours-old 24 -o jobs.jsonl
jobspy "data analyst" --remote --fields title,company,job_url

MCP 服务

mcp-jobspy 是一个通过 uvx mcp-jobspy@latest 运行的 MCP 服务。有关配置、工具和代理的信息，请参阅 mcp/README.md。

标准配置适用于大多数客户端：

{
  "mcpServers": {
    "jobspy": {
      "command": "uvx",
      "args": ["mcp-jobspy@latest"]
    }
  }
}

scrape_jobs() 的参数

Optional
├── site_name (list|str): 
|    linkedin, zip_recruiter, indeed, glassdoor, google, bayt, bdjobs, naukri, hellowork
|    (default is all)
│
├── search_term (str)
|
├── google_search_term (str)
|     search term for google jobs. This is the only param for filtering google jobs.
│
├── location (str)
│
├── distance (int): 
|    in miles, default 50
│
├── job_type (str): 
|    fulltime, parttime, contract, temporary, internship, perdiem, other, volunteer
│
├── proxies (list|str): 
|    in format ['user:pass@host:port', 'localhost'], or a single proxy as a string
|    each job board scraper will round robin through the proxies
|    socks proxies on LinkedIn, Indeed and BDJobs need pip install "requests[socks]"
|
├── is_remote (bool)
│
├── results_wanted (int): 
|    number of job results to retrieve for each site specified in 'site_name'
│
├── easy_apply (bool): 
|    filters for jobs that are hosted on the job board site
|
├── user_agent (str): 
|    override the default user agent which may be outdated
│
├── description_format (str): 
|    markdown, html, plain (Format type of the job descriptions. Default is markdown.)
│
├── offset (int): 
|    skips that many results (e.g. 25 skips the first 25 and starts from the 26th)
│
├── hours_old (int): 
|    filters jobs by the number of hours since the job was posted 
|    (Glassdoor filters by whole days, so it rounds up to the next day.)
│
├── verbose (int) {0, 1, 2}: 
|    Controls the verbosity of the runtime printouts 
|    (0 prints only errors, 1 is errors+warnings, 2 is all logs. Default is 1.)
│
├── fetch_description (bool): 
|    for boards whose search results don't include the job description: fetches each job's
|    page for the description and other details (e.g. job type). Without it these are empty
|    for those boards. Adds one request per job, so use proxies for larger searches
│
├── linkedin_fetch_description (bool): 
|    deprecated, use fetch_description (still works; removed in 2.0)
│
├── linkedin_company_ids (list[int]): 
|    searches for linkedin jobs with specific company ids
|
├── country_indeed (str): 
|    filters the country on Indeed & Glassdoor (default is usa; see below for the names)
|
├── enforce_annual_salary (bool): 
|    converts wages to annual salary
|
├── ca_cert (str)
|    path to CA Certificate file for proxies

支持职位搜索的国家/地区

LinkedIn

LinkedIn 支持全球搜索，且只使用 location 参数。

ZipRecruiter

ZipRecruiter 搜索美国/加拿大的职位，且只使用 location 参数。

Indeed / Glassdoor

Indeed 和 Glassdoor 支持大多数国家/地区，可通过 country_indeed 参数选择（默认值为 usa）。此外，可使用 location 参数缩小搜索范围，例如在需要时指定城市和州。

在 Indeed 上搜索时，可指定以下国家/地区（请使用准确名称，* 表示支持 Glassdoor）：

Argentina*	Australia*	Austria*	Bahrain
Belgium*	Brazil*	Canada*	Chile
China	Colombia	Costa Rica	Czech Republic
Denmark	Ecuador	Egypt	Finland
France*	Germany*	Greece	Hong Kong*
Hungary	India*	Indonesia	Ireland*
Israel	Italy*	Japan	Kuwait
Luxembourg	Malaysia*	Mexico*	Morocco
Netherlands*	New Zealand*	Nigeria	Norway
Oman	Pakistan	Panama	Peru
Philippines	Poland	Portugal	Qatar
Romania	Saudi Arabia	Singapore*	South Africa
South Korea	Spain*	Sweden	Switzerland*
Taiwan	Thailand	Turkey	Ukraine
United Arab Emirates	UK*	USA*	Uruguay
Venezuela	Vietnam*

Bayt

Bayt 会搜索所有国家/地区，除非 location 指定了其覆盖的地区，例如 "Dubai, UAE" 或 "Saudi Arabia"。

BDJobs

BDJobs 会搜索孟加拉国。location 可填写行政区或地区，例如 "Dhaka" 或 "Chattogram Division"。

Naukri

Naukri 会搜索印度。location 可填写城市，例如 "Pune"。

HelloWork

HelloWork 会搜索法国。location 可填写法国城市、邮政编码或地区，例如 "Lyon"。大多数职位信息使用法语发布，因此使用法语搜索词能找到更多结果。

备注

• 目前 Indeed 是最好的抓取工具，且没有速率限制。
• Indeed 的 date_posted 是职位添加到 Indeed 的日期，与 hours_old 筛选所依据的日期相同。
• 大多数招聘网站接口在单次搜索中最多返回约 1000 个职位。
• LinkedIn 会对突发请求进行速率限制，并返回 429；约一分钟后限制会解除。进行大规模搜索时请使用代理。
• Glassdoor 每秒请求超过约 2 次时会进行速率限制。

常见问题

问：如何区分被屏蔽的招聘网站和没有职位的招聘网站？
**答：**发生故障和忽略选项时会记录日志，结果的 attrs 也会包含相同消息，供代码读取：

jobs.attrs["errors"]    # {"linkedin": "response status code 429 (blocked: use a proxy)"}
jobs.attrs["warnings"]  # {"bdjobs": ["job_type internship isn't supported, ignoring it"]}

---

问：为什么 Indeed 会返回无关职位？
**答：**Indeed 也会搜索职位描述。

• 使用 - 排除词语
• 使用 "" 进行精确匹配

Indeed 搜索词示例

search_term='"engineering intern" software summer (java OR python OR c++) 2025 -tax -marketing'

此搜索会检索职位描述和标题，且必须包含 software、summer、2025、其中一种语言，以及精确匹配的 engineering intern，同时不得包含 tax 和 marketing。

---

问：使用 "google" 时没有结果？
**答：**Google Jobs 目前不可用。

---

问：收到响应代码 429？
**答：**招聘网站因请求过多而屏蔽了你。所有招聘网站都会积极屏蔽请求。我们建议：

• 每次抓取之间等待一段时间（因网站而异）。
• 尝试使用 proxies 参数更改 IP 地址。

---

JobPost 架构

JobPost
├── id
├── site
├── job_url
├── job_url_direct
├── title
├── company
├── location
├── date_posted
├── job_type: fulltime, parttime, internship, contract, temporary, ...
├── salary_source: direct_data, description (parsed from posting)
├── interval: yearly, monthly, weekly, daily, hourly
├── min_amount
├── max_amount
├── currency
├── is_remote
├── job_level
├── job_function
├── listing_type
├── emails
├── description
├── company_industry
├── company_url
├── company_logo
├── company_url_direct
├── company_addresses
├── company_num_employees
├── company_revenue
├── company_description
├── skills
├── experience_range
├── company_rating
├── company_reviews_count
├── vacancy_count
└── work_from_home_type

如果招聘网站未提供某一列，该列将为空。