Skip to content

Member of Technical Staff (Index, Search Crawler)

PerplexityLondon

First seen Nov 17 · open 3 days · reposted 9×No pay listed

HirQ verdict

57/100 · Fair. Based on age, reposts, pay, the company's hiring and ghost signals.

Medium ghost risk
True age
3 days
Reposts
Reposted 9×

See the evidence behind this score.

Pro shows each part of the score, the reasons, the pay percentile and the listing history.

HirQ's ghost-risk estimate and company labels are automated opinions based on what we observe on employers' public job boards: how long a listing has been open, whether it was re-listed, wording in the description, and how often roles on that board close. They are not statements about an employer's intent, and a high-risk listing can still be a real opening. Figures are as of the date shown. How we measure

At a glance

Pay
No pay listed
Level
Lead
Experience
5+ years
Type
FullTime
Team
Search
Work setup
On-site

Perplexity hiring

Company page
Actively hiringHiring59· FairAI & Machine Learning
Open roles
151
New in 30 days
50
Closed in 30 days
27
Hiring trend, 13 weeksPro
Follow-through: ••%Pro

About the role

From Perplexity's careers page, checked Nov 21

AI answers are only as trustworthy as the information behind them. Perplexity grounds its answers in fresh, real-world sources, and the index is what makes that possible. We're looking for an engineer to work on the indexing and data processing layer of Perplexity's Search Crawler. You'll build systems that ingest, process, and organize large volumes of crawled content into efficient, queryable structures, working primarily on offline and nearline pipelines that keep data fresh, complete, and accessible to downstream retrieval. Throughput, scalability, and correctness are critical across datasets that change continuously.

Responsibilities

  • Design, implement, and operate large-scale indexing systems and data pipelines at the core of Perplexity's search infrastructure.
  • Develop and optimize indexing strategies that balance performance, freshness, and resource efficiency.
  • Work on storage formats, compaction, and update mechanisms that keep data accessible and current.
  • Keep pipelines reliable and predictable under high-throughput conditions.
  • Build well-tested components with clear responsibilities and interface contracts that stay flexible as the system evolves.
  • Define and implement observability across offline and near line pipelines, including structured logs, metrics, and data quality signals.
  • Monitor throughput, resource usage, and cost, and drive optimisations as business needs change.
  • Partner with retrieval, ranking, and ML teams to make sure indexing outputs meet their requirements.
  • Enable safe experimentation on indexing strategies and processing logic through controlled rollouts and clearly defined quality signals.

Qualifications

  • 5+ years of experience building production backend or data infrastructure systems.
  • Strong programming experience in Go, C++, or Rust.
  • Experience with high-throughput data processing systems and very large datasets.
  • Experience building or operating databases, storage systems, data planes, or indexing pipelines.
  • Strong understanding of distributed systems, fault tolerance, consistency, and scalability.
  • Experience running production systems and handling operational incidents.
  • A systems-thinking mindset and the ability to reason about end-to-end data flows.

Skills mentioned

  • Go
  • Rust
  • C++
  • Distributed Systems
  • Observability
  • Machine Learning
  • A/B Testing
  • Contract Management
Apply on Perplexity's siteOpens Perplexity's own application page.

Similar jobs

Same role or field, nearby or remote, ranked by HirQ score.

More at Perplexity

All roles

Keep exploring

Member of Technical Staff (Index, Search Crawler)

No pay listed · HirQ 57

Apply