Skip to content

Staff Software Engineer, Ray Data

AnyscaleSan Francisco, CA

First seen Sep 9 · open 72 days · posted once$240k–$270k/yr

HirQ verdict

64/100 · Fair. Based on age, reposts, pay, the company's hiring and ghost signals.

Low ghost risk
True age
72 days
Reposts
Posted once

See the evidence behind this score.

Pro shows each part of the score, the reasons, the pay percentile and the listing history.

HirQ's ghost-risk estimate and company labels are automated opinions based on what we observe on employers' public job boards: how long a listing has been open, whether it was re-listed, wording in the description, and how often roles on that board close. They are not statements about an employer's intent, and a high-risk listing can still be a real opening. Figures are as of the date shown. How we measure

At a glance

Pay
$240k–$270k/yr
Level
Lead
Experience
6+ years
Type
FullTime
Team
Engineering
Work setup
On-site

Pay vs market

Employer-posted ranges for Software Engineering roles in CA in the last 12 months (6,470 postings).

$174k
25th pct/yr
$210k
Median/yr
$253k
75th pct/yr
$140k · 10th90th · $300k

This job: $240k–$270k/yr

Where this pay sits: ••th percentilePro

Anyscale hiring

Company page
Actively hiringHiring60· FairAI & Machine Learning
Open roles
24
New in 30 days
5
Closed in 30 days
2
Hiring trend, 13 weeksPro
Follow-through: ••%Pro

About the role

From Anyscale's careers page, checked Nov 21

About Anyscale

At Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/, Uber https://www.uber.com/blog/horovod-ray/, Spotify https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/, Instacart https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB, Cruise https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200 with $250+ million raised to date.

About Ray Data Team

Ray Data https://docs.ray.io/en/latest/data/data.html is a Python-native data processing engine and a one-stop shop for all AI data processing needs. Ray Data provides performant, first-class integration with cutting-edge AI frameworks using both multimodal and structured data.

The Ray Data team develops and maintains Ray Data https://docs.ray.io/en/latest/data/data.html, building the underlying distributed data processing infrastructure that powers modern AI workloads. We are a team of engineers passionate about solving challenging problems in distributed systems, data processing, and performance at scale. We are looking for exceptional engineers to build, optimize, and scale Ray Data for increasingly complex AI workloads, including multimodal data processing and large-scale batch inference.

Learn more about how Ray Data enables scalable multimodal AI workloads in Architecting Multimodal Data Pipelines That Scale with Ray https://www.anyscale.com/blog/architecting-multimodal-data-pipelines-that-scale-with-ray.

As part of this role, you will

  • Design, build, and improve the core systems that power Ray Data https://docs.ray.io/en/latest/data/data.html, with a focus on performance, scalability, and reliability.
  • Design and optimize distributed execution across different stages of data pipelines in heterogeneous environments.
  • Build data loading and processing solutions for production training and inference workloads.
  • Solve challenging problems in distributed execution, scheduling, resource management, data partitioning, fault tolerance, and performance optimization.
  • Make system-level architectural decisions and reason through tradeoffs in areas such as resource allocation, execution models, batch vs. streaming workloads, and consistency and availability.
  • Work with customers and new-age AI-native companies to understand and solve challenges in scaling their AI workloads.

We'd love to hear from you if you have

  • 6+ years of experience building production-grade software, infrastructure, or developer-facing systems, with strong Python engineering experience.
  • 6+ years of experience personally owning core architectural decisions within a distributed data or compute engine, rather than primarily operating or using a platform someone else designed.
  • Deep experience with distributed systems internals, such as scheduling, fault tolerance, data partitioning, distributed execution, performance optimization, or database and query engine internals.
  • A track record of reasoning through system-level tradeoffs and defending architectural decisions, such as batch vs. streaming, static vs. dynamic resource allocation, or consistency vs. availability.
  • Passion for solving the unsolved problems in large-scale AI infrastructure and building systems that enable the next generation of AI applications.

WHY ANYSCALE

  • We're on a mission to make scalable computing effortless. Ray is the AI Compute Engine at the center of some of the world's most powerful AI platforms
  • Our tech is in production at companies like OpenAI, Uber, Spotify, Instacart, and Cruise
  • We're backed by Andreessen Horowitz, NEA, and Addition, with $250M+ raised to date
  • Recent partnerships with Azure, CoreWeave, and Google Cloud are putting AI-native compute directly into enterprise environments
  • Competitive salary and equity, plus health/dental/vision coverage (many plans up to 99% employer-covered)
  • We offer flexible time off, paid parental leave, and mental health support

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.

Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing

Skills mentioned

  • Distributed Systems
  • Python
  • Machine Learning
  • GCP
  • Azure
  • Spanish
Apply on Anyscale's siteOpens Anyscale's own application page.

Similar jobs

Same role or field, nearby or remote, ranked by HirQ score.

COMSEC Manager

AndurilSanta Ana, California, United States

$147k–$196k/yr1d ago85· Excellent

More at Anyscale

All roles

Keep exploring

Staff Software Engineer, Ray Data

$240k–$270k/yr · HirQ 64

Apply