Skip to content

Backend / Platform Engineer, AI Analytic Engines

ThirdlawRemote

First seen Jun 4, 2025 · open 534 days · posted onceNo pay listed

HirQ verdict

37/100 · Weak. Based on age, reposts, pay, the company's hiring and ghost signals.

High ghost risk
True age
534 days
Reposts
Posted once

See the evidence behind this score.

Pro shows each part of the score, the reasons, the pay percentile and the listing history.

HirQ's ghost-risk estimate and company labels are automated opinions based on what we observe on employers' public job boards: how long a listing has been open, whether it was re-listed, wording in the description, and how often roles on that board close. They are not statements about an employer's intent, and a high-risk listing can still be a real opening. Figures are as of the date shown. How we measure

At a glance

Pay
No pay listed
Level
Mid level
Experience
5+ years
Type
FullTime
Team
Engineering
Work setup
Remote

“Remote”

Thirdlaw hiring

Company page
FrozenHiring43· WeakSoftware & SaaS
Open roles
4
New in 30 days
0
Closed in 30 days
0
Hiring trend, 13 weeksPro
Follow-through: ••%Pro

About the role

From Thirdlaw's careers page, checked Nov 21

ABOUT THE COMPANY

ThirdLaw is building the control layer for AI in the enterprise. As companies rush to adopt LLMs and AI agents, they face new safety, compliance, and operational risks that traditional observability tools were never designed to detect. Metrics like latency or cost don’t capture when a model makes a bad decision, leaks sensitive data, or behaves unpredictably.

We help IT and Security teams answer the foundational question: "Is this OK?"—and take real-time action when it’s not.

Backed by top-tier venture firms and trusted by forward-looking enterprise design partners, we’re building the infrastructure to monitor, evaluate, and control AI behavior in real-world environments—at runtime, where it matters. If you're excited to build systems that help AI work as intended—and stop it when it doesn’t—we’d love to meet you.

ABOUT THE ROLE

You won’t just be piping logs or tuning models—you’ll build and scale systems that reconcile latency, correctness, and observability across distributed pipelines. You’ll be designing the nervous system of a new class of software—where AI Agents reason, act, and fail in unpredictable ways. If you're excited by AI and want to shape its safe deployment—not just watch from the sidelines—this is your opportunity.

WHAT YOU’LL DO

  • Architect scalable, low-latency services for running evaluations in real-time and batch, integrating with streaming data pipelines and trace-based event models.
  • Design and build the core evaluation engine within ThirdLaw that applies heuristics, semantic models, and foundation model calls to detect violations across LLM inputs and outputs.
  • Build a runtime intervention layer to determine and execute appropriate enforcement actions—such as block, redact, notify, escalate—based on evaluation results and risk context.
  • Create reusable frameworks for pluggable evaluators and intervention policies, supporting no-code authoring and automated deployment pipelines.
  • Configure and operationalize a vector database pipeline for RAG-like use cases.
  • Build for scale. Mitigate blocking gRPC threads, implement micro-batching & streaming for LLM/embedding calls and add reliability controls such as queue-based back-pressure and graceful degradation paths.

WHO WE ARE LOOKING FOR

REQUIRED

  • 5+ years of Backend software engineering experience, including designing and shipping production software services
  • Strong coding proficiency in Python and/or Go
  • Deep experience with streaming data pipelines (e.g. Kafka, Pulsar, Redis Streams) and batch processing systems
  • Proven track record scaling high-QPS, low-latency services (p95/p99 ownership a plus).
  • Familiarity with vector databases (e.g. FAISS, Weaviate, Qdrant, pgvector) and embedding-based matching
  • Strong grasp of cloud-native infrastructure: containers, Kubernetes, serverless functions, CI/CD pipelines
  • Exposure to structured observability patterns, including OpenTelemetry (or similar tracing standards)
  • Comfortable designing—then defending—trade-offs around build vs buy vs OSS.

NICE-TO-HAVE

  • Experience with modern Python APIs & concurrency, e.g. gRPC, FastAPI, asyncio, multithreading/processes
  • Familiarity with ClickHouse, Apache Arrow, or fast analytical storage engines
  • Prior work on agent frameworks (e.g. LangChain, CrewAI, AutoGen) or LLM orchestration
  • Experience in trust & safety, compliance, or AI safety domains
  • Hands-on experience with secure enterprise integrations (authorization/authentication, webhooks, SIEM, IAM)

Why Apply?

Our team is small and focused, valuing autonomy and real impact over titles and management. We need strong technical skills, a proactive mindset, and clear written communication, as much of our work is asynchronous. If you're organized, take initiative, and want to work closely with customers to shape our products, you'll fit in well here.

Finally, we pay market cash compensation and generally above-market equity. The compensation package for this role is benchmarked using Carta Total Compensation and reflects real-time market data for our company’s size, this role’s level, and your geographic location. We have well-designed and generous benefits.

https://www.thirdlaw.io/

Skills mentioned

  • LLMs
  • Observability
  • Python
  • gRPC
  • Go
  • FastAPI
  • Redis
  • Kafka
  • ClickHouse
  • Kubernetes
  • CI/CD
  • Serverless
  • LangChain
  • RAG
  • SIEM
  • IAM
Apply on Thirdlaw's siteOpens Thirdlaw's own application page.

Similar jobs

Same role or field, nearby or remote, ranked by HirQ score.

More at Thirdlaw

All roles

Keep exploring

Backend / Platform Engineer, AI Analytic Engines

No pay listed · HirQ 37

Apply