Site Reliability Engineer

About Forward

Forward is a consulting firm that works exclusively with independent consultants to help startups build their engineering organizations.

‍

About the Work

Keywords: Ops, LLMs, Observability

Budget: $150-$200/hour

Hours per week: 20

Term: 3 months with possibility of extension

Geographic Constraints: None

Timezone Constraints: 5 hours overlap with ET

Start Date: Immediate

Company Stage: Series A

‍

Context

We’re working with a company that is streamlining the workflows of insurance companies using AI.

They need to add llm failover and improve availability and to get there they need observability on what is going over the wire to and from their llms.

The work would involve doing an analysis of the existing state of observability tooling in the llm space, building prototypes with a few tools, recommending a path forward, and implementation.

Prior experience with llm ops or observability tooling would be great to have but given this is all very new we’re also very open to working with a strong infrastructure engineer who’s comfortable jumping into this space.

‍

About You

Roughly in order of importance:

• You have ops experience
• You’re interested in LLMs
• You have consulting experience
• You have experience working at early stage (~Series A) companies
• You have 10+ years experience
• You have experience operating LLM-based applications

‍

How to Apply

Note: This is a syndicated job post, meaning it was not posted to Fractional Jobs directly, so we don't have control over the application process. To apply, click on the "View Application" and follow the application's instructions.