<section style="margin-bottom: 20px;">
 <h2 style="color: #34495e; font-size: 1.2em; margin: 20px 0 10px 0;">Job Title</h2>
 <p style="line-height: 1.6; margin-bottom: 15px;">Anyscale is seeking a Distributed LLM Inference Engineer in San Francisco, California. This pivotal role involves pushing the boundaries of performance for ML inference at scale. You'll work closely with product teams to deliver end-to-end solutions while leveraging open-source technologies and contributing to community projects.</p>
</section>
<section style="margin-bottom: 20px;">
 <h2 style="color: #34495e; font-size: 1.2em; margin: 20px 0 10px 0;">Qualifications</h2>
 <p style="line-height: 1.6; margin-bottom: 15px;">Candidates should have a solid understanding of distributed systems and familiarity with deep learning frameworks, ideally with experience in PyTorch and Ray.</p>
</section>
<section style="margin-bottom: 20px;">
 <h2 style="color: #34495e; font-size: 1.2em; margin: 20px 0 10px 0;">Benefits</h2>
 <p style="line-height: 1.6; margin-bottom: 15px;">Anyscale offers competitive compensation and extensive benefits, including:</p>
 <ul style="padding-left: 20px; margin: 10px 0;">
 <li style="margin: 10px 0; line-height: 1.6;">healthcare coverage</li>
 <li style="margin: 10px 0; line-height: 1.6;">stock options</li>
 </ul>
</section>

Distributed LLM Inference Engineer - Scale AI at Speed

Job Description

Job Title

Qualifications

Benefits

Required Skills