SunnyvaleRecruiter Since 2001
the smart solution for Sunnyvale jobs

Member of Technical Staff, Research Engineer (Inference)

Company: Tbwa Chiat/Day Inc
Location: Palo Alto
Posted on: November 10, 2024

Job Description:

About the Role
Member of Technical Staff, Research Engineer (Inference)
As part of Inflection's commitment to deploying high-performance models for enterprise applications, our inference team ensures that these models run efficiently and effectively in real-world scenarios. Research engineers in this role focus on optimizing model inference processes, reducing latency, and improving throughput without compromising model performance, ensuring robust deployment in enterprise environments.
This is a good role for you if you:


  • Have experience with deploying and optimizing LLMs for inference, both in cloud and on-prem environments.
  • Are adept at using tools and frameworks for model optimization and acceleration, such as ONNX, TensorRT, or TVM.
  • Enjoy troubleshooting and solving complex problems related to model performance and scaling.
  • Have a deep understanding of the trade-offs involved in model inference, including hardware constraints and real-time processing requirements.
  • Are proficient with PyTorch and familiar with infrastructure management tools like Docker and Kubernetes for deploying inference pipelines.

    Employee Pay Disclosures
    At Inflection AI, we aim to attract and retain the best employees and compensate them in a way that appropriately and fairly values their individual contributions to the company. For this role, Inflection AI estimates a starting annual base salary will fall in the range of approximately $200,000 - $350,000. This estimate can vary based on the factors described above, so the actual starting annual base salary may be above or below this range.

    #J-18808-Ljbffr

Keywords: Tbwa Chiat/Day Inc, Sunnyvale , Member of Technical Staff, Research Engineer (Inference), Engineering , Palo Alto, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

Sunnyvale RSS job feeds