<- All Jobs
Software/Research Engineer
Meta is seeking an AI Research Engineer/Software Engineer to join our team. The ideal candidate will have experience working on maximizing performance of AI models. This role involves applying these skills to solve some of the most crucial and exciting problems that exist on the web.
The AI Applications Engineering team is dedicated to maximizing training and inference performance of Generative AI (GenAI) and Recommendation models on Meta's Training and Inference Accelerator (MTIA). We employ innovative optimization and data parallelization strategies to maximize training throughput for the next generations of GenAI and recommendation models. Additionally, we work cross-functionally with many partner teams to ensure end-to-end performance of large-scale pre-training and inference, enabling us to deliver the next generation of AI experiences more quickly to our users.Software/Research Engineer Responsibilities
Equal Employment Opportunity Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.
Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.
The AI Applications Engineering team is dedicated to maximizing training and inference performance of Generative AI (GenAI) and Recommendation models on Meta's Training and Inference Accelerator (MTIA). We employ innovative optimization and data parallelization strategies to maximize training throughput for the next generations of GenAI and recommendation models. Additionally, we work cross-functionally with many partner teams to ensure end-to-end performance of large-scale pre-training and inference, enabling us to deliver the next generation of AI experiences more quickly to our users.Software/Research Engineer Responsibilities
- Applying state-of-the-art optimization techniques to our latest large-scale AI workloads running on Meta鈥檚 fleet of accelerators
- Profiling, analyzing, debugging, and optimizing large-scale workloads on our next-generation training superclusters
- Work tightly with our customers to co-design models to maximize pre-training and inference efficiency
- Set direction and goals for the team related to project impact, capacity, and developer efficiency
- Collaborating cross-functionally with the compiler, framework, communication and firmware teams to capture performance bottlenecks
- Implement custom kernels to maximize model performance
- Lead large and complex technical efforts across many engineers and teams
- Bachelor鈥檚 degree in computer science or a related STEM field
- Experience programming AI accelerators (e.g. GPUs, custom silicon etc.) using AI frameworks such as PyTorch or similar
- Experience developing custom kernels and compiler infrastructure to improve performance using low-level programming models such as CUDA, OpenCL or similar
- Minimum 5 years of experience developing and optimizing performance in modern C/C++
- Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment
- Master鈥檚/PhD in computer science or related STEM field
- A proven track record of impactful contributions to pre-training of AI models at scale using GPUs/custom ASIC or similar (publications, relevant work experience, shipped products, patents etc)
- Experience with neural network training using ML frameworks such as PyTorch etc.
- Experience with distributed AI systems and communication protocols such as MPI or collective libraries such as NCCL etc.
- Experience or knowledge in one or more of LLMs and recommender systems.
Equal Employment Opportunity Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.
Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.