- NVIDIA (Santa Clara, CA)
- …open-sourced inference frameworks. Seeking a Senior Deep Learning Algorithms Engineer to improve innovative generative AI models like LLMs, VLMs, multimodal and ... as large language models (LLM) and diffusion models for maximal inference efficiency using techniques ranging from quantization, speculative decoding, sparsity,… more
- Amazon (Seattle, WA)
- …The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on ... Labs team at AWS, is the backbone for accelerating deep learning and GenAI workloads on Amazon's Inferentia and Trainium ML accelerators. This comprehensive toolkit… more
- Amazon (Seattle, WA)
- …The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on ... Labs team at AWS, is the backbone for accelerating deep learning and GenAI workloads on Amazon's Inferentia and Trainium ML accelerators. This comprehensive toolkit… more
- Red Hat (Boston, MA)
- …closely with our product and research teams to scale SOTA deep learning products and software . As an ML Ops engineer , you will work closely with our technical ... open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings...AI for the enterprise and brings operational simplicity to GenAI deployments. As leading developers, maintainers of the vLLM… more
- NVIDIA (Santa Clara, CA)
- NVIDIA is now looking for AI Software Engineers for our GenAI Frameworks (Megatron Core (https://github.com/NVIDIA/Megatron-LM/tree/main/megatron/core) and NeMo ... and Multimodal (MM) foundation model pretraining and post-training. Our GenAI Frameworks provide end-to-end model training, including pretraining, alignment,… more
- Red Hat (Boston, MA)
- …Kubernetes ecosystem, including core concepts, custom APIs, operators, and the Gateway API inference extension for GenAI workloads (a plus). + Experience with ... open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings...AI for the enterprise and brings operational simplicity to GenAI deployments. As leading developers, maintainers of the vLLM… more
- Bank of America (Kennesaw, GA)
- Software Engineer III-AI/ML/ GenAI Addison, Texas;Charlotte, North Carolina; Kennesaw, Georgia; Newark, Delaware **To proceed with your application, you must ... must be at least 18 years of age.** Acknowledge (https://ghr.wd1.myworkdayjobs.com/Lateral-US/job/Addison/ Software - Engineer -III-AI-ML- GenAI \_25031110) **Job Description:** At Bank… more
- Red Hat (Raleigh, NC)
- …the power of open-source LLMs and vLLM to every enterprise. The Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to ... GenAI deployments. As leading contributors and maintainers of the...optimize, and scale LLM deployments. As a Machine Learning Engineer focused on vLLM, you will be at the… more
- Red Hat (Boston, MA)
- …bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to ... GenAI deployments. As leading developers, maintainers of the vLLM project, and inventors of state-of-the-art techniques for model quantization and sparsification, our… more
- NVIDIA (Santa Clara, CA)
- We are now looking for a Senior Deep Learning Software Engineer , LLM Performance! NVIDIA is seeking an experienced Deep Learning Engineer passionate about ... set of teams involving performance modeling, performance analysis, kernel development and inference software development. What you'll be doing: + Performance… more
- DataRobot (Boston, MA)
- …that makes sense for their business - today and in the future. As a Principal Software Engineer for Generative AI at DataRobot, you will be the technical anchor ... & Libraries, LLM Onboarding,Tools, Multi-Agent Evaluations, Multimodality, etc.) and GenAI systems (eg Inference optimization, Distributed Training, Finetuning,… more
- Google (Mountain View, CA)
- Senior Software Engineer , Backend and AI Systems, Flow _corporate_fare_ Google _place_ Mountain View, CA, USA; New York, NY, USA **Mid** Experience driving ... years of experience with ML infrastructure (eg, model deployment, inference , data processing, debugging). **Preferred qualifications:** + Master's degree...goes on and is growing every day. As a software engineer , you will work on a… more
- Amazon (Palo Alto, CA)
- …strong entrepreneurial spirit and bias for action. We are looking for a talented Software Engineer with a strong background in machine learning engineering to ... the future of advertising. Key job responsibilities As a Software Development Engineer in Machine Learning, you...inference systems. * Pioneer the development of LLM inference infrastructure to support next-generation GenAI workloads… more
- Amazon (New York, NY)
- …strong entrepreneurial spirit and bias for action. We are looking for a talented Software Engineer with a strong background in machine learning engineering to ... the future of advertising. Key job responsibilities As a Software Development Engineer in Machine Learning, you...inference systems. * Pioneer the development of LLM inference infrastructure to support next-generation GenAI workloads… more
- Meta (Menlo Park, CA)
- …space of GenAI /LLM scaling reliability and performance. **Required Skills:** Software Engineer , SystemML - Scaling / Performance Responsibilities: 1. ... role, you will be a member of the Network.AI Software team and part of the bigger DC networking...and innovations to leverage our large-scale GPU training and inference fleet through an observable, reliable and high-performance distributed… more
- Walmart (Sunnyvale, CA)
- …Prometheus) and distributed tracing for actionable insights. + Optimize LLM inference (prompt caching, quantization, retrieval filtering) and system throughput. + ... engineering playbooks. + Drive experimentation (A/B testing, multi-armed bandits, causal inference ) and champion innovation. + **Product Integration & Delivery** +… more
- Microsoft Corporation (Redmond, WA)
- …Groups to fine-tune LLMs and serve agentic workload for their own scenarios. As a Software Engineer II, you will work on the infrastructure and tools to support ... **Overview** The GenAI Infrastructure and Solutions team is building large-scale...large scale model fine-tuning, evaluation, and inference . Microsoft's mission is to empower every person and… more
- Zscaler (San Jose, CA)
- …and agility with a cloud-first strategy. We're looking for an experienced Sr. Staff Software Engineer to join our Digital Experience team. This role is hybrid ... building frameworks for all products + Evaluate and integrate state-of-the-art GenAI advances (eg, LLMs/SLMs, retrieval, fine-tuning, inference optimization) to… more
- Zscaler (San Jose, CA)
- …speed and agility with a cloud-first strategy. We're looking for an experienced Sr. Software Engineer to join our Digital Experience team. This role is hybrid ... countries. Bring your vision and passion to our team of cloud architects, software engineers, security experts, and more who are enabling organizations worldwide to… more
- Google (Sunnyvale, CA)
- Staff Software Engineer , AI Data, Multimodal _corporate_fare_ Google _place_ Sunnyvale, CA, USA **Advanced** Experience owning outcomes and decision making, ... be credible with customers and engineers. + Understanding of genAI model development workflows for post-training and product fine-tuning,...goes on and is growing every day. As a software engineer , you will work on a… more