- Red Hat (Raleigh, NC)
- …for enterprises to build, optimize, and scale LLM deployments. We are seeking an experienced Senior ML Ops engineer to work closely with our product and research ... mission to bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates...teams to scale SOTA deep learning products and software . As an ML Ops engineer , you… more
- Red Hat (Raleigh, NC)
- …serve models, and deliver innovative apps. The OpenShift AI team seeks a Software Engineer with Kubernetes and Model Inference Runtimes experience to join ... Contribute directly to upstream inference runtime communities such as vLLM (https://github.com/ vllm -project/ vllm ) , TGI (https://github.com/huggingface/text-generation-inference)… more
- Red Hat (Raleigh, NC)
- …open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings ... to GenAI deployments. As leading developers, maintainers of the vLLM (http://github.com/ vllm -project/) project, and inventors of state-of-the-art techniques… more