heidloff.net - Building is my Passion
Post
Cancel

OpenShift AI Platform based on Open Source

AI is evolving fast and lots of new frameworks come up frequently. The open-source project Open Data Hub (ODH) brings several of these modern frameworks together. Red Hat uses ODH as upstream project for its offering OpenShift AI.

From the OpenShift AI landing page:

Red Hat OpenShift AI is a flexible, scalable artificial intelligence and machine learning platform that enables enterprises to create and deliver AI-enabled applications at scale across hybrid cloud environments. Built using open source technologies, OpenShift AI provides trusted, operationally consistent capabilities for teams to experiment, serve models, and deliver innovative apps.

Details:

Workbench

To test, fine-tune and evaluate Large Language Models several technologies can be utilized. OpenShift AI provides multiple options to run these as containers.

image

Serving

For serving models various inference stacks are provided, for example Hugging Face Text Generation Inference and vLLM.

image

Next Steps

To learn more, check out the Watsonx.ai documentation and the Watsonx.ai landing page.

Featured Blog Posts
Disclaimer
The postings on this site are my own and don’t necessarily represent IBM’s positions, strategies or opinions.
Contents
Trending Tags