Hugging Face provides the Transformers library to load pretrained and to fine-tune different types of transformers-based models in an unique and easy way. This post gives a brief summary about its ...
Watsonx.ai Trial on the IBM Cloud
Watsonx.ai is IBM’s next generation enterprise studio for AI builders to train, validate, tune and deploy AI models including foundation models. This post describes briefly the available trial vers...
Python and PyTorch for AI Engineers
IT professionals who want to become AI engineers need to learn new technologies. This post summarizes the languages and frameworks that I’ve started to look into recently. As a developer I’ve lear...
Understanding In-Context Learning for LLMs
There are different ways to train and tune LLM models. This post summarizes some interesting findings from a research paper whether prompts can change the behavior of models. There are several opt...
Understanding Chain of Thought Prompting
This post describes the ‘Chain of Thought’ pattern for large language models. The technique is simple, but at the same time powerful to help AI models to understanding reasoning. Some of my previo...
Evaluating Question Answering Solutions
Retrieval Augmented Generation (RAG) solutions like Question Answering are not easy to evaluate. This post summarizes some options with their pros and cons. Question Answering solutions are more t...
Retrieval Augmented Generation with Chroma and LangChain
ChatGPT is more than just the GPT model. Similarly, the AI task Question Answering is also more than invoking just one model. This post describes a simple flow that leverages vector search via Chro...
Searching Documents related to Questions via Embeddings
In large language models embeddings are numerical representations of words, phrases, or sentences that capture their meaning and context. This post describes how to use embeddings to search and rer...
LoRA Fine-tuning without Code in Watsonx.ai
Watsonx.ai is IBM’s next generation enterprise studio for AI builders to train, validate, tune and deploy AI models. This post describes how to do LoRA-based fine-tuning with the Tuning Studio with...
Understanding the Watsonx.ai API
Watsonx.ai is IBM’s next generation enterprise studio for AI builders to train, validate, tune and deploy AI models. It comes with multiple Large Language Models which can be accessed via API. Via...