IBM
Generative AI Engineering with LLMs Specialization
IBM

Generative AI Engineering with LLMs Specialization

Advance your ML career with Gen AI and LLMs. Master the essentials of Gen AI engineering and large language models (LLMs) in just 3 months.

Sina Nazeri
Fateme Akbari
Wojciech 'Victor' Fulmyk

Instructors: Sina Nazeri

7,958 already enrolled

Included with Coursera Plus

Get in-depth knowledge of a subject
4.5

(200 reviews)

Intermediate level

Recommended experience

3 months to complete
at 4 hours a week
Flexible schedule
Learn at your own pace
Get in-depth knowledge of a subject
4.5

(200 reviews)

Intermediate level

Recommended experience

3 months to complete
at 4 hours a week
Flexible schedule
Learn at your own pace

What you'll learn

  • In-demand, job-ready skills in gen AI, NLP apps, and large language models in just 3 months.

  • How to tokenize and load text data to train LLMs and deploy Skip-Gram, CBOW, Seq2Seq, RNN-based, and Transformer-based models with PyTorch

  • How to employ frameworks and pre-trained models such as LangChain and Llama for training, developing, fine-tuning, and deploying LLM applications.

  • How to implement a question-answering NLP system by preparing, developing, and deploying NLP applications using RAG.

Details to know

Shareable certificate

Add to your LinkedIn profile

Taught in English

See how employees at top companies are mastering in-demand skills

 logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

Advance your subject-matter expertise

  • Learn in-demand skills from university and industry experts
  • Master a subject or tool with hands-on projects
  • Develop a deep understanding of key concepts
  • Earn a career certificate from IBM

Specialization - 7 course series

What you'll learn

  • Differentiate between generative AI architectures and models, such as RNNs, transformers, VAEs, GANs, and diffusion models

  • Describe how LLMs, such as GPT, BERT, BART, and T5, are applied in natural language processing tasks

  • Implement tokenization to preprocess raw text using NLP libraries like NLTK, spaCy, BertTokenizer, and XLNetTokenizer

  • Create an NLP data loader in PyTorch that handles tokenization, numericalization, and padding for text datasets

Skills you'll gain

Category: Prompt Engineering
Category: Databases
Category: Data Storage
Category: Natural Language Processing
Category: Generative AI
Category: User Interface (UI)
Category: Data Processing
Category: Document Management
Category: Unstructured Data
Category: Data Storage Technologies
Category: Large Language Modeling

What you'll learn

  • Explain how one-hot encoding, bag-of-words, embeddings, and embedding bags transform text into numerical features for NLP models

  • Implement Word2Vec models using CBOW and Skip-gram architectures to generate contextual word embeddings

  • Develop and train neural network-based language models using statistical N-Grams and feedforward architectures

  • Build sequence-to-sequence models with encoder–decoder RNNs for tasks such as machine translation and sequence transformation

Skills you'll gain

Category: Artificial Intelligence and Machine Learning (AI/ML)
Category: Prompt Engineering
Category: Generative AI
Category: Natural Language Processing
Category: Generative AI Agents
Category: Large Language Modeling
Category: Artificial Intelligence
Category: Application Development

What you'll learn

  • Explain the role of attention mechanisms in transformer models for capturing contextual relationships in text

  • Describe the differences in language modeling approaches between decoder-based models like GPT and encoder-based models like BERT

  • Implement key components of transformer models, including positional encoding, attention mechanisms, and masking, using PyTorch

  • Apply transformer-based models for real-world NLP tasks, such as text classification and language translation, using PyTorch and Hugging Face tools

Skills you'll gain

Category: Prompt Engineering
Category: Natural Language Processing
Category: Performance Tuning
Category: Generative AI
Category: Large Language Modeling
Category: Reinforcement learning

What you'll learn

  • Sought-after, job-ready skills businesses need for working with transformer-based LLMs in generative AI engineering

  • How to perform parameter-efficient fine-tuning (PEFT) using methods like LoRA and QLoRA to optimize model training

  • How to use pretrained transformer models for language tasks and fine-tune them for specific downstream applications

  • How to load models, run inference, and train models using the Hugging Face and PyTorch frameworks

Skills you'll gain

Category: Prompt Engineering
Category: PyTorch (Machine Learning Library)
Category: Natural Language Processing
Category: Performance Tuning
Category: Application Frameworks
Category: Generative AI
Category: Applied Machine Learning
Category: Large Language Modeling

What you'll learn

  • In-demand generative AI engineering skills in fine-tuning LLMs that employers are actively seeking

  • Instruction tuning and reward modeling using Hugging Face, plus understanding LLMs as policies and applying RLHF techniques

  • Direct preference optimization (DPO) with partition function and Hugging Face, including how to define optimal solutions to DPO problems

  • Using proximal policy optimization (PPO) with Hugging Face to build scoring functions and tokenize datasets for fine-tuning

Skills you'll gain

Category: Deep Learning
Category: PyTorch (Machine Learning Library)
Category: Natural Language Processing
Category: Generative AI
Category: Text Mining
Category: Applied Machine Learning
Category: Large Language Modeling

What you'll learn

  • In-demand, job-ready skills businesses seek for building AI agents using RAG and LangChain in just 8 hours

  • How tapply the fundamentals of in-context learning and advanced prompt engineering timprove prompt design

  • Key LangChain concepts, including tools, components, chat models, chains, and agents

  • How tbuild AI applications by integrating RAG, PyTorch, Hugging Face, LLMs, and LangChain technologies

Skills you'll gain

Category: PyTorch (Machine Learning Library)
Category: Deep Learning
Category: Artificial Neural Networks
Category: Generative AI
Category: Natural Language Processing
Category: Machine Learning Methods
Category: Feature Engineering
Category: Text Mining
Category: Large Language Modeling

What you'll learn

  • Gain practical experience building your own real-world generative AI application to showcase in interviews

  • Create and configure a vector database to store document embeddings and develop a retriever to fetch relevant segments based on user queries

  • Set up a simple Gradio interface for user interaction and build a question-answering bot using LangChain and a large language model (LLM)

Skills you'll gain

Category: Artificial Intelligence and Machine Learning (AI/ML)
Category: PyTorch (Machine Learning Library)
Category: Jupyter
Category: Generative AI
Category: Natural Language Processing
Category: Data Processing
Category: Text Mining
Category: Large Language Modeling

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructors

Sina Nazeri
IBM
2 Courses32,961 learners
Fateme Akbari
IBM
4 Courses17,170 learners
Wojciech 'Victor' Fulmyk
IBM
6 Courses57,185 learners

Offered by

IBM

Why people choose Coursera for their career

Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."
Coursera Plus

Open new doors with Coursera Plus

Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Frequently asked questions