WA3517
Comprehensive Generative AI Engineering for Data Scientists and ML Engineers Training
This Comprehensive Generative AI (GenAI) course is for Machine Learning and Data Science professionals who want to dive deep into the world of GenAI and Large Language Models (LLMs). This course covers various topics, from the foundations of LLMs to advanced techniques like fine-tuning, domain adaptation, and evaluation. Participants gain hands-on experience with popular tools and frameworks, including Python, Hugging Face Transformers, and open-source LLMs.
Course Details
Duration
5 days
Prerequisites
- Practical experience (6+ months) minimum in Python - functions, loops, control flow
- Data Science basics - NumPy, pandas, scikit-learn
- Solid understanding of machine learning concepts and algorithms
- Regression, Classification, Unsupervised learning (clustering, Neural Networks)
- Strong foundations in probability, statistics, and linear algebra
- Practical experience with at least one deep learning framework (e.g., TensorFlow or PyTorch) recommended
- Familiarity with natural language processing (NLP) concepts and techniques, such as text preprocessing, word embeddings, and language models
Skills Gained
- Understand the architecture, training techniques, and evaluation methods for Large Language Models (LLMs)
- Fine-tune and adapt open-source LLMs for domain-specific tasks and applications
- Develop and optimize prompts for improved LLM performance and output quality
- Implement advanced techniques such as Retrieval Augmented Generation (RAG) and vector embeddings
- Evaluate and compare LLM performance using appropriate metrics and benchmarks
Course Outline
- LLM Foundations for ML and Data Science
- Overview of Generative AI and LLMs
- LLM Architecture and Training Techniques
- Deep dive into the transformer architecture and its components
- Exploring pre-training, fine-tuning, and transfer learning techniques
- Prompt Engineering for LLMs
- Introduction to Prompt Engineering
- Techniques for creating effective prompts
- Best practices for prompt design and optimization
- Developing prompts for various NLP tasks
- Text classification, sentiment analysis, named entity recognition
- Introduction to Prompt Engineering
- LLM Evaluation and Comparison
- Overview of metrics and benchmarks for evaluating LLM performance
- Techniques for comparing LLMs and selecting the best model for a given task
- Evaluating and comparing LLMs for a specific NLP task
- Fine-Tuning and Domain Adaptation
- Introduction to Open-Source LLMs
- Advantages and limitations in ML and data science projects
- Preparing domain-specific datasets for fine-tuning LLMs
- Techniques for adapting LLMs to new domains and tasks using transfer learning
- Fine-tuning and adapting an open-source LLM for a specific domain
- Introduction to Open-Source LLMs
- Advanced Fine-Tuning and RAG Techniques
- Advanced fine-tuning techniques for LLMs
- Implementing Retrieval Augmented Generation (RAG)
- Improving LLM output quality and relevance
- Building a RAG-powered LLM application for a specific use case
- Vector Embeddings and Semantic Search
- Introduction to vector embeddings and their applications in NLP
- Using vector embeddings for semantic search and recommendation systems
- Generating vector embeddings from text data
- Implementing a similarity search using libraries like Faiss or Annoy
- LLM Optimization and Efficiency
- Techniques for optimizing LLM performance
- Quantization and pruning
- Applying optimization techniques to reduce LLM model size and inference time
- Strategies for efficient deployment and serving of LLMs in production
- Techniques for optimizing LLM performance
- Ethical Considerations and Best Practices
- Addressing biases and fairness issues in LLMs
- Ensuring transparency and accountability in LLM-powered applications
- Best practices for responsible AI development and deployment
- Navigating privacy and security concerns when working with LLMs and sensitive data
