Domů
Návrh Školení
Návrh Školení
Návrh Školení
Fine-Tuning Open-Source LLMs (LLaMA, Mistral, Qwen, etc.) Počítačový Kurz

Fine-Tuning Open-Source LLMs (LLaMA, Mistral, Qwen, etc.) Počítačový Kurz

Fine-tuning open-source LLMs is an emerging best practice for organizations that seek to customize AI capabilities in secure, cost-efficient, and private environments.

This instructor-led, live training (online or onsite) is aimed at intermediate-level ML practitioners and AI developers who wish to fine-tune and deploy open-weight models like LLaMA, Mistral, and Qwen for specific business or internal applications.

By the end of this training, participants will be able to:

Understand the ecosystem and differences between open-source LLMs.
Prepare datasets and fine-tuning configurations for models like LLaMA, Mistral, and Qwen.
Execute fine-tuning pipelines using Hugging Face Transformers and PEFT.
Evaluate, save, and deploy fine-tuned models in secure environments.

Format of the Course

Interactive lecture and discussion.
Lots of exercises and practice.
Hands-on implementation in a live-lab environment.

Course Customization Options

To request a customized training for this course, please contact us to arrange.

Thank you for sending your enquiry! One of our team members will contact you shortly.

Thank you for sending your booking! One of our team members will contact you shortly.

Návrh Školení

Introduction to Open-Source LLMs

What are open-weight models and why they're important
Overview of LLaMA, Mistral, Qwen, and other community models
Use cases for private, on-premise, or secure deployments

Environment Setup and Tools

Installing and configuring Transformers, Datasets, and PEFT libraries
Choosing appropriate hardware for fine-tuning
Loading pre-trained models from Hugging Face or other repositories

Data Preparation and Preprocessing

Dataset formats (instruction tuning, chat data, text-only)
Tokenization and sequence management
Creating custom datasets and data loaders

Fine-Tuning Techniques

Standard full fine-tuning vs. parameter-efficient methods
Applying LoRA and QLoRA for efficient fine-tuning
Using Trainer API for quick experimentation

Model Evaluation and Optimization

Assessing fine-tuned models with generation and accuracy metrics
Managing overfitting, generalization, and validation sets
Performance tuning tips and logging

Deployment and Private Use

Saving and loading models for inference
Deploying fine-tuned models in secure enterprise environments
On-premise vs. cloud deployment strategies

Case Studies and Use Cases

Examples of enterprise use of LLaMA, Mistral, and Qwen
Handling multilingual and domain-specific fine-tuning
Discussion: Trade-offs between open and closed models

Summary and Next Steps

Požadavky

An understanding of large language models (LLMs) and their architecture
Experience with Python and PyTorch
Basic familiarity with the Hugging Face ecosystem

Audience

ML practitioners
AI developers

14 hodiny

Počet účastníků

Online

Classroom

Select Location

Please select a Venue

Price per participant

Open Training Courses require 5+ participants.

Fine-Tuning Open-Source LLMs (LLaMA, Mistral, Qwen, etc.) Počítačový Kurz - Booking

Jméno a příjmení *

Partnerství a certifikace *

Telefon *

Job Title

Company Name

Address 1 *

City *

State / Province

Kontaktujte NobleProg *

Postcode *

Start Date

Tax ID

Dates are subject to availability and take place between 09:30 and 16:30.

Payment *

Bank Transfer (Invoice, PO)

Debit / Credit Card

Comments

Allow Publishing Certificate

If you check this box the participants will receive an option to publish their course certificate on the NobleProg Certified Professional Catalogue.

Pravidla a podmínky *

I am an authorised representative of the above named client and I wish to book the above courses or services in accordance with NobleProg Terms and Conditions and Privacy Policy.

Inform me about discounts and promotions

Please read our Privacy Policy to find out how we use your data

Fine-Tuning Open-Source LLMs (LLaMA, Mistral, Qwen, etc.) Počítačový Kurz - Enquiry

Jméno a příjmení *

Partnerství a certifikace *

Telefon *

Počet účastníků

Company Name

Company Address

How do you want to take the course?

Client Premises

Online

Učebna

Comments

Inform me about discounts and promotions

Please read our Privacy Policy to find out how we use your data

Fine-Tuning Open-Source LLMs (LLaMA, Mistral, Qwen, etc.) - Consultancy Enquiry

Consultancy Enquiry

Jméno a příjmení *

Telefon *

Partnerství a certifikace *

Company Name

Consultancy Subject *

Consultancy Goal

Consultancy Duration

Number of Consultants

Vhodné datum

Who will the consultant work with?

Advanced Techniques in Transfer Learning

14 hodiny

Toto živé školení vedené instruktorem v České republice (online nebo na místě) je zaměřeno na pokročilé odborníky na strojové učení, kteří si přejí osvojit si nejmodernější techniky učení s přenosem a aplikovat je na složité problémy reálného světa.