Program Content

  • 1

    Program Overview

  • 2

    Individual Project

    • Individual Project Proposal

    • Individual Project Deck
  • 3

    Assignment

    • 1.1. Assignment 1: Implementing FlashAttention & Its Variants from Scratch

    • 1.1.1. Assignment 1: Implementing FlashAttention & Its Variants from Scratch (Optional, Extra Credit) - Deadline: 11:59 PM PT, September 17

    • 1.2. Assignment 1 Tutorial: Triton & GPU programming

    • 1.3. Assignment 2: GRPO for Countdown Math Problems - Deadine: 12 Oct 11:59 PM (PT)
  • 4

    Week 1: Review attention, Transformer, and LLM pre-training

    • 1.1. Onboarding Handbook

    • 1.2. Slide Lecture 1

    • 1.3. Video Lecture 1

    • 1.4. Slide Lecture 2

    • 1.5 Video Lecture 2
  • 5

    Week 2: FlashAttention & Assignment 1

    • 1.1. Slide Lecture 3

    • 1.2. Video Lecture 3

    • 1.3. Video Lecture 4
  • 6

    Week 3: Post-training

    • 1.1. Video Lecture 5

    • 1.2. Slide Lecture 6

    • 1.3. Video Lecture 6

    • 1.4. Slide on AI Safety Issues and Evals

    • 1.5. Slide on AI Evaluation & Reasoning with RL
  • 7

    Week 4: Reasoning & Pre-training

    • 1.1. Video Lecture 7

    • 1.2. Slide Lecture 7

    • 1.3 Video Lecture 8
  • 8

    Week 5: Advanced FlashAttention

    • 1.1. Video Lecture 9

    • 1.2. Video Lecture 10
  • 9

    Week 6: Individual Project Presentation

    • Video Prensentation 1

    • Video Presentation 2

Ready to embark on an exciting journey with us

GStar Bootcamp - NTI Global Talent Program 2025

  • 00Days
  • 00Hours
  • 00Minutes
  • 00Seconds
Apply now