NVIDIA GTC 2023 Trip Report

Conor Hoekstra · March 24, 2023

This will be a short “trip report” on the talks I watched over the week of the virtual GTC 2023 (March 20 - 24). All talks are freely available online. You can read my GTC trip report from 2022 here.

Summary

Speaker(s) Talk
Huang 🌟⭐GTC 2023 Keynote with NVIDIA CEO Jensen Huang image
Jones ⭐ How to Write a CUDA Program
Buck Advances in Accelerated Computing for AI & Scientific Computing
Jones ⭐ CUDA: New Features and Beyond (2023)
Huang & Suskever ⭐ Fireside Chat with Ilya Sutskever and Jensen Huang: AI Today and Vision of the Future
Lelbach C++ Standard Parallelism


  Meaning
🌟 Keynote
Best talks
image Available on YouTube

GTC Keynote

Speaker: Jensen Huang, CEO of NVIDIA

image

How to Write a CUDA Program

Speaker: Stephen Jones

This was a great talk, especially if you are new to CUDA. It walks you through a building a simple CUDA program in steps:

  1. Downloading CUDA and the CUDA toolkit
  2. Writing a “hello world” GPU kernel
  3. Determining the number of blocks and threads for your kernel (image below)
    • When in doubt, use a block size of 256
    • Corollary: avoid block sizes smaller than 128 if you can
  4. Using NVIDIA Nsight Systems for profiling and analysis

image

⭐ CUDA: New Features and Beyond (2023)

Speaker: Stephen Jones

This is a summary of the latest and greatest things in CUDA and the CUDA ecosystem. Highlights include:

  • Overview of cuNumeric and Legate
  • Overview of CUTLASS 3.0 and CuTe
  • Overview of NVIDIA GPU Computing Tools

and much more!

image

C++ Standard Parallelism

Speaker: Bryce Adelstein Lelbach

This talk is largely the same as Bryce’s GTC 2022 with the same name. However, it has been updated, as shown by the slide below. ⬇️

image

Hope to See You Next Year!

This was my fourth virtual GTC I have “attended” since joining NVIDIA back in 2019. I’ve got my fingers crossed that in 2024 we will be able to attend in person and I can meet some of you there!

Twitter, Facebook