README | GPU Glossary (original) (raw)

██████╗ ██████╗ ██╗ ██╗ ██╔════╝ ██╔══██╗██║ ██║ ██║ ███╗██████╔╝██║ ██║ ██║ ██║██╔═══╝ ██║ ██║ ╚██████╔╝██║ ╚██████╔╝ ╚═════╝ ╚═╝ ╚═════╝ ██████╗ ██╗ ██████╗ ███████╗███████╗ █████╗ ██████╗ ██╗ ██╗ ██╔════╝ ██║ ██╔═══██╗██╔════╝██╔════╝██╔══██╗██╔══██╗╚██╗ ██╔╝ ██║ ███╗██║ ██║ ██║███████╗███████╗███████║██████╔╝ ╚████╔╝ ██║ ██║██║ ██║ ██║╚════██║╚════██║██╔══██║██╔══██╗ ╚██╔╝ ╚██████╔╝███████╗╚██████╔╝███████║███████║██║ ██║██║ ██║ ██║ ╚═════╝ ╚══════╝ ╚═════╝ ╚══════╝╚══════╝╚═╝ ╚═╝╚═╝ ╚═╝ ╚═╝

We wrote this glossary to solve a problem we ran into working with GPUs here atModal : the documentation is fragmented, making it difficult to connect concepts at different levels of the stack, likeStreaming Multiprocessor Architecture ,Compute Capability , andnvcc compiler flags .

So we've read thePDFs from NVIDIA , lurked in the good Discords , and even boughtdead-tree textbooks to put together a glossary that spans the whole stack in one place.

This glossary, unlike a PDF or a Discord or a book, is a hypertext document -- all pages are inter-linked with one another, so you can jump down to read about the Warp Scheduler so you can better understand the threads that you came across in the article on theCUDA programming model .

You can also read it linearly. To navigate between pages, use the arrow keys, the arrows at the bottom of each page, or the table of contents (in the sidebar on desktop or in the hamburger menu on mobile).

The source for the glossary is availableon GitHub .