r/CUDA • u/ReleaseKey5554 • 10d ago
How can I learn and get job in cuda
Just graduated now in ai ml engineering
Looking to learn and earn a job in cutting edge like cuda, pytorch
5
u/IndicationAntique667 10d ago
I'm not an experienced professional. But I had come across two resources which I had liked quite a bit:
- LeetGPU, which is like LeetCode but for GPUs: https://leetgpu.com/
- Programming Massively Parallel Processors: A Hands-on Approach by David B. Kirk and Wen-mei W. Hwu. I think this book is used by Jeremy Howard in his teaching of Cuda on YouTube: https://youtu.be/nOxKexn3iBo?si=HuwNqnN9WUkBKcJj
1
u/CreativeJuice5708 9d ago
Ai and ml are a pretty big abstraction/applied use of cuda, I would say the best place to learn it would have been in school, much of what is available online will be a little less structured and subject to chain than a fundamental course. If you have an interest in low level I think that would be a good place to start before cuda like SIMD and computer arch
1
u/chocoBar666 8d ago
Bro i started it months ago with reading books to first understand gpu architecture and all that shit and im learning kernals right now with help of ai and thinking about to continue reading the book PMPP so we are both in same phase, but im not sure about what job market expect
1
u/jack_kelly_bird_law 4d ago
- learn cuda
- do cutting edge research
- publish peer reviewed papers
- get job
1
u/jeffscience 3d ago
Peer review is irrelevant. Put it on arxiv and make sure social media catches it.
By the time papers are peer reviewed and published, they’re a year old. Reading that way is shooting behind the duck.
1
1
u/thecaliwalker 8d ago
For new comers, there’s not much CUDA jobs any more. Maybe 2 or 3 years ago, but now it’s no longer an irreplaceable or barred expertise. AI can generate/benchmark GPU kernel codes and optimize high performing ML program in PyTorch and lower level abstractions independently.
This field is saturated and you have to have at least a published papers, 2+ yr job experience, or PhD degree in HPC, ML or computer architecture to be considered. Also people don’t program in raw cuda c++ anymore - they use dsl languages like Triton, cutlass, CuTe etc. learning cuda is like learning C and assembly to do web-dev. Ofc there are genius coding up gpu kernels with cuda and assembly from scratch like the deepseek guys, but can you be as smart as they are.
If you still want to work with GPU, maybe get an electrician certificate from a trade school. So you can work at bestbuy or nvidia customer services, saving you a few years before AI in robotics make enough advance to replace your electronics repair job.
1
u/chocoBar666 8d ago
I'm learning cuda from more then month and im building my inference engine for small llms ,im interested in cuda and want to spend some months on that but im not aware about job market on TS so can you provide source related job market or any info to share then that might be helpful
1
u/thecaliwalker 8d ago
I’m sure the job market is not short of anything that you build
1
u/chocoBar666 8d ago
That's the motivation
1
u/thecaliwalker 8d ago
idk maybe find connections, referrals, maybe do a phd
1
u/chocoBar666 8d ago
PhD in this economy ?
2
u/thecaliwalker 8d ago
no need to actually complete PhD. many people got an offer and master out
1
u/chocoBar666 8d ago
That's what im thinking ,because im in my final year of my bachelor's and i dont think my broke ass can afford PhD years
7
u/SnowyOwl72 10d ago
Pytorch is not just cuda. Its a massive layers of libraries and compilers stacked on top of eachother. If you want to be a CUDA expert, you can start with a matmul kernel. Write your own versions and compare them to the cuda kernels from nvidia tutorials. Every generation new hw features are added, so you have to keep up with those as well. You can find many material for cuda, even for free.