Job description
We’re looking for someone who loves open-source and collaborating with the OSS community but also has deep understanding in how transformers and Unsloth works.
_MUST COMPLETE CHALLENGES BEFORE APPLYING: _https://x.com/danielhanchen/status/1891194528931209644
Must have:
- Deep knowledge and implementation experience with multi-GPU training techniques such as FSDP
- Important contributions to ML open-source projects (e.g., transformers, TRL, kernels, Unsloth) with reviewable code.
- Heavy experience working with ML frameworks like Unsloth, Transformers, TRL, and PyTorch.
- Familiarity with inference engines such as vLLM
- Familiarity with low-level languages and kernels like Triton
- Understanding of cloud services such as GCP or AWS (bonus).
Can be initially remote, with the ability to work in-person in San Francisco later.