Software Engineer - Kernels
MatX
About the role
What MatX Is Building
MatX is on a mission to be the compute platform for AGI. We are developing vertically integrated full-stack solutions from silicon to systems including hardware and software to train and run the largest ML workloads for AGI. We primarily use the Rust programming language.
What You'll Do Here
Design and optimize kernels that interface directly with our hardware
Work in partnership with our ML Research and Hardware Engineering teams
Provide expertise and guidance on hardware architecture from a programmer's perspective, ensuring seamless integration with the software stack
Who You Are
Bachelor of Computer Science or equivalent degree
10+ years of software development experience
Experience optimizing software for specialized hardware, employing techniques such as parallelism, SIMD programming, C, assembly-level optimization, or GPU/CUDA programming
Language: at least one of assembly, C++, C, Zig, or Rust
This is a hybrid role that will require you to work from our Mountain View, CA office 3 days a week on Tuesday through Thursday
Bonus Points If You Have
Experience implementing kernels for ML models such as Transformers
Experience using and implementing distributed parallelism techniques such as AllReduce, AllToAll, data parallelism, tensor parallelism.
Familiarity with how compilers work
Compensation
The US base salary for this full-time position is determined based on a variety of factors including role, experience, location, job-related skills, and relevant education and training. Career length is only a guideline for compensation.
Early Career - $160,000 - $275,000 + equity
Mid Career - $175,000 - $400,000 + equity
Senior Career - $250,000 - $600,000 + equity
What We Offer
Time off: 4 weeks PTO (accrued) + 12 company Holidays + up to 3 weeks remote work
Health: Company-subsidized Medical (Kaiser or Anthem) for employees & dependents, Guardian Dental and Vision insurances for employee & dependents, and life insurance (employee only), plus HSA and FSA offerings via Lively.
Financial Security: Choose from Roth or pre-tax 401K (or both) with a 5% company contribution (even if you don't contribute), 100% company-paid life insurance (up to $300K), long-term disability and travel insurance.
Professional Development: $1500 per year Professional Development Budget
Team Meals: MatX provides onsite team lunch & dinner Monday - Friday, with your choice of ordering via WeBox, Specialty’s or via our reimbursement system
Commute on Us: We pay 100% for your daily commute. Commute via our company rideshare account, reimburse public transportation, or get a Fasttrak card (or all three)
MatX E[x]tras: $50/mo to use on the perk you value most
Cell & Internet Reimbursement: $35/mo for cellular and $40/mo for wifi
Remote Home Setup: Use our Amazon business account for up to $1000 in office setup purchases.
Mental Wellbeing: 100% paid mental health benefit via SpringHealth and Guardian EAP.
Support to Parents: Up to 12 weeks paid parental leave regardless of path to parenthood, 10 weeks pregnancy disability leave, flexible return-to-work hours, and a $6K Family Fund to cover fertility, surrogacy, adoption, menopausal health, preservation, family counseling and more.
As part of our dedication to the diversity of our team and our focus on creating an inviting and inclusive work experience, MatX is committed to a policy of Equal Employment Opportunity and will not discriminate against an applicant or employee on the basis of race, color, religion, creed, national origin or ancestry, sex, gender, gender identity, gender expression, sexual orientation, age, physical or mental disability, medical condition, marital/domestic partner status, military and veteran status, genetic information or any other legally recognized protected basis under federal, state or local laws, regulations or ordinances.
---------
This position requires access to information that is subject to U.S. export controls. This offer of employment is contingent upon the applicant's capacity to perform job functions in compliance with U.S. export control laws without obtaining a license from U.S. export control authorities.
--------
MatX does not accept unsolicited resumes from individual recruiters or third-party recruiting agencies in response to job postings. No fee will be paid to third parties who submit unsolicited candidates directly to our hiring managers or People team and any resumes submitted are deemed to be the property of MatX.
Responsibilities
- Design and optimize kernels that interface directly with MatX hardware
- Partner with ML Research and Hardware Engineering teams
- Advise on hardware architecture from a programmer's perspective to support software integration
Qualifications
- Bachelor's degree in Computer Science or equivalent
- 10+ years of software development experience
- Experience optimizing software for specialized hardware using techniques such as parallelism, SIMD, C, assembly-level optimization, or GPU/CUDA programming
- Experience with at least one of assembly, C++, C, Zig, or Rust
- Bonus: Experience implementing kernels for ML models such as Transformers
- Bonus: Experience with distributed parallelism techniques such as AllReduce, AllToAll, data parallelism, or tensor parallelism
- Bonus: Familiarity with compilers
Benefits
- Four weeks of accrued PTO, 12 company holidays, and up to three weeks of remote work
- Company-subsidized medical, dental, and vision insurance, plus life insurance and HSA/FSA options
- 401(k) with a 5% company contribution, long-term disability, and travel insurance
- $1,500 annual professional development budget
- Onsite team lunch and dinner Monday through Friday
- Daily commute costs covered
- Monthly perks, cell, and internet reimbursements
- Up to $1,000 for remote office setup
- Paid mental health benefits
- Paid parental leave and a $6,000 family fund
Skills mentioned
About MatX
MatX designs hardware tailored for the world’s best AI models: We dedicate every transistor to maximizing performance for large models. For these models, we deliver 10× more computing power, enabling AI labs to make models an order of magnitude smarter and more useful. Our hardware would make it possible to train GPT-4 and run ChatGPT, but on the budget of a small startup. A world with more widely available intelligence is a happier and more prosperous world—picture people of all socioeconomic levels having access to an AI staff of specialist MDs, tutors, coaches, advisors, and assistants.
H-1B sponsorship history
Historical employer filing data was found for MatX. The employer record includes 12 historical certified applications. This is employer-level history, not a guarantee that this role currently offers sponsorship.