Machine Learning Infrastructure Engineer
WindBorne Systems · On-site
This listing is no longer verified as available.
MeritLog keeps this source-backed description for reference. Availability is not verified, and there is no application link here.
Source: the employer's Ashby job board. Open the original listing for current details. Availability is not verified for this retained page.
Job details
- Work model
- On-site
- Salary
- Not listed by source
- Location
- RWC HQ
What the role asks for
What you'd do
- Research to Operations pipelines - Our models serve real-time forecasts to customers with strict latency requirements. You'd own uptime end-to-end: build health monitoring, improve logging, diagnose failures across nodes.
- Inference scaling & compute strategy - We have an on-prem cluster but also use cloud providers, especially for production deployments. You'd evaluate cost/performance tradeoffs across cloud options as we scale, and also help manage growing on-prem resources for compute and storage.
- Training infrastructure - Make distributed training runs reliable. They die from silent OOMs, network faults, and storage issues. Build monitoring, auto-recovery, and job scheduling so researchers can launch experiments with less need for babysitting them.
What they're asking for
- Have experience running production ML systems - you’re not just good at fighting fires but also know how to build systems that don’t catch on fireSkill
- Experience with large datasetsSkill
- Comfortable keeping up with fast-paced model releases and building reliable custom deployments for themSkill
- Experience with PyTorch, Docker, cursed memory management, compression and debugging network saturationSkill
- Affinity for systems and structure - you can counterbalance a research team’s natural state of chaos with well-organized infrastructure and clear processesSkill
- Experience with weather data, geospatial pipelines, or scientific computingSkillPreferred
- Experience with very large datasets, on the petabyte scaleSkillPreferred
- Experience managing GPU clusters or job schedulersSkillPreferred
Parsed by MeritLog from the employer’s own posting. The full description follows below.
Job description
WindBorne Systems is supercharging weather forecasts with a proprietary data source: a global constellation of next-generation smart weather balloons targeting critical atmospheric data. We design, manufacture, and operate our own balloons, using their observations to generate otherwise unattainable weather intelligence. Our mission is to eliminate weather uncertainty and help humanity adapt to climate change-whether by predicting hurricanes or speeding the adoption of renewables. The founding team of Stanford engineers was named Forbes 2019 30 Under 30 and is backed by top-tier investors, including Khosla Ventures and Footwork VC. WindBorne builds AI weather models that run 24/7, producing global forecasts every 20 minutes. Our research team is small and moves fast, but too much of their time goes to operationalization and infra firefighting instead of model development. We need someone to fix that. RESPONSIBILITIES WHAT YOU’D OWN: - Research to Operations pipelines - Our models serve real-time forecasts to customers with strict latency requirements. You'd own uptime end-to-end: build health monitoring, improve logging, diagnose failures across nodes. - Inference scaling & compute strategy - We have an on-prem cluster but also use cloud providers, especially for production deployments. You'd evaluate cost/performance tradeoffs across cloud options as we scale, and also help manage growing on-prem resources for compute and storage. - Data pipelines & upstream reliability - Weather data comes from dozens of sources https://windbornesystems.com/blog/weathermesh-5c-release-notes (satellites, government agencies, our own balloon observations) with varying schedules, incomplete documentation and sometimes failing or changing quality. You'd build pipelines for training and realtime data that gracefully handle upstream delays, do QC checks on data, and add logging and alerting for a zoo of edge cases. - Training infrastructure - Make distributed training runs reliable. They die from silent OOMs, network faults, and storage issues. Build monitoring, auto-recovery, and job scheduling so researchers can launch experiments with less need for babysitting them. SKILLS AND QUALIFICATIONS REQUIREMENTS - Have experience running production ML systems - you’re not just good at fighting fires but also know how to build systems that don’t catch on fire - Experience with large datasets - Comfortable keeping up with fast-paced model releases and building reliable custom deployments for them - Experience with PyTorch, Docker, cursed memory management, compression and debugging network saturation - Affinity for systems and structure - you can counterbalance a research team’s natural state of chaos with well-organized infrastructure and clear processes NICE TO HAVES - Experience with weather data, geospatial pipelines, or scientific computing - Experience with very large datasets, on the petabyte scale - Experience managing GPU clusters or job schedulers BENEFITS - 401(k) - Dental, health, and vision insurance - Unlimited PTO - Stock Option Plan - Office food and beverages SALARY - $140k–$240k. We consider a range of backgrounds and experience levels and adjust offers to be competitive with market rates. LOCATION 1600 Bridge Pkwy, Redwood City, CA. Hybrid or in-person.
Keep exploring
Available Data & Analytics roles
These current listings are available to explore now.