Automation Engineer
Blitzy · On-site
MeritLog read this listing from Blitzy's Ashby job board and last checked it on September 8, 2026.
Source: the employer's Ashby job board. Open the original listing for current details.
Job details
- Work model
- On-site
- Salary
- $120,000 – $145,000
- Location
- Cambridge, MA
- Company website
- socket.io
Hiring context
How this role compares at Blitzy
Blitzy has 33 live roles in MeritLog’s catalog across 6 job families, and 15 of them are in engineering. 1 of those listings publish a pay range, a disclosure rate of 3%.
Blitzy concentrates this hiring in:
Counted across the job boards MeritLog tracks, at the time this page was served. Pay comparisons use only listings that publish a complete range in the same currency and period.
What the role asks for
What you'd do
- Own the evolution and expansion of our automated testing frameworks for AI-generated code, increasing coverage and reliability.
- Drive and expand end-to-end and integration testing coverage across production environments.
- Drive runtime monitoring and quality assurance standards across multi-language deployments.
- Manage CI/CD pipeline integration for continuous quality validation.
- Collaborate cross-functionally with AI engineers to surface and resolve platform-level quality issues.
- You expand and maintain automated testing frameworks that validate the runtime behavior and performance of AI-generated applications.
- You develop intelligent test suites that automatically assess application functionality in production environments.
- You extend existing testing frameworks to increase coverage and validate runtime behavior across multiple languages and frameworks.
- You establish quality metrics and testing protocols that measure real-world performance of generated applications.
- You build systems to automatically detect and flag runtime issues in deployed applications.
- You collaborate with our AI team to improve the platform based on runtime performance data.
- You implement automated integration and end-to-end testing that ensures generated applications work as intended in production.
- You develop metrics and monitoring systems to track runtime performance across different customer deployments.
What they're asking for
- 3+ years of experience with Playwright and automated testing frameworks.Experience
- Strong expertise in Python (our primary automation language).Skill
- Experience with CI/CD tools (GitHub Actions or similar).Skill
- Proficiency in version control systems (Git).Skill
- Experience testing distributed systems.Skill
- Understanding of modern software development practices.Skill
- Experience working with cloud platforms (GCP preferred).SkillPreferred
- Experience with runtime monitoring and testing of distributed systems.Skill
- Knowledge of performance testing and APM (Application Performance Monitoring).Skill
- Experience with end-to-end testing of complex, enterprise-grade applications.Skill
- Understanding of distributed tracing and monitoring.Skill
- Experience with chaos engineering and resilience testing.Skill
Parsed by MeritLog from the employer’s own posting. The full description follows below.
Job description
Blitzy is a Cambridge, MA based AI software development platform on a mission to revolutionize the software development life cycle by autonomously building custom software to unlock the next industrial revolution. We're transforming how enterprises build software, turning enterprise requirements into enterprise grade code with an agentic software development platform that can autonomously execute 80% of the quantum of software development work. We're backed by multiple tier 1 investors, and have proven success as founders of previous start-ups. OUR CULTURE Who we are: Led by two pioneering co-founders we are one of the fastest growing companies in the U.S., creating our own category of enterprise autonomous software development. We automate thousands of hours of software development for our customers, which includes strong representation within the Fortune 500. How we work: - We move Blitzy Fast: Time is both our company’s and our clients’ most precious asset. We move quickly and decisively to innovate internally and deliver exceptional software externally. - Championship Mindset: We operate like a professional sports team. We win as a team by holding ourselves and each other to high standards, collaborating in-person, and remaining focused on the mission. - Passion for Invention: We’re pushing the frontier of what’s possible, requiring constant innovation and iteration. - We Work for the Customer: We focus on delivering outsized value to the customers we work with and expanding those relationships into deep, meaningful partnerships. - We believe in being ‘everyday athletes’: taking care of ourselves so we can bring our best minds to work. We promote great sleep, movement, and restorative activities for optimal mental performance. It makes for a happier and more productive team. ABOUT THE ROLE We are looking for a Senior Automation Engineer to own, extend, and scale our automated testing frameworks that validate the runtime behavior of code generated by our AI platform. This role is critical in ensuring that our platform’s output performs correctly in production environments. You’ll work at the intersection of AI and quality assurance, expanding test coverage and improving the testing solutions that validate AI-generated applications during actual execution. RESPONSIBILITIES - Own the evolution and expansion of our automated testing frameworks for AI-generated code, increasing coverage and reliability. - Drive and expand end-to-end and integration testing coverage across production environments. - Drive runtime monitoring and quality assurance standards across multi-language deployments. - Manage CI/CD pipeline integration for continuous quality validation. - Collaborate cross-functionally with AI engineers to surface and resolve platform-level quality issues. - You expand and maintain automated testing frameworks that validate the runtime behavior and performance of AI-generated applications. - You develop intelligent test suites that automatically assess application functionality in production environments. - You extend existing testing frameworks to increase coverage and validate runtime behavior across multiple languages and frameworks. - You establish quality metrics and testing protocols that measure real-world performance of generated applications. - You build systems to automatically detect and flag runtime issues in deployed applications. - You collaborate with our AI team to improve the platform based on runtime performance data. - You implement automated integration and end-to-end testing that ensures generated applications work as intended in production. - You develop metrics and monitoring systems to track runtime performance across different customer deployments. QUALIFICATIONS - 3+ years of experience with Playwright and automated testing frameworks. - Strong expertise in Python (our primary automation language). - Experience with CI/CD tools (GitHub Actions or similar). - Proficiency in version control systems (Git). - Experience testing distributed systems. - Understanding of modern software development practices. - Experience working with cloud platforms (GCP preferred). - Experience with runtime monitoring and testing of distributed systems. - Knowledge of performance testing and APM (Application Performance Monitoring). - Experience with end-to-end testing of complex, enterprise-grade applications. - Understanding of distributed tracing and monitoring. - Experience with chaos engineering and resilience testing. Salary Range: $120,000 - $145,000 + Bonus + Equity Blitzy is an equal opportunity employer committed to building a diverse and inclusive team. We believe different perspectives make us stronger. Base salary ranges are determined by country, role, level, experience, and skills. The range displayed on each job posting reflects Blitzy’s good faith determination of the minimum and maximum targets for new hire salaries across all US locations. Individual pay is determined by related factors, including job skills, experience, and relevant education or training, which may impact a final offer. Your Talent Partner can share more about the specific salary range during the hiring process.