Job details

Senior Machine Learning Quality Engineer - job 1 of 2

Company Description

At ServiceNow, our technology makes the world work for everyone, and our people make it possible. We move fast because the world can’t wait, and we innovate in ways no one else can for our customers and communities. By joining ServiceNow, you are part of an ambitious team of change makers who have a restless curiosity and a drive for ingenuity. We know that your best work happens when you live your best life and share your unique talents, so we do everything we can to make that possible. We dream big together, supporting each other to make our individual and collective dreams come true. The future is ours, and it starts with you.

With more than 7,700+ customers, we serve approximately 85% of the Fortune 500®, and we're proud to be one of FORTUNE 100 Best Companies to Work For® and World's Most Admired Companies™.

Learn more on Life at Now blog and hear from our employees about their experiences working at ServiceNow.

Unsure if you meet all the qualifications of a job description but are deeply excited about the role? We still encourage you to apply! At ServiceNow, we are committed to creating an inclusive environment where all voices are heard, valued, and respected. We welcome all candidates, including individuals from non-traditional, varied backgrounds, that might not come from a typical path connected to this role. We believe skills and experience are transferrable, and the desire to dream big makes for great candidates.

Job Description

What you get in this role:

You will be working with the Applied AI Science & Quality Assurance engineering team. We help build out our Machine learning models and AI functions. Design and review test automation frameworks for machine learning models

Work with ML engineers to make sure that functional & non-functional requirements are addressed
Establish and improve metrics collection and reporting
Establish test effectiveness and efficiencies throughout the team
Incorporate research of industry trends and apply best practices in quality engineering practices used in
evolving machine learning techniques
Work in a team oriented environment and work with technical and non-technical team members equally
well
Create test plans, test cases and other testing artifacts
Maintain existing automation test frameworks
Collect and report quality metrics from test execution
Work with developers to design specific testing strategies for features being developed and automate them
Create comprehensive test plans; execute and automate them
Enable engineering organizations in troubleshooting or addressing issues with applications and dev/test environments

Qualifications

To be successful in this role you have:

Bachelors or Masters in Computer Science or related subjects with 5 to 8 years of work experience
Strong test automation skills in Java / Python
Hands-on experience testing large-scale, production systems in Python or Java
Excellent communication, collaboration, reporting, analytical and problem-solving skills
Ability to take a project from scoping the requirements and building the test cases
Familiarity with AI/ML modeling approaches such as supervised and unsupervised techniques
Familiarity with testing AI/ML models and evaluation of the model quality
Ability to analyze results from the test set and create defects based on result patterns
5 to 8 years Experience in quality assurance and/or application development
Knowledge of machine learning techniques, data structures, algorithms, statistics
Expertise in developing automation pipelines & frameworks for verification of machine learning models
Experience in collecting and maintaining data according to test plans / cases.
Experience setting up automated test systems using continuous build environments (e.g. Jenkins) and ML
Content management systems to build full stack testing workflows
Experience in designing scalable and maintainable automated testing solutions for large-scale ML systems
Experience in an agile environment and in standard software testing methodology, e.g. integration testing, code reviews, design documentation

For positions in the Bay Area, we offer a base pay of $137,000 - $233,000, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs (subject to eligibility requirements). Compensation is based on the geographic location in which the role is located, and is subject to change based on work location.

Additional Information

ServiceNow is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status or any other category protected by law.

At ServiceNow, we lead with flexibility and trust in our distributed world of work. Click here to learn about our work personas: flexible, remote and required-in-office.

If you require a reasonable accommodation to complete any part of the application process, or are limited in the ability or unable to access or use this online application process and need an alternative method for applying, you may contact us at [email protected] for assistance.

For positions requiring access to technical data subject to export control regulations, including Export Administration Regulations (EAR), ServiceNow may have to obtain export licensing approval from the U.S. Government for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by the U.S. Government.

Please Note: Fraudulent job postings/job scams are increasingly common. Click here to learn what to watch out for and how to protect yourself. All genuine ServiceNow job postings can be found through the ServiceNow Careers site.

Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of, ServiceNow.

ServiceNow Glassdoor Company Review

4.5

ServiceNow DE&I Review

4.6

CEO of ServiceNow

Bill McDermott

Approve of CEO

Average salary estimate

$185000 / YEARLY (est.)

min

max

$137000K

$233000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

What You Should Know About Senior Machine Learning Quality Engineer, ServiceNow

As a Senior Machine Learning Quality Engineer at ServiceNow, you'll be stepping into an exciting role where you'll work closely with our Applied AI Science & Quality Assurance engineering team. Your mission will be to ensure that our machine learning models and AI functions are not just built but built right. With a blend of innovation and collaboration, you'll design and review automation frameworks for testing these models, making sure that both functional and non-functional requirements are met. This won't just be about deploying technology; you'll also be instrumental in establishing and enhancing metrics collection and reporting processes to boost team effectiveness. Your insights on industry trends will help elevate our quality engineering practices, adapting them to the evolving landscape of machine learning techniques. We pride ourselves on a team-oriented environment, so you'll frequently collaborate with both technical and non-technical team members to create comprehensive test plans, execute tests, and automate thorough evaluations. Your role will also involve troubleshooting issues in applications and development/testing environments, making you a critical player in our success. To thrive in this role, you should have a background in Computer Science or a related field and substantial experience in quality assurance and application development, particularly in a machine learning context. Join us at ServiceNow, where your abilities will be harnessed to create meaningful change and impact in our technology processes.

Frequently Asked Questions (FAQs) for Senior Machine Learning Quality Engineer Role at ServiceNow

What responsibilities does a Senior Machine Learning Quality Engineer at ServiceNow have?

A Senior Machine Learning Quality Engineer at ServiceNow focuses on designing and reviewing test automation frameworks for machine learning models, ensuring functional and non-functional requirements are met, establishing metrics collection processes, and improving test efficiencies. The role blends both technical acumen and collaboration, as you'll be working with various team members to create test plans and automate evaluations, making significant contributions to enhancing the quality of our AI functions.