Test Engineer (Computer Vision)

Relocation | full time

Scylla

Job description

Scylla is looking for an Test Engineer (Computer vision) who will be testing and probing Scylla modules and solutions. The Test Engineer’s role is to apply adversarial testing scenarios to existing and new solutions in real-world or simulated environments, analyze the results, structure, deduct and highlight the limitations of each.

The candidate will gather and analyze data from existing POC and production installations, compare and combine them with the in-vitro testing results. Will apply existing analytical and problem-solving skills to help validate Scylla solutions through careful testing in order to maximize the benefit of business investments, define the limitations of systems and communicate those to the end client to avoid false hopes.

Responsibilities:

• Design and develop test automation frameworks for machine learning/computer vision models;
• The testing scenarios development to probe the capabilities of each module developed by Scylla aimed to derive the limits of the system (which will be used to verify that the system meets the client's needs);
• Solutions testing “from other side”, development of adversarial, counter-testing cases and subjecting the solutions to harsh, edge conditions;
• Establish and improve metrics collection and reporting;
• Establish test effectiveness and efficiencies throughout the team
• Incorporate research of industry trends and apply best practices in quality engineering practices used in evolving machine learning techniques
• Create test plans, test cases and other testing artifacts as necessary to ensure a systematic approach for guaranteeing the quality of our products and services
• Integrate new data into existing ML models to track performance improvements.
• Document and report status on manual and automated test cases for functional and non-functional requirements

Required Qualifications:

• 2+ years of experience in the mentioned field;
• Understanding of machine learning techniques, data structures, algorithms, statistics;
• Expertise in developing automation pipelines & frameworks for verification of machine learning models;
• Experience in scripting languages (ex. Python, bash/csh etc.)
• Experience in maintaining data according to test plans/cases.
• Experience setting up automated test systems using continuous build environments (e.g. Jenkins) and ML content management systems (e.g. Supervisely) to build full stack testing workflows
• Experience in designing scalable and maintainable automated testing solutions for large-scale ML systems
• Experience in an agile environment and in standard software testing methodology, e.g. integration testing, code reviews, design documentation - Proficiency in English

Benefits & Perks:

• Health Insurance;
• Company stock options;
• "Work From Home" Days;
• Team events and trainings for personal development
• Access to advisors including advisory board member at NASA Health Institute and serial founders to help us grow, personally and professionally

Contact info: 

lena@scylla.ai