Software Quality Engineer II

<p><img id="Picture_x0020_1" src="https://rmkcdn.successfactors.com/dd82a348/461743ac-ca78-42fa-8634-a.png" style="height:255.0px;width:600.0px"></p> <div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:16.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px"><b>Job Purpose</b></H2> </div><div><p>To design, engineer, and continuously improve quality practices for AI-driven conversational banking platforms by embedding automation, AI-aware validation, and observability across the full engineering lifecycle. This role is accountable for ensuring:</p> <ul type="disc"> <li>High-quality, reliable customer conversational experiences</li> <li>Robust and scalable API and integration-driven systems</li> <li>Accurate and consistent AI/NLP interpretation and response behaviour</li> </ul> <p>The SQE operates as a software engineer specialising in quality, contributing to system design, automation frameworks, CI/CD pipelines, and production quality insights to enable continuous delivery with confidence</p></div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:16.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px"><b>Job Responsibilities</b></H2> </div><div><p><strong>QE Strategy &amp; Lifecycle Ownership</strong></p> <ul type="disc"> <li>Contribute to execution of the QE strategy for conversational banking</li> <li>Embed quality across:</li> <ul type="circle"> <li>Design</li> <li>Development</li> <li>CI/CD pipelines</li> <li>Production</li> </ul> <li>Champion:</li> <ul type="circle"> <li>Shift-left practices (test design, testability)</li> <li>Shift-right practices (observability, production validation)</li> </ul> </ul> <p><strong>2. Automation Engineering </strong></p> <ul type="disc"> <li>Design and implement scalable, reusable automation frameworks</li> <li>Develop automation across:</li> <ul type="circle"> <li>APIs (primary focus)</li> <li>Integration layers</li> <li>Event-driven systems</li> </ul> <li>Ensure:</li> <ul type="circle"> <li>Test automation is integrated and executed in CI/CD pipelines</li> <li>High test reliability and maintainability</li> </ul> </ul> <p><strong>3. Conversational, NLP &amp; AI Testing </strong></p> <p>Design and implement validation for AI-driven behaviour, including:</p> <ul> <li><strong>Conversational Validation</strong> <ul> <li>Multi-turn conversations</li> <li>Context retention</li> <li>End-to-end journey flow</li> </ul> </li> </ul> <ul> <li><strong>NLP Validation</strong> <ul> <li>Intent recognition accuracy</li> <li>Entity extraction accuracy</li> <li>Confidence threshold validation</li> </ul> </li> </ul></div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:16.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px"><b>Job Responsibilities Continue</b></H2> </div><div><ul> <li><strong>LLM / AI Response Validation </strong></li> </ul> <ul> <li>Validate: <ul style="list-style-type:circle"> <li>Response correctness and relevance</li> <li>Consistency of responses</li> <li>Handling of ambiguous inputs</li> </ul> </li> <li>Test: <ul style="list-style-type:circle"> <li>Prompt behaviour (where applicable)</li> <li>Guardrails and fallback mechanisms</li> <li>Hallucination and incorrect responses</li> </ul> </li> <li><strong>Dataset Engineering</strong></li> <li>Build and maintain: <ul style="list-style-type:circle"> <li>NLP test datasets</li> <li>Conversation variations</li> <li>Edge cases (slang, multilingual inputs, typos)</li> </ul> </li> </ul> <p><strong>4. CI/CD &amp; Quality Engineering </strong></p> <ul type="disc"> <li>Own integration of automated tests into:</li> <ul type="circle"> <li>CI/CD pipelines (Azure DevOps / Jenkins)</li> </ul> <li>Implement:</li> <ul type="circle"> <li>Quality gates (coverage, pass rates, reliability)</li> </ul> <li>Ensure:</li> <ul type="circle"> <li>Continuous regression execution</li> <li>Fast feedback loops for developers</li> </ul> </ul> <p><strong>5. Observability &amp; Production Quality </strong></p> <ul type="disc"> <li>Monitor production conversational quality:</li> <ul type="circle"> <li>Conversation success rate</li> <li>Escalation rates</li> <li>Intent accuracy trends</li> <li>Latency</li> </ul> <li>Analyse telemetry to:</li> <ul type="circle"> <li>Identify defects and patterns</li> <li>Improve test coverage</li> <li>Feed insights into backlog</li> </ul> <li>Establish:</li> <ul type="circle"> <li>Production → Test feedback loops</li> </ul> </ul> <p><strong>6. Non-Functional &amp; Resilience Engineering</strong></p> <ul type="disc"> <li>Perform:</li> <ul type="circle"> <li>Performance testing for APIs and conversational services</li> <li>Load and latency validation</li> </ul> <li>Validate:</li> <ul type="circle"> <li>System resilience</li> <li>Failover and degradation behaviour</li> </ul> </ul> <p><strong>7. Collaboration &amp; Agile Engineering</strong></p> <ul type="disc"> <li>Work as part of cross-functional squads</li> <li>Contribute to:</li> <ul type="circle"> <li>Refinement</li> <li>Design sessions</li> <li>Sprint delivery</li> </ul> <li>Influence:</li> <ul type="circle"> <li>Testability</li> <li>Definition of Done (automation, quality gates)</li> </ul> </ul></div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:16.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px">Essential Qualifications - NQF Level</H2> </div><ul style="margin-top:0.0;margin-bottom:0.0"><li>Professional Qualifications/Honour’s Degree </li></ul></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:16.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px">Preferred Qualification</H2> </div><div><p>BSc IT or BComm IT or similar</p> </div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:16.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px">Preferred Certifications</H2> </div><div><p>ISTQB Agile Foundation. ISTQB Advanced certification (preferred). Bootcamp training in Agile &amp; DevOps.</p> </div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:16.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px">Minimum Experience Level</H2> </div><div><ul type="disc"> <li>5+ years in Quality Engineering / Software Engineering in Test</li> <li>Strong experience in:</li> <ul type="circle"> <li>API automation</li> <li>CI/CD pipeline integration</li> </ul> <li>Practical exposure to:</li> <ul type="circle"> <li>Conversational platforms / AI systems</li> </ul> </ul></div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:16.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px"><b>Technical / Professional Knowledge</b></H2> </div><ul style="margin-top:0.0;margin-bottom:0.0"><li>Object-orientated Programming (OOP) </li><li>Development languages; C#, Java </li><li>Mobile Test Automation </li><li>Soap and RESTFUL services </li><li>Use of testing tools and frameworks (E.g. Selenium, Appium, RestAssured, Karate, Jira, JMeter) </li><li>Service virtualisation &amp; Data virtualisation </li><li>Performance and load testing </li><li>Vulnerability testing </li></ul></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:16.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px">Behavioural Competencies</H2> </div><ul style="margin-top:0.0;margin-bottom:0.0"><li>Building Partnerships </li><li>Decision Making </li><li>Influencing </li><li>Driving for Results </li><li>Technical/Professional Knowledge and Skills </li><li>High-Impact Communication </li><li>Innovation </li></ul></div></div><p style="line-height:18.9px"><img alt="" height="228" src="https://rmkcdn.successfactors.com/dd82a348/61ad7a3f-eb85-4980-a04c-e.jpg" style="height:75.0px;width:600.0px" width="245"></p> <p style="line-height:18.9px">---------------------------------------------------------------------------------------</p> <p style="line-height:18.9px"><span style="color:#006341"><em><b>Please contact the Nedbank Recruiting Team at +27 860 555 566 </b></em></span></p>