With increased efforts and recognition of the benefits of test automation our test libraries are expanding.  At Rolls Royce we have come a long way in the last five years whereby Unit Tests are the norm and automation of our Integration and End-to-End Tests are planned and implemented as part of the user stories.

There are good and efficient techniques being used which are using a flavour of the recommendations in our ‘Test Framework’ but unfortunately some of our automated test validations are occurring too late in the test cycle and in some cases not making the best use of good practice or learning from experience.

How do we manage that? ….. hold that thought!

Also, in a bid to implement Continuous Delivery release pipelines, there is also a danger of let’s automate everything and test every single combination possible of a scenario

Because we can  … right?

Well the honest answer is we could find ourselves in a situation where testing is not only the bottleneck to accelerated continuous testing and product delivery but also poses a risk of costing more than the actual value returned.

There’s more food for thought…..

This presentation will guide you through some of the techniques applied and the tools we’ve developed to gain insights into our automated testing and CI/CT/CD orchestration costs and some of the mechanisms we’ve employed to improve what we do