Overcoming complex technical challenges for a pharmaceutical application through a risk-based exploratory approach to testing
The client: A leader in digital patient engagement and data capture
Industry: Pharmaceutical
Technologies: Fiddler, Postman API testing
Ten10 services: Mobile testing
Summary
A project to develop a service on behalf of a big pharmaceutical company was progressing slowly and had encountered technical issues that appeared unsolvable. Ten10’s intervention resulted in the development of testing methodologies to fix the technical problems and to bind a geographically distributed team into an efficient unit, resulting in the delivery of the service, ready for user acceptance testing.
The project
The client was creating a support service on behalf of a global pharmaceutical company, aimed at patients diagnosed with chronic obstructive pulmonary disease or asthma, and who are using a particular inhaler. The service is designed to capture usage of the inhaler electronically so that patients can be reminded of the need to use the device, and so that medical professionals can monitor usage remotely in order to provide the right support at the right time.
At the point where Ten10 became involved, the project testing methodology and develop systems that would capture the data was two years old, progress had slowed, and the test strategy had become outdated. Ten10 was called in to develop a new testing methodology and help find faults.
Goals
The goals for Ten10’s intervention were clear. We needed to use our long-proven testing tools and techniques to resolve the issues around a lack ofend-to-end testing, fix the problem of the unreliable activation, and work to strict deadlines in order to launch the service in the three countries consecutively. In addition, we planned to run regression tests on all areas of the product in order to ensure that each change had not introduced new bugs, all the while communicating the required fixes and processes to both the client and the outsourced developers.
Challenges
The challenges being faced by the client were varied. Apart from a new project manager being appointed four weeks into testing, which had an impact as he got up to speed, the system was being rolled out in three countries. One of those three countries was France, where it is mandatory for personal medical data to remain inside the country, and for security procedures more stringent than just username and password to be adopted; in this case, twofactor authentication in the form of a one time password texted to the user was adopted.
In addition, the scripts initially being used to test the service did not stress all elements of the system, namely the inhaler, the mobile application and the portal, and activation of the system had long been unreliable, for reasons that the client had not been able to uncover. Product development was also being hampered by being split between in house and outsourced development teams.
Consequently, the pharmaceutical company had been unable to take delivery of a functional, demonstrable service, to market to potential buyers.
Success story
The client’s service encompassed a number of technological disciplines. Components include Bluetooth for initial connectivity, a database back end, a portal, the application itself and connectivity between the components.
Using a holistic, risk-based, exploratory approach that embraced a range of technologies, such as traffic interception tools and regression testing with every aspect of the service in use, Ten10 was able to discover where subsystems were failing, speed up the project, and enhance communication across a number of teams. By testing every aspect of the system both individually and together, logging the connections, and communicating failures and other issues to the client’s project manager, Ten10 also uncovered defects not found by the previous test team.
Not only did our testing enable a successful delivery of the service to the end client, it gave confidence to the pharmaceutical company that its service could be demonstrated successfully to its customers and therefore gain market traction. So successful was this approach that the client engaged Ten10 on another project.
To download the case study PDF please click here