Case Studies

Performance Testing for a Fortune 50 Bank

Fri, 06 Apr 2012 17:31:00 GMT

Maintaining financial data integrity and software quality are paramount concerns for any major financial institution. This is especially true when the firm in question is a Fortune 50 Bank, and the system involved manages a multi-billion dollar mortgage asset portfolio. Staying current on valuation requires 24 x 7 asset calculations on multiple sets of thousands of mortgages, including a check of the overall value of the portfolio which is accomplished every night. To meet these demands, the bank maintains a custom-built, 1000 node grid supercomputing platform for asset valuation, management and reporting. This system is core to the bank’s operation, is unique to the industry and has been under continuous development and expansion for over ten years. The grid computer system is subject to periodic upgrade and replacement to avoid hardware obsolescence.

Due to the extreme transaction volume, reliability, availability and functional performance required, the migration to the new platform with its multiple processing environments had to be verified as fully functional and demonstrate as fast or faster performance than the existing platform. Complicating this picture was the fact that no formal requirements or design documents had ever been developed for the system. Further, the system's user interface had been adapted to its highly expert end-user group which was more concerned about correct operation than usability.

SLI Global Solutions (SLI) was tasked by the bank with a project to support the planned migration with multiple measures of success, which included:

Rapidly documented all components of the system;
Developed corresponding functionality tests for all system components; Ensure the tests are uniform across all disparate operating environments;
Executed tests to provide absolute evidence of replicable performance between the new platform and the existing platform;
Managed the test execution effort to provide "on-the-fly" progress status, including exact completion status at any time of the work day;
Fully conformed to SOX operational and auditing requirements; and
Delivered the testing, management and reporting features cited above without purchasing or leasing any Commercial-Off-The-Shelf (COTS) products.

Our test program spanned 11 components, approximately 100 display screens, dozens of dynamically inserted 'task' panes within the display screens, and hundreds of different configuration and control combinations, most of which were tested in permutations across multiple settings. These tests fully covered all daily operations and also supported month-end and quarter-end reporting periods.

SLI rendered over 300 test cases into procedures with automated time journaling features to provide real-time tracking of both projected and actual schedule in order to ensure the system migration date would be met. Additionally, we developed six individual customized test suite dashboards that allowed test libraries to be adjusted to different patterns of functionality and performance in each of the six grid environments. We also provided innovative, SLI- proprietary data mining and reporting tools capable of pushing hundreds of test results via single display screens, with real-time "on-the-fly" update capabilities. These capabilities enabled the test team to update and report on percent testing complete, current status and projected time to complete testing within 90 seconds at any time during the work day.

In order to accurately report test results, SLI engineers visually rendered outcomes for the new system to compare existing vs. new grid system performance. This approach enabled the new performance results, even though occurring in non-replicable environment conditions, to be contrasted with prior parallel runs in the existing system.

The results of our program enabled the client to verify the readiness of the new grid system and facility on schedule and with no additional costs. During parallel operations, empirically derived performance test data matched our predictive results and the system delivered the enhanced performance that was anticipated in this multi-million $ migration. This result enabled our client to retire the existing system ahead of schedule and enjoy the cost savings and performance improvement of the new system almost a quarter earlier than anticipated. The net business benefit of this engagement was measured in multi-million dollars per year of operation – resulting in a very sound investment for the bank.

Said the Project Manager for the overall migration effort:

”Downtime of any length is very costly and deemed unacceptable: for this effort, the only acceptable risk was 'zero' risk. As we did not have the resources to satisfy the testing requirements within identified project schedule, we met with SLI Global and quickly decided that they had the expertise and personnel for the job. What made SLI stand out for us was their communication and flexibility. As with any project of this size, problems arise; SLI helped us rise to the occasion at every turn. On the bottom line, SLI was instrumental in helping us attain that goal of keeping acceptable risk at zero."

SLI delivers custom solutions for rapid delivery of customer-directed quality to CenterStone Technologies

Mon, 02 Apr 2012 18:42:00 GMT

SLI provided a full range testing services to CenterStone Technologies, an e-Commerce company whose iVendix system provides business-to-business ordering capabilities world-wide. SLI used its proprietary textless QA management capabilities to quickly assess iVendix, implement a comprehensive test suite, then provide automated testing and on-line dashboard reporting – all within 30 days.

SLI QA and Testing solutions enables rapid upgrades in software quality with or without current documentation, for all types of systems, with traditional, agile and hybrid development processes. Most important, PIQ’s rates are competitive across-the-board. CenterStone chose SLI to accelerate delivery and ensure that service level agreements with their clients are uniformly met.

“We have more meaningful, automated testing in the first 30 days of using
SLI than we have been able to accumulate over the last few years”

Rich Guess, Director of IT, CenterStone Technologies

For more information contact:

Peyton Langford, Account Executive
SLI Global Solutions
plangford@sliglobalsolutions.com

Electronic Voting System Test and Certification Project for the Republic of the Philippines

Fri, 03 Sep 2010 21:49:00 GMT

SLI has completed testing of an electronic election system for the Republic of the Philippines which was successfully used to support the May 2010 elections. This project was a first of a kind international certification test program conducted by a US company.

For more see http://bit.ly/1NdIzh. Eighty-thousand scanning machines were deployed in the over 7,000 islands that comprise the Philippine archipelago using a complex transmission protocol that had never been used before. SysTest Lab’s project delivered the comprehensive results needed to support a timely go/no go decision for electronic elections. In order to accomplish this, SysTest Labs tested the performance, accuracy and security of the system. SysTest Labs executed a full audit, review, and test of all system characteristics by applying innovative test methods that covered extreme technical requirements and logistical challenges.

SLI engineers developed a load generation tool that was specifically tailored to combine actual test traffic on the system along with simulated vote data. The combined traffic modeled load and expected transmission behavior. The results of the simulated load test indicated that the system would be able to handle the projected transmittal rates and the results on election-day confirmed our findings.

The election was held on May 10, 2010 and has been hailed as one of the most orderly and successful elections ever conducted in the Philippines. Our client summed it up this way:

“We are so gratified that our cumulative efforts have yielded the much-needed results.
… I must hasten to add that the work of the entire SLI team has definitely lent so much credibility to this entire electoral process ... for this alone, you have the gratitude of not just this member of the Tech Evaluation Committee, but more likely that of an entire nation.”

Maraming, maraming salamat po sa inyong lahat diyan sa SLI

Tim Diaz de Rivera
Director General, National Computing Center
Republic of the Philippines

For more information contact:

Mark Phillips, Vice President Compliance Services
SLI Global Solutions
mphillips@sliglobalsolutions.com

Mississippi Electronic Health Records (MEHRS/eScript) Project

Mon, 02 Apr 2012 18:39:00 GMT

SLI (then SysTest Labs) provided Independent Verification and Validation (IV&V) services to the Mississippi Division of Medicaid (DOM) for the implementation and operation of a $9.8 million Electronic Health Record (EHR) and e-Prescribing solution, which includes:

Web portal access for Medicaid providers to obtain an EHR based on Medicaid medical and prescription claims data
Web-based e-Prescribing system
Web portal access for Medicaid providers to obtain hospital discharge information based on Medicaid claims

The end users of the MEHRS/eScript system are authorized and authenticated Mississippi Medicaid providers and MEHRS/eScript Administrators, who will be granted access to a web portal that offers clinical and administrative data about Mississippi DOM beneficiaries. Additionally, the providers will be able to prescribe electronically, gain insight into their own practice through Shared Health’s Patient Population Manager and Disease & Wellness Registry applications, and be able to enter updates to the clinical repository, including new patients, medications, vital signs, immunizations, and allergies.

The benefits to implementing the MEHRS/eScript system are numerous, but all share a common theme – improved care for the beneficiary while concurrently reducing the cost of that care. Online access to medical claims and pharmacy claims data offers information to the provider that the beneficiary may be unable to provide, better positioning the provider to identify and treat the beneficiary’s illness, reducing waste and duplicated effort. Electronic prescribing is a less costly and more efficient use of provider time, and reduces potential errors in deciphering hand written prescriptions at the pharmacy. Patient Population Manager and Disease & Wellness Registry allow a provider to look across his beneficiary population and quickly identify those beneficiaries whose prior care has deviated from evidence-based guidelines, and to subsequently drill down to the beneficiary level to assist in managing the care for those beneficiaries with one or more predefined disease conditions.

As Mississippi’s IV&V partner, SLI's primary services include:

Project Oversight. We reviewed all project planning and management plan deliverables for the project and provided input to the state on those plans completeness and adequacy for the areas they were intended to address. Our IV&V Project Manager also attended weekly project management and project work plan meetings, as well as the monthly Executive Steering Committee. The focus of the project oversight work was to identify risk and issues as quickly as possible and to document those risks and issues in terms of the importance and impact on the project. Additionally all risk and issues identified also included recommended actions and mitigation strategies. In this area SLI also provided various white papers to DOM management addressing specific areas of project activity that were problematic and needed more documentation and analysis. Finally, We provided a monthly project status report directly to the senior management of DOM. The purpose of this monthly report was to provide an independent assessment of the progress and status of the DDI vendor’s progress.
System and Integration Test Review. SLI conducted detail assessment and analysis of the system and integration test methodologies, practices and outcomes of the DDI vendors test activities. Our IV&V Team prepared detail weekly reports throughout this test phase with an analysis of the DDI’s activities and reports for the week.
User Acceptance Test Support. SLI assisted the state in developing User Acceptance Test (UAT) plans and UAT test cases. Assisted the state in the execution of UAT by providing subject matter experts to help conduct UAT, reviewed outputs of test, defined and tracked defects and participated in a defect management board made up the state and DDI vendor staff.
Deliverable Review Reports. SLI IV&V Team created detailed Deliverable Reveiew Reports (DRR) documents is to ensure processes and tasks undertaken by the MEHRS/eScript Implemenation Contractor were configured to the MEHRS/eScript system were clearly, thoroughly, and consistently documented. Each document reviewed was assessed in terms of the standards for clarity and specificity, completeness, quality, risk, and adherence to standards and criteria. These attributes measured by use of our quality checklists. We completed a total of (20) twenty formal Deliverable Review Reports (DRR) for DOM over a one-year contract period. These assessment reports analyzed and reported on the contents, approach, and results of the multiple deliverables produced by the EHR Contractor while implementing the MEHRS/eScript system.
Additionally, SLI completed the following quality documents to support the project: Quality Management Plan, Requirements Traceability Matrix, and Master Test Plan.
In addition to producing the formal DRR documents to assess the quality of the MEHRS/eScript Contractor deliverables, SLI delivered two more work products for DOM that facilitate the IV&V assessment of the project. These are a Quality Management Plan (QMP) and a Requirements Traceability Matrix (RTM). The QMP is an overarching document to support the tasks and schedule of the IV&V Team.

The MEHRS/eScript system went live June 2010 and the IV&V team completed at the end of July 2010.

Denver Health Electronic Health Record Performance Testing Project

Mon, 02 Apr 2012 18:52:00 GMT

SLI (then SysTest Labs) provided Load & Performance (L&P) Test Services for Denver Health (DH), a regional top acute care hospital, to confirm that its new Electronic Health Record (EHR) system would perform adequately with a large number of end-users.

By using innovative approaches and flexible implementation, we enabled DH to confirm that its EHR System performed as required in terms of hospital-unique project and institutional goals. Our approach also enabled DH to keep its staff focused on medical services delivery, rather than be diverted into IT support consulting. Most importantly, SLI was able accommodate DH’s unique EHR testing needs without any increases in project cost or schedule impacts.

Our services for Denver Health include:

An L&P test solution for Denver Health that minimized DH staff time demands
Rapid test development, yet provided full function L&P test cases
Optimized available Denver Health staff time by using video capture to record staff use of the EHR system
Test case documentation and the expected results
Multiple full length L&P tests in as little as one business day, enabling rapid turn-around in order to meet tight delivery schedules
L&P test scripts and easily understood results

Reed Group Performance Testing Project

Fri, 06 Apr 2012 17:31:00 GMT

SLI (then SysTest Labs) provided Performance Testing services to Reed Group, a leading provider of employee leave management services and absence management software. Reed Group contracted with SLI to upgrade its software testing capabilities in multiple areas. We responded by assessing the quality of each test suite, including suite execution time and accuracy of defects found during testing; and also accelerated testing performance by incorporating automated functional testing.

We created the Enhanced Manual Test Library, permitting accurate and timely decisions regarding software defect findings. Our team also provided rollout training and support for the new EMTL to the Reed Group QA staff allowing them to manage the process for the future. The creation of the functional test automation solution and running tests from Quality Center significantly reduced overall test execution time.
SLI provided a two-part solution for Reed Group:

The first part was an Enhanced Manual Test Library (EMTL), which created an overall summary report in each test suite. The report provided dashboard displays for test script quality, test defect results, and real-time (on-demand) tracking of the testing schedule progress. With this upgrade, management could know for the first time the quality of all test cases, summarize all defect findings in real-time, as well as predict and manage the real-time execution of over 300 individual test cases.
The second element was a turn-key test functional test automation solution for 80 test scripts using HP’s Quick Test Professional and HP’s Quality Center.

North Dakota Medicaid Management Information System (MMIS) Project

Mon, 02 Apr 2012 18:38:00 GMT

SLI is providing Independent Verification and Validation (IV&V) support to the North Dakota Department of Human Services (DHS) with its implementation of a $60 million replacement Medicaid Management Information System (MMIS). The North Dakota Medicaid Management Information System (MMIS) Project is a turnkey development project where the design, development, and implementation (DDI) vendor is using a COTS MMIS product as the base, with customizations and extensions to meet North Dakota specific requirements. As the IV&V contractor, SLI's primary services include:

Business Process Review. A review of current MMIS related business processes for the department and the identification of those requiring business process modification.
Project Oversight. Complete verification and validation of project artifacts and outcomes:
- Review of all project planning and management plan deliverables, to include an assessment of completeness and adequacy
- Participation in weekly project management and project work plan meetings as well as the monthly Executive Steering Committee
- Identification and documentation of project risk and issues stratified by severity and potential impact to project success, to include recommendations and mitigation strategies
Provision of monthly independent assessment project status reports to executive management on project health, schedule, and budget
Design Review. Verification of the Detail Design of the project, to include MMIS subject matter expert participation in design sessions, specialized design sessions on selective issues, review of design documents for accuracy and completeness, and identification and documentation of unresolved issues.
System and Integration Test Review. Detailed assessment and analysis of the system and integration test methodologies, practices, and outcomes of the DDI vendor’s test activities, to include weekly analysis reports throughout the test phase.
User Acceptance Test Support. Assist with the development of User Acceptance Test (UAT) plans and UAT test cases, and the execution of UAT through review outputs of test, tracking defects, and participating in the Defect Management Board.
MITA/CMS Certification Support. Designed the approach to validate the MITA/CMS Certification requirements to applicable sections of the Detail System Design, including the mapping of test cases that address the MITA/CMS Certification requirements for each requirement.

New York State Board of Elections Independent Test Authority Voting Systems Testing Project

Mon, 02 Apr 2012 18:49:00 GMT

SLI (then SysTest Labs) was contracted by the New York State Board of Elections (NYSBOE) to serve as the State’s federally certified Independent Testing Authority (ITA) for the purpose of examination and testing for the State Board’s certification, decertification, and re-certification of voting systems.
Two voting system manufacturers applied for certification to NSYBOE. SLI tested both products by developing test cases that support the scope of testing derived from the 2005 VVSG (Federal voting standards), New York State Law, and 6209 regulations. At its December 15, 2009 board meeting, the Board of Elections voted to certify both systems.
The voting systems’ source code and documentation were verified directly against 1,111 review requirements. All documents and each source code module provided to the state for compliance were reviewed to the best practices and coding requirements defined in the 2005 VVSG. This included a secure source code review to ensure protection against all known and suspected vendor vulnerabilities identified within prior ITA reports, voting system tests, or risk assessment final reports, and other comparable examinations performed by independent testing organizations.
Source code was compiled and built at the our Compliance Testing Facility by SLI personnel. The build scripts, vendor source code, and any modified Commercial off-the-Shelf (COTS) code were reviewed for format, structure, and functionality. All code delivered was also reviewed using both automated and manual methods to check for malicious code, Trojans, and viruses.
Functional, security, and hardware testing consisted of running 26 test cases that contained 6,730 test steps to fully cover all 1,524 testable requirements. Each test case had detailed step by step test procedures that allowed repeatability and auditing. All testing was performed at the SLI's facility and assessed the response of the voting systems when subjected to a range of conditions including end-to-end operational use, failure injection, data driven conditions, user interface testing, data referential integrity, stress, volume, performance, accessibility, usability and accuracy testing. SLI also identified and provided specific threat and vulnerability criteria against which the voting systems were tested.
In her report to the New York State Board of Commissioners, Director of Election Operations Anna Svizzero stated that “As New York is the first state in the nation to adopt the EAC’s voluntary guidelines as regulations, it necessarily subjects any voting system submitted for certification in New York to the most rigorous testing protocols in the Nation”. She goes on to state that “…after an extensive review of the testing materials submitted by SLI and NYSTEC, we have no doubt these systems can be used safely and properly by voters at elections under the conditions prescribed in Election Law,..”
SLI is proud to be an integral part of the team that brought electronic voting machines to the state of New York.

North Carolina Medicaid Management Information System (MMIS)

Mon, 02 Apr 2012 18:51:00 GMT

SLI is providing Test Management services to the North Carolina Department of Health and Human Services (DHHS) with its implementation of a $69 million replacement Medicaid Management Information System (MMIS), and $196 million for fiscal agent services for 4 base years and 1 option year; for a total contract amount of $265 million.

The North Carolina Medicaid Management Information System (MMIS) Project is a turnkey development project where the design, development, and implementation (DDI) vendor is using a COTS MMIS product as the base, with customizations and extensions to meet North Carolina specific requirements. The DDI vendor began work in early 2009. SysTest Labs became engaged as the test management vendor in the fall of 2009. The current planned implementation date is August 2011.

As the Test Management vendor, SLI's primary services include:

Review and Monitoring of DDI Vendor Test Practices. Detailed assessment and analysis of the system and integration test methodologies, practices, and outcomes of the DDI vendor’s test activities, to include weekly analysis reports throughout the test phase.
Support Test Knowledge Transfer to DHHS Participants. Through interactive training sessions, strengthen DHHS SME testing skills in test process, procedures, and standards of testing
Plan, Lead, and Manage State led User Acceptance Testing. Define and implement User Acceptance test planning, execution, and reporting for the MMIS project and supplemental projects, including the Reporting & Analytics (data warehouse) and Business Process Automation Systems (facilities licensing and inspection); focus testing efforts in a value-added fashion that achieves the best return on investment and overlaps the DDI test efforts only where prudent and necessary
Provide Specialty Test Services. Conduct specialized testing support, to include security and performance testing
- Work with the North Carolina Office MMIS Services (OMMISS) to determine the level of appropriate penetration testing activities to be performed
- Conduct Vulnerability Assessments beginning with a thorough review of configurations, requirements, and specifications of the application, interfaces, network, database, and system hardware
- Work with DHHS and the DDI vendor to define the workloads to be tested, develop the scripts to be executed, and configure appropriate tool settings for execution with the objective of simulating real-world conditions

Alabama Statewide Automated Child Welfare System (SACWIS)

Thu, 05 Apr 2012 16:15:00 GMT

The genesis of focused Federal support for statewide automated child welfare information systems (SACWIS) sprang from the Omnibus Budget Reconciliation Act (OBRA) of 1993, enacted on August 19, 1993. That legislation provided states with the opportunity to obtain funding through the Title IV-E program of the Social Security Act to plan, design, develop, and implement a SACWIS. In exchange for the additional funding provided to a State that elects to implement a SACWIS, the State must agree that the SACWIS will be the sole case management automation tool used by all public and private social workers responsible for case management activities. Furthermore, staff are expected to enter all case management information into SACWIS so it holds a State's "official case record" - a complete, current, accurate, and unified case management history on all children and families served by the Title IV-B/IV-E State agency. Since the inception of the SACWIS program in 1993, 40 states and the District of Columbia have chosen to develop SACWIS systems. Twenty-seven of these systems are now operational.

Development of a SACWIS system is an extremely complex and costly project for a State to undertake and takes years to complete, from planning through development to final statewide implementation. For a complete SACWIS system the minimum planning and development time frame is about three to four years but often takes longer, sometimes extending to as much as five to ten years. This is attributable to the many difficult challenges involved in developing these systems, including factors such as:

Conversion of data from multiple legacy information systems;
Construction of multiple automated interfaces with external data systems; and
Integration of multiple complex business processes, including casework services and planning, provider management, contracting, payment, and federal claiming.

Faced with these challenges, most states recognize that they do not have sufficient technical expertise and experience to successfully execute and manage a project of this scope and complexity, and they decide to procure the services of a software development company either to custom build the SACWIS system or to adapt a transfer solution.

Contracting with a software development vendor for this kind of project brings an additional set of challenges for states, including developing a comprehensive RFP, managing the procurement process, negotiating an effective contract, and managing the project to ensure that contract terms as well as federal and state requirements are fully met. Over the years there has been a growing recognition that to successfully manage a contract with a software development vendor on a SACWIS project, states need to contract with an experienced quality assurance (QA) and Independent verification and validation (IV&V) vendor. In fact, the federal agency overseeing the SACWIS program, the Administration for Children and Families (ACF), has often required states to do this as a condition of funding their SACWIS development projects.

Such was the case in 2005 when the Alabama Department of Human Resources (DHR) requested additional funding from ACF to complete a SACWIS system that had been in development and partial implementation since the mid 1990’s. The Alabama Department of Human Resources (DHR) contracted with SLI Global Solutions (then SysTest Labs) in December 2006 to provide quality assurance (QA) and independent verification and validation (IV&V) services for the Statewide Automated Child Welfare Information System (SACWIS) Project. In this engagement, SLI was responsible for monitoring the progress of the project, assessing the compliance of all parties with the terms of the contract, advising the State of potential problems, recommending corrective action, and providing an independent source of information on the status of the Project for State and Federal decision makers.

On an extremely aggressive schedule, the project was able to successfully develop and implement the transfer solution proposed by the software development vendor within 26 months of project initiation to a user base of over 2000 Alabama DHR staff. The SLI QA/IV&V team focused on factors that enabled the project to avoid risk and achieve success through providing seasoned expertise in program, technical and project management. The contribution of the SLI QA/IV&V team to the success of this project has been acknowledged by both the executive management team of DHR and by the ACF representative for the State of Alabama.

"FACTS has been a successful project and this success was facilitated in no small measure by the SysTest staff. Throughout the project they have been constructive and flexible. Your able team...[has] been an asset to the project and a credit to your organization. My thanks to SysTest for being particularly easy to work with and for being willing to provide resources as needed in order to keep the project moving. This was a team effort and it paid off."
--Thomas Bernier, Alabama FACTS (SACWIS) Director (retired) –

Childrens Hospital EMR Project

Mon, 02 Apr 2012 18:33:00 GMT

As technology continues to advance so do the methods required to keep up with it. Electronic Medical Record (EMR) systems help manage this data flow. EMR software manages the clinical, financial and administrative aspects of any healthcare organization. A system is only considered an EMR when it integrates information from multiple sources captures data at the site of service and supports caregiver decision making. Some of the more well known EMR systems include, but are not limited to Epic, Cerner, GE Healthcare, McKessen, Greenway Medical and Sage Health.

Since these systems capture incredible amounts of critical data and are integrated with numerous other software applications in a single organization, testing becomes an integral aspect of maintaining the system. As the EMR software continues to evolve due to changing government regulations of patient data, system upgrades and software patches, these changes need to be deployed throughout the system. Some manufacturers send out as many as two hundred patches or upgrades per month. Deploying this litany of patches and upgrades carries the risk of causing major issues within the system and the integrated applications. Historically, IT departments have tested the new changes manually. This is a time consuming and costly process especially in today’s market, where even hospitals are being hit financially. Test Automation Engineers can develop functional tests that are designed to check specific EMR component operations for accuracy. These Test Engineers will use structured test script execution to deliver one framework that covers all EMR components allowing for a solution that is scalable and accessible to the hospital’s IT staff. Automation testing of EMR systems’ deployments (upgrades and maintenance) helps hospitals reduce risk, improve efficiency, and is a cost effective measure for keeping systems updated and operational.

According to a study by the American Hospital Association, the College of Healthcare Information Management Executives and the National Alliance for Health Information Technology, despite budget cuts hospitals are determined to go ahead with critical IT projects like EMR’s. This will necessitate the need to find ways to cut the cost of maintaining these systems. The automation of regression testing is one such cost saving measure. Test automation will increase the accuracy of testing, increase the quality of the software application and reduce the time needed to test deployments – all resulting in an overall cost savings. Test automation can have a significant impact in the overall bottom line of any healthcare organization that chooses to be proactive in using automated solutions.

Childrens Hospital in Denver is one example of a healthcare organization that chose to be proactive in using automated testing solutions. This hospital contracted SLI Global Solutions (then SysTest Labs) to automate tests tailored to their particular EMR system. Our Test Automation Engineers developed functional tests designed to check specific EMR component operations for correctness. They also structured test script execution to allow for rapid, wide-ranging confirmation of EMR operations after installation of patches. This solution resulted in SLI delivered one framework that covers all EMR components. The frameworks is scalable so that it can be quickly upgraded or changed to handle future changes of EMR components and is accessible so that the client’s IT staff can exercise full control of operations and maintenance to meet changing needs. The SysTest Labs’ solution allowed Childrens to stay ahead of EMR upgrades and patches, to deploy the EMR with confidence, and to complete the EMR system deployments in appreciably less time.