Friday, 27 September 2019

Causes of Unplanned Scope Changes

The leading causes for unplanned scope changes on a project are:

1. Shift in business drivers - Due to the dynamic nature of the business world today, things can change quickly. These business changes can have an immediate impact on existing projects. Examples of business drivers that can alter a project’s scope include:

• Available budget/funding for the project
• New government regulations
• Changing target market for the product
• Time-to-market pressures
• New business opportunities
• Changing customer priorities
• Unexpected market or world events

2. Shift in project acceptance criteria - Addresses changes in either the targeted completion date, financial return on investments, client satisfaction ratings, quality levels, other expected benefits, or the stakeholders who need to approve.

3. Shift in technology - With the move to shorter duration and phased projects, this is not as much of an issue as it has been in the past. However, there are still times when new technology becomes available during a project that will significantly meet the needs of the customer much better than what is currently planned.

4. Poor scope statement - If the scope statement is incomplete, ambiguous, inconsistent with project assumptions, or does not address the complete business workflow process, you are much more likely to have project scope changes.

5. Poor requirements definition - There are entire training courses on requirements definition and requirements management due to the importance they play on project success. Suffice to say, the more gaps that you have in your requirements, the more scope changes you are likely to have. Here is a list of the leading reasons for poorly defined requirements:
  • Ineffective or wrong techniques used to gather requirements
  • Communication breakdowns between analysts and stakeholders
  • Requirements are not aligned with project scope
  • Requirements do not address complete process work flow
  • Documented requirements are not meaningful to targeted audience
  • Requirements not reviewed for inconsistencies
  • Requirements not verified for correctness and completeness
  • Missing stakeholders
  • Users sign off without a “real” understanding of what the documented requirements mean
To better manage project changes and project risks, and to minimize the number of scope changes, it is important to understand the leading causes for unplanned scope changes on a project.


Thursday, 26 September 2019

Seven key management principles for effective project change control

Following are seven key management principles for effective project change control:

1. Plan for changes—Change control does not mean preventing changes at all costs. Conversely, project changes should be expected, planned, and well managed. The two keys here are selecting the proper project approach (methodology) and setting up a project change control system. For projects with an innovation focus or a volatile set of requirements, an iterative development-type approach that expects deliberate scope expansion or scope clarification should be utilized.

2. Set up a change control system—If your organization does not already have a defined procedure for project change control, then you need to set up a change control system for your project. The key benefits for establishing a formal change control system include the following:

• Helps protect the integrity of the project performance baselines
• Ensures the right people are involved in the decision-making process
• Helps manage stakeholder expectations
• Enhances the credibility and professionalism of the project manager
• Avoids issues and confrontations when changes do occur

3. Educate stakeholders—Whether you adopt an existing change control system or develop your own, you need to step through the change control process with your stakeholders. Do not assume that because the procedure is documented that individuals understand it or their roles and
responsibilities within it.

4. Use the system—This might seem obvious, but it is a common pitfall. Make sure to utilize the change control system that you have defined. If the project manager does not consistently follow the process, no one else will either.

5. Minimize scope changes—This is the great balance of managing project changes. On the one hand, you plan for changes and set up a system to manage those changes when they do occur; on the other hand, you work diligently on influencing those factors that are responsible for project changes, especially scope changes, to minimize their occurrence. The keys here include the following:
  • Keep the team focused on the project objectives, the big picture.
  • Listen carefully. You need to understand immediately when a critical gap is identified.
  • Limit, if not totally avoid, any unnecessary changes by either the customer or the team.
  • Educate stakeholders on the impact of their change request.
  • Encourage any scope change request that is not an absolute, must-have feature to be scheduled for a follow-up project (cycle, iteration, or phase).
6. Over-communicate—For effective stakeholder management, make sure that all project changes are clearly communicated and understood by all key project stakeholders.

7. Be a watchdog—As a project manager, you must be continuously alert and mindful to anything that could impact your critical success factors. In particular, you need to understand what can cause unplanned scope changes to occur—and then work to prevent their occurrence.


Wednesday, 25 September 2019

Project Change

A project change is a change in any of the critical success factors (scope, schedule, costs, quality, and project acceptance criteria). The “big deal” is not that there is a change. In fact, for many projects, changes—especially scope expansions—are expected and encouraged. The big deal is uncontrolled change.

Why?

Because a change in any of the critical success factors affects the other factors, which then impacts project performance and the project’s ability to achieve the success criteria, which then impacts stakeholder perceptions and satisfaction levels. For example, an expansion in project scope increases the work of the project. At a minimum, the increased work affects project schedule and project costs. In many cases, the increased work also impacts resource plans and adds new risks. On projects with contractual arrangements, the increased scope will likely have contract implications and needs to be formally managed to protect all parties involved.

Thus, any time a change occurs, the project needs a way to recognize the change, evaluate the impact of the change, communicate the change, and make planning adjustments if the change is accepted. This mechanism is commonly referred to as a project change control system.

For many people, project control equals “managing project changes,” and managing project changes equals preventing “scope creep.” Scope creep is a common term used to describe uncontrolled expansion of project scope. Scope creep is legendary for causing project delays and cost overruns.

Although this belief is not completely accurate, the perception cannot be ignored. The ability to manage and control the change elements on a project, particularly the project scope, is a key to project success and a key performance indicator for a project manager.

To manage project changes effectively, a project manager must utilize all of his skills and  demonstrate project leadership. In addition to being an insightful measure of individual project management maturity, it is not uncommon for organizations that are in the early stages of adopting project management business approaches to look at how well project changes are being managed to determine whether project management is making a difference. Although it sounds like there is a lot riding on this ability to manage project changes (and there is), the process is not difficult if you follow the key success principles and understand how to avoid the common errors.

Although scope changes are generally responsible for 80% or more of the project changes, it is important to recognize that any of the following would also constitute a project change (and should be controlled using the project change control system):

• An expansion or reduction of project scope
• An expansion or reduction of product features
• An expansion or reduction in performance requirements
• An expansion or reduction in quality requirements
• A significant change in the target milestone dates
• A shift in the implementation or deployment strategy
• An increase in resource costs
• An expansion or reduction in the project budget
• A change in any of the project objectives
• A change in any of the final acceptance criteria, including return on investment forecasts
• A change in any of the project assumptions, constraints, or dependencies, especially regarding resources and work effort estimates
• A shift in project roles or responsibilities, especially on projects with contractual arrangements
• A decision to reset the performance baselines due to an unrecoverable performance variance




Tuesday, 24 September 2019

What occurs during a typical project recovery?

A project recovery is an attempt to turn around a troubled project. If there is ever a case where project control is absolutely critical, it is when you are trying to heal a sick project. To really understand what is important for controlling a project, let’s review what occurs during a typical project recovery.

The first thing that senior management will do to recover a project is to make sure there is an  effective project manager in charge. This might mean anything from validating the current project manager, bringing in someone new, pulling someone up from the project team, or providing a mentor to the current project leadership. After the project leadership is solidified, most recovery missions
involve the following activities:

1. Review planning principles—The planning principles are revisited. A focus is placed on establishing priorities and objectives, clarifying acceptance criteria, gaining consensus, and reviewing roles and responsibilities.

2. Reset baseline—As a final step in the re-planning step, key milestones are set and new baselines are set for cost and schedule performance.

3. Frequent status checks—To facilitate better communications, prevent additional obstacles, reinforce the visibility of the recovery mission, and emphasize individual accountability, team status meetings are conducted daily. In some situations, these checkpoints are even more frequent. It depends on the nature of the project.

4. Aggressive issue resolution—One purpose of the frequent status checks is to gain visibility of any new or potential issue. The resolution of any new issue is aggressively pursued. These become top priorities for project leadership.

5. Ensure clarity—Another technique normally employed in successful project recoveries is an extra effort to ensure clear understanding of all communications, expectations, and work assignments. When focus and efficiency is of paramount importance, the criticality of clear communications and mutual understanding is obvious.

6. Increase visibility and accountability—This has been referenced indirectly already, but it is worth emphasizing again. A major reason that project recoveries often work is because people know they are more accountable for their efforts due to the increased visibility with senior management. For both the individual and the organization, the recovery mission helps to prioritize efforts and align resource allocations.

Monday, 23 September 2019

Ubiquitous Project Control Challenges

In the previous posts we’ve discussed on some of the challenges the project managers when  attempting to control their projects. Now let’s see the top reasons for difficulty in the project control arena.

1. Time and cost accounting logistics—The logistical and organizational culture issues relating to time reporting and project costs tracking can prove detrimental to timely and accurate performance reporting. During planning, you want to understand and clarify how project time and cost information is reported and how quickly you can get this data. You might need to establish project specific time reporting or approval procedures to ensure the integrity of your control system.

2. Project manager reluctance, multitasked—The project manager might be reluctant to request WBS level time reporting by project team members, especially if this is not part of the organizational culture. In addition, the project manager might be overallocated and might not be able to invest enough time to performing the project controlling duties. This is most common when the project manager has assigned other project roles to herself or when the project manager is assigned to multiple projects.

3. No change control—The most popular reason is the lack of change control procedures. This is most problematic when the project scope has increased without the proper reconciliation with the project schedule and budget.

4. No completion criteria—When clear completion criteria for work assignments is not established, you are more likely to have increased rework cycles, more difficulty in accurately reporting progress or status, and more likely to experience the 90% done phenomenon.

5. No baselines—This should be obvious by now, but if a schedule and budget baseline are not  established and controlled, then you will not be able to accurately measure for performance variances. Without this ability, you are less likely to detect problems early—when they are small and more manageable.

6. No requirements traceability—Definitely an issue for controlling scope and stakeholder expectations. The lack of a formal tracking procedure between original requirements and final products increases the odds of missed work and scope creep.

7. Not consistent—When control procedures are not consistently implemented, it is difficult to detect performance variances early, and it is more difficult to get project team members to follow the defined control procedures.

8. Measuring progress accurately—Accurately measuring progress is a natural challenge on work assignments with intangible final products, especially on any project where status is estimated. However, this challenge is further complicated when work definition is vague, completion criteria is not established or when work efforts are not reported on a daily basis.

9. Impact of hidden work—This hits at the heart of work definition and change control. Any effort spent on unidentified work, unplanned rework cycles, or out-of-scope work adversely affects the accuracy and effectiveness of project control procedures.

10. Virtual/distributed teams—When project team members are not physically located together, it can be more difficult to get information, detect potential issues, measure work progress and ensure understanding of work expectations.

Friday, 20 September 2019

Common EVMS Misconceptions

For companies exploring a potential contractual need or competitive desire to implement an Earned Value Management System (EVMS), there are a host of misconceptions that frequently surface about earned value management (EVM) and implementing an EVMS. For anyone new to EVM, there is a certain air of mystery about it - EVM can appear complicated and hard to do. There is no doubt that implementing an EVMS requires management commitment and concerted effort to succeed. The whole point of an EVMS is to provide reliable, timely, and actionable information that can be used to manage a project more effectively. The trick is not making it more difficult than necessary. What are some common misconceptions about EVM and EVM Systems? The following is a short list of some of the frequent misconceptions Humphreys & Associates consultants encounter along with some observations to help dispel them.
  1. Install software, have EVMS.

    False. Implementing one or more software toolsets to assist in the EVM process always helps, but it is just one component. An EVM System is more about instilling a disciplined and repeatable process for managing projects. That process will need to integrate all of the project control subsystems such as work organization, planning and scheduling, budgeting, accounting, work performance and analysis cycles, estimating what it will take to complete the remaining work (in time and resources), and managing changes to ensure the process provides reliable information from project inception to completion.

    The people using the project control system are another critical component. The goal is to create an EVMS that all project stakeholders including upper level management, project managers, integrated product team (IPT) leads, control account managers (CAMs), and others actively use as a normal part of their day-to-day routines regardless of the toolsets the company uses.

    The right software tools can certainly make it easier to implement an EVMS. Merely implementing software without addressing the process does not address the issue. Implementing a disciplined process that people use does.

    Beware of those who suggest that implementing a software toolset equates to an EVMS. In some instances the incorrect application of software, or software that claims to do more than it does, hinders the EVM process and can create issues with a government customer EVMS review team. Classic examples include the inability to fully integrate the schedule and cost data or the software produces Contract Performance Reports (CPR) formats using an outdated Data Item Description (DID).
     
  2. An EVMS prevents budget overruns or schedule delays.

    Unfortunately, this is a common misconception of both contractors and government program offices.

    Properly used, an EVMS is an early warning system. It provides the means to identify issues early and proactively address them before they impact the ability to meet contractual requirements whether technical, schedule, or cost. Knowing how to identify risks and opportunities is an integral part of an EVMS. It is essential that managers at all levels know how to use the information the EVMS provides to respond quickly to deviations from a baseline plan. An EVM System is a useful management by exception tool. Project managers can manage the work effort with less stress, because they can focus on critical or problematic work elements.

    When a baseline plan is unrealistic or does not take into account likely risks to the project, implementing an EVMS will not prevent an overrun or schedule delay. It will, however, highlight where the baseline planning was inadequate and which work elements require management attention to make the necessary adjustments for the remaining work effort.
     
  3. Variances are a bad thing.

    This is another common misconception of both contractors and government project managers. The bad part of this misconception is that it causes people to unwisely hide schedule or cost variances or to produce rosy estimates at completion (EACs) until an unpleasant surprise surfaces (i.e., the bad news cannot be hidden any longer). Hiding variances negates the whole purpose for implementing an EVMS. This is one of the reasons EVM gets a bad name. The EVMS is used improperly and then becomes the culprit when management or the customer is blindsided.

    Variances are the early warning mechanism of an EVMS. While most projects endeavor to produce a reasonable and executable baseline plan, what actually occurs as the work is performed will deviate to some degree from the plan. Consequently, the performance variances provide the ability to quickly identify deviations from the plan and determine the impact to the project. That means management can take the appropriate action to minimize the impact. This analysis provides fact-based information that can be provided to the customer about issues that are surfacing, what the impact is to project, and the actions being taken to minimize the impact. This instills confidence in the system, because the contractor demonstrates it knows how to actively manage the work effort.

    Variances and performance indices also provide an indication of the quality of the baseline planning process or how realistic the baseline plan was from the onset. It may be that the proposal and/or baseline basis of estimate or scheduling process needs additional work to produce better baseline plans for future projects. It highlights an opportunity to improve that initial planning process.

    Conversely, a good estimating or baseline process can result in small deviations in variances and performance indices as project work effort is completed. At completion performance indices can be cited in future proposals as evidence of a company's ability to effectively plan and manage projects. These indices also validate the underlying basis of estimates when planning similar projects in the future.
     
  4. An EVMS is too rigid, requires too much detail.

    This can be true in those situations where the EVMS implementation process was not thought out or tailored to the environment. An EVMS does not inherently require more detail. A common error made by companies new to EVM is to drive the data down into too much detail. This over complicates the planning and scheduling, budgeting, performance measurement, analysis, and change control processes.

    What EVM does require is a defined logical approach to produce technical, schedule, cost, and risk data that are fully integrated. This is necessary to summarize the source detail data to various levels or to drill down into the data to perform root cause analysis. That means more upfront planning is required to determine a reasonable level of detail to manage the work effort based on risk and other factors for management visibility. It also means defining a useful coding approach to organize and integrate the data. This upfront effort quickly pays for itself because it provides the means for the EVMS to highlight work effort that is deviating (positively or negatively) from the plan and for management to take appropriate action.

    EVMS most certainly adds a level of discipline to the project management process. This is necessary to implement a repeatable process that can be described and demonstrated - this is similar to goals of the Capability Maturity Model Integration (CMMI). An EVM System is a structured collection of effective project management practices as defined in a company's EVM System Description. Projects use the same effective practices (the System Description) along with needed project specific directives to match the project's needs or contractual requirements. Implementing and effectively using an EVMS demonstrates a higher project management maturity level.

    Whether or not someone translates a repeatable process as being too rigid is a subject for debate. In some instances, the "too rigid" label is a result of self-induced pain. The EVM System Description should provide a foundation of sound practices that all projects are expected to follow so that a common set of performance metrics can be captured for companywide project portfolio analysis. Project directives can be used to further define how those practices are applied to a project based on the scope of work, type of contract, duration, risk, and other factors. This provides the ability to tailor or scale the EVMS as needed and yet ensure sound, effective practices are being followed.

    What is easy to forget are the hazards and business risks related to ad hoc processes or project management by heroics. Typical results of ad hoc processes: regularly failing to meet objectives (overruns, late deliveries, last minute scrambles to the finish line), lack of management visibility into the real status of the project (which results in unpleasant surprises), quality issues that result in rework or unhappy customers, and high frustration levels (is anyone in charge?).

    The important point is that the principles of EVM can be used on any project to improve the management and control process.
     
  5. High cost to implement and to use an EVMS.

    Or the corollary to this: EVM provides limited return on investment. This is a common argument about any new process that is introduced. An EVMS may be a new contractual requirement for a company. To win the business, an EVMS is required. That immediately determines management's commitment - either implement or decline to bid.

    There certainly is a price tag for implementing new processes. The difficult part is determining the delta between what a company is currently doing compared to those practices noted in the EIA-748 32 Guidelines. It may be a narrow or large gap. Having an experienced independent third party conduct a gap analysis is one means to capture fact-based information about the current state of a company's project control system and project personnel's EVM knowledge level. This can provide a basis to determine what it will take in time, resources, and cost to close the gap. This can also help to perform an internal cost/benefit analysis.

    What is sometimes missed is that EVM is really a set of proven project management principles that can be applied to any project. It can improve the ability of a company to meet commitments, increases management visibility which helps to prevent expensive surprises, and demonstrates a higher level of project management maturity that can be used to a competitive advantage. All of these factors can reduce the overall cost to execute projects and, in turn, increase the company's profit margin.

    Yes, there is a cost to implement a disciplined project management process. A company's management team must make the decision to fully embrace EVM (a cultural change) or not. There is a much higher hidden cost for ad hoc project management practices that is harder to capture and measure and thus easier to overlook as it is business as usual. There are also significant costs incurred should a government customer decide a company's project control system is not up to the task or is not being implemented properly. That typically means an emergency response team has to be brought in (whether internal or external) to resolve issues that could have been averted with proactive upfront planning, and avoid a loss in credibility and goodwill with the customer. Unfortunately, some companies learn that the hard way when senior management is not fully committed at the start.

Tuesday, 17 September 2019

Introduction to Implementing an EVMS

An earned value management system (EVMS) is a common contractual requirement on any US federal government agency project as well as some foreign government agency projects. Requiring the use of an EVMS is a sensible approach as a means to provide more visibility into project performance whether for a government customer or for internal management.

Implementing an EVMS does require dedication and significant effort as it inherently increases the maturity level of a contractor’s project control functions. It requires a higher level of project control discipline that can impact business functions as well as the corporate culture.

Based on more than three decades of helping hundreds of companies implement earned value management systems, Humphreys & Associates experience has shown that it typically requires approximately 12 months to fully implement an EVM System. Preparing for and obtaining a system validation from the designated government agency can easily add six months or more to the process.
As with any new concept or tool, everything is dependent on how the system is implemented. The upfront planning can mean the difference between success and failure. The seven steps described below can help to expedite and manage the implementation of a compliant EVM System. The goal is to create an earned value based project control system that is embraced and used throughout the company from the highest level managers to those performing the work. Successfully implementing an EVMS can prove to be a business enhancing endeavor.

Step 1 – Management Team Commitment

Commitment and support from the management team is essential to the success of the implementation. Without it, the process will fail. Establishing an implementation team responsible for developing the strategy plan and schedule is a critical initial step. The first task for the team is to create a charter that defines its specific roles and responsibilities. With that in place, the team can focus on developing an initial implementation plan that defines the goals and objectives, scope of the effort, overall time frame and key milestones, and resource requirements (people and budget). It is also useful to include a discussion on potential risks as well as how to document and resolve problems that may arise during the implementation process.

Step 2 – Pre-Implementation Assessment

Before implementing an EVMS, it always helps to have a clear understanding of the state of the current project control system. This is essential to be able to determine the full scope of the implementation effort. Comparing the current processes and procedures to the 32 guidelines in the EIA-748 Standard for Earned Value Management Systems (EIA-748) is part of the process. It also includes assessing the level of data quality and integration as well as how company personnel are using the current system. It is important to evaluate the level of project management and earned value knowledge.
Internal EVM experts or an independent third party can conduct this assessment, sometimes referred to as a requirements analysis or gap analysis. The intent is to produce fact-based information useful for creating a more realistic implementation plan. What are the processes, tools, and training that need to be enhanced or implemented? Based on this knowledge, a resource loaded schedule can be produced that defines the specific tasks and milestones to accomplish the end objectives. This implementation plan and frequent schedule status help to manage the process and maintain focus – what’s been done and what’s left to do.

Step 3 – System Structure and Integration

At the beginning of the system enhancement or design stage, it is useful to focus on each of the subsystems that support the nine EVMS process areas and how they integrate with each other. When the customer’s reviewing agency reviews the company’s EVMS, it will look at each of the following process areas:
  • Work Organization
  • Planning and Scheduling
  • Work/Budget Authorization
  • Accounting
  • Indirect Management
  • Management Reporting and Analysis
  • Revisions and Data Maintenance
  • Material Management
  • Subcontract Management
Note that risk management may be treated as a separate and additional process area or incorporated into the other process areas where appropriate. An example is incorporating schedule risk assessment into the scheduling subsystem.
The EIA-748 32 guidelines are the foundation for determining if an EVMS meets the requirements for a compliant system. Developing flow diagrams and storyboards are useful tools at the beginning of the design phase to note what needs to be added or enhanced to create a fully integrated EVMS as well as to satisfy the EIA-748 guidelines.
An EVMS storyboard illustrates all of the EVMS process areas as cross functional flow diagrams on panels or a conference room wall. It depicts the integration of all the process areas and clearly shows who is responsible for what, the flow of functions, inputs, outputs or products, and actions using real company project artifacts. The storyboard illustrates the complete system as well as the various interactions between the different subsystems, functional organizations, and project artifacts. The contractor will also need it for demonstrating how its system works to the government reviewing agency’s team. It is also very useful as the basis for an EVMS training program.
Once this preliminary design is laid out and approved by the implementation team and management, a more comprehensive effort to design or modify forms, practices, and subsystems can begin.

Step 4 – The System Description Document

The primary document for describing the system and how it satisfies the EVMS guidelines is the EVM System Description. Internal formal procedures support this document. The system description and related procedures are meant to be the all-inclusive explanation of the EVMS characteristics and how the system is used to manage a project from inception to completion. The EVMS storyboard and system description are complementary work efforts. An excellent starting point for the system description is to develop an outline that describes the subsystems for each of the nine process areas. Include references to completed forms and reports. If a form or report exists, include it as an example. If it does not, then one should be created and incorporated into the system process. Some companies also find it useful to create desktop procedures to help ensure that the end users understand how to use a specific toolset to complete typical actions such as statusing a network schedule or completing a baseline change request (BCR).
It is also strongly recommended that a cross reference to the EIA-748 guidelines’ 162 management system characteristics (MSCs) is included as part of the EVM System Description. This is important to fully demonstrate that specific system description content, forms, or reports support the requirements.

Step 5 – Training

Training is an important part of the implementation process. This includes upper level management, project managers, functional managers, control account managers (CAMs), and analysts. The training should reflect the EVM System Description as the government reviewing agency’s team will assess whether or not a project is following the company’s EVM System Description. The development and execution of the training plan as part of the overall implementation plan helps to ensure the various end users complete the training they need. Training tailored for the various end user roles helps to engrain the new process more quickly. Training may be more in depth for analysts and CAMs or summarized for upper level management. Having a strong set of instructors in place makes it easier to continually train new and existing users. This also helps to increase the confidence level and knowledge base within the company and provides the foundation to keep improving the application and use of the EVM System.

Step 6 – System Implementation

System implementation on a pilot project requires dedicated teamwork and is the most time consuming of the seven steps. An easier approach is to implement the EVMS on a new project so that all project artifacts reflect the system description at the onset. An existing project can present extra challenges as it may be necessary to recode data or enhance the quality of the data, incorporate new forms, or undertake forensic accounting to create contract budget base (CBB), management reserve (MR), and undistributed budget (UB) logs.
Once a company becomes comfortable with its EVMS, each future project must be planned and managed using the EVM System. This is where the benefit from implementing the system becomes more apparent over time. Management gains confidence in the system to provide timely and reliable information that it can use to make informed decisions. An actively used EVMS can help project managers to manage their work effort with less stress because they can quickly respond to issues and problems. Projects that are run effectively and efficiency often translate into higher profit margins and result in more company business.

Step 7 – Operation and Use Verification

Once in place, periodic internal reviews, sometimes called self surveillance, can be done to ensure that the EVMS implementations on the various projects continue to comply with the company’s EVM System Description. This helps to prevent the system from atrophying over time. It also provides an opportunity to address additional training needs, resolve common implementation issues, and enhance the system. A common approach for companies with a long history of using EVMS on its projects is to form peer review teams. An example would be reviewers from a different project or another division performing a review on a given project. This provides a degree of independence that can help to identify problems or issues. These companies develop an annual schedule of the reviews they will conduct based on a number of factors such as risk, the number of change orders, type of contract, size of the contract, project phase, etc. This can also include EVM contractors and EVMS  subcontractors when the EVMS requirement has been flowed down to the subcontractor. Independent third parties can also assist with the self surveillance process. This provides an added benefit with using experienced outside consultants who regularly perform mock validation and other types of reviews. The outside consultant team can also update a company on the latest issues the government agency review teams are focusing on, provide a fresh look at how an EVMS is used on a project, or bring new ideas to the table that can improve the company’s EVM System. Similar to the implementation and use of the EVMS, it is important to establish a repeatable process for self surveillance, capture the results from the self surveillance, identify the problem areas, identify actions to address the root cause of the problems, and track them to closure.