The CII Project Assurance Continuum, Part 1 of 2

Introduction

The speaker, Steve Cabano, is introduced as the President of Pathfinder and a long-time volunteer with CII. The purpose of the presentation is explained, and it is mentioned that the program will be split into two parts due to its length.

Speaker Introduction

• Steve Cabano is the President of Pathfinder and has a history of volunteering with CII.

• He has received the Richard Tucker award from CII.

Importance of the Program

The importance of summarizing CII's vast collection of documents into a few key points that provide value to owners is discussed. The current industry landscape and resource reshuffling are also mentioned.

Reasons for Summarizing CII Documents

• With over a thousand documents and research efforts by CII, there is a need to summarize them into key points that add value.

• The goal is to identify the most valuable information for owners without having to sift through all the documents.

Current Industry Landscape

• There has been a reshuffling of resources within organizations and shifts between different organizations.

• New members have joined CII.

• Projects are becoming larger and more complex due to regulatory requirements, resource limitations, supply chain issues, etc.

• There is a significant capital program bow wave either currently happening or forthcoming.

Speaker's Experience with CII

• Steve Cabano and his company have been members of CII for over 20 years.

• They are registered education providers within CII and have experience facilitating these efforts.

• They have participated in various research efforts, gaining an understanding of how tools were created and their purpose.

Overview of the Presentation

An overview of what to expect in the two-hour presentation is provided. The focus is on giving a brief overview of a handful of tools that can be implemented by owners to create an assurance program for their capital projects.

Presentation Goals

• Provide a brief overview of key tools that can be used to create an assurance program.

• Demonstrate how these tools can be organized to cover the entire project lifecycle, from concept to commissioning and startup.

• Emphasize that these tools can be implemented internally without the need for extensive customization or hiring consultants.

Conclusion and Speaker's Experience

Steve Cabano briefly mentions his involvement with CII over the years and highlights his company's experience in facilitating and participating in research efforts.

Speaker's Experience with CII (Continued)

• Steve Cabano has been involved with CII since the early 2000s.

• His company has been actively engaged in various CII initiatives, gaining knowledge and experience in using CII tools and processes.

The transcript ends here, so there are no further sections or timestamps available.

Project Assurance Overview

In this section, the speaker introduces the concept of project assurance and its importance in maximizing value from CII (Construction Industry Institute). The focus is on providing a set of tools and approaches that can be implemented by owner organizations to ensure effective project management.

Introduction to Project Assurance

• Project assurance is facilitated by the chair of the deployment committee at CII.

• It aims to provide guidance and support to owner organizations in implementing an end-to-end assurance approach.

• The goal is to help organizations gain maximum value from their projects while minimizing customization and time requirements.

Key Points

• There are proven CII tools and research available that can add immediate value to projects.

• A tool for front-end project assessment will be deployed at the annual conference.

• The focus is on enabling owner organizations to implement an assurance group or team that ensures organized and sequential progress throughout different phases.

• Business planning plays a crucial role in gaining value from opportunities and assets.

• Business objectives have evolved beyond financial returns, encompassing environmental, social, and governance considerations (ESG).

• The aim is to guide owner organizations through a five-phase process: feasibility, concept development, detailed scope, project authorization, detailed design procurement construction, and handover to operations.

• Several tools are introduced:

• Capital efficiency and capital effectiveness tool (upcoming)

• Project Definition Rating Index (PDRI) Suite of tools

• Construction Readiness Assessment

Capital Efficiency and Effectiveness Tool

This section provides a teaser about the upcoming Capital Efficiency and Effectiveness tool. It explains how this tool helps projects enter the pipeline effectively and mature into a capital portfolio that adds significant value for owner organizations.

Key Points

• The Capital Efficiency and Effectiveness tool focuses on optimizing capital utilization within projects.

• It assists in selecting projects that align with the organization's objectives and deliver maximum value.

• The tool helps in maturing projects from phase one (concept development) to a capital portfolio.

• It will be discussed further in subsequent sessions.

Project Definition Rating Index (PDRI)

This section introduces the Project Definition Rating Index (PDRI) Suite of tools. It explains how PDRI can be applied at different phases of a project to ensure effective project definition and rating.

Key Points

• The PDRI Suite of tools offers variations for different phases, focusing on pre-authorization stages.

• PDRI helps assess project definition and rating, ensuring clarity and alignment before moving forward.

• The main PDRI tool will be discussed, along with its adoption in different phases.

Construction Readiness Assessment

This section discusses the Construction Readiness Assessment, which evaluates whether a project is ready for execution or mobilization. It highlights the importance of thorough preparation before initiating construction activities.

Key Points

• The Construction Readiness Assessment determines if all necessary prerequisites are met before mobilizing resources.

• It ensures that schedules align with actual readiness for construction activities.

• There are two levels of assessment: one during phase three and another just before mobilization.

Timestamps have been associated with relevant bullet points as requested.

Utilizing Assurance Tools Throughout the Project Phases

This section discusses how assurance tools can be used throughout different project phases, starting from the middle of phase three through construction, planning, commissioning, and startup.

Assurance Tools Application

• Assurance tools can be utilized as early as the middle of phase three and throughout construction, planning, commissioning, and startup.

• Advanced Work Packaging (AWP) is a significant focus in Construction Industry Institute (CII) today. However, its implementation is still being assessed to ensure it aligns with other processes.

• Commissioning and startup are crucial stages that require evaluation during earlier phases to ensure readiness. The path of construction should align with procurement activities and project definition rating index.

Pursuing Capital Efficiency and Effectiveness

This section introduces the concept of pursuing capital efficiency and effectiveness in projects. It explains the definitions of these terms and their importance in achieving project success.

Definitions of Capital Efficiency and Effectiveness

• Capital efficiency refers to how well a project maximizes the value gained from the capital invested. It focuses on optimizing project execution to achieve higher value within a given opportunity.

• Capital effectiveness involves analyzing opportunities thoroughly to select the right projects that align with business objectives. Success is measured based on parameters beyond economic return, such as environmental, social, and governance (ESG) factors.

Assessing Portfolio Options

• Owners need to assess their portfolio options when they have more opportunities than available capital. They must determine the best combination of projects that support business objectives while considering revenue generation and integration with contractors and suppliers for overall efficiency and effectiveness.

New Section

This section discusses the process of pushing out opportunities and projects, starting from the business team's integration and alignment to handing it off to a project team for execution on the efficiency side.

Process of Pushing Out Opportunities and Projects

• The business team integrates and aligns with the project team to hand off opportunities and projects.

• More details about this process will be provided at the annual conference. A QR code is available for registration.

• The tool aims to ensure that owners select the right opportunities by defining their needs.

• Economic return is not the sole criterion for selecting projects; different organizations may have different opportunities or business drivers.

• Alignment between business and engineering is crucial, as it helps avoid overspending or overdesigning projects that support overall business goals.

• The first step is weeding out opportunities that are not aligned with the business approach before following the typical front-end loading process.

New Section

This section emphasizes the importance of feeding the pipeline of opportunities in order to select the best ones for a capital program.

Feeding the Pipeline of Opportunities

• Selecting the best opportunity, rather than just focusing on selecting the best project, ensures value creation for an organization.

• Following a typical front-end loading process helps identify and implement projects that support selected opportunities.

New Section

This section introduces another assurance tool called Project Definition Rating Index (PDRI) used at different stages of project development.

Project Definition Rating Index (PDRI)

• PDRI is a tool used at various stages of project development, such as concept selection, detailed scope, and full project authorization.

• Different variations of PDRI exist for different industries, including industrial, buildings and infrastructure, manufacturing and life sciences, mining, etc.

• PDRI assessments provide assurance and help determine readiness to move into the next phase of a project.

The transcript does not provide timestamps for the remaining content.

New Section

In this section, the speaker discusses the importance of realistic expectations for a scope of work and the decision-making process involved in project management.

Realistic Expectations and Decision-Making

• Realistic expectations include understanding the scope of work, cost, duration, and resource requirements.

• Gates are used to make decisions on whether to proceed with a project or not.

• Stopping a project early can be beneficial for owners as it allows them to reassess other opportunities in their portfolio.

• The PDRI (Project Definition Rating Index) provides an unbiased viewpoint on the level of definition and maturity of a project's deliverables.

• PDRI also helps assess accuracy and inputs in project planning.

• Projects that are less mature or accurate may result in substantial cost savings if identified early.

New Section

This section focuses on mindset shift and exploring alternative opportunities based on new information.

Mindset Shift and Exploring Alternatives

• It is important to have a mindset that allows for exploration of alternative opportunities when one project does not meet business expectations.

• The PDRI helps provide more realistic information about projects at different stages of maturity.

New Section

This section explains the concept of PDRI and its benefits in assessing project maturity and accuracy.

Understanding PDRI

• The PDRI provides an unbiased assessment of a project's level of definition and maturity.

• It helps measure the accuracy of inputs in project planning.

• Projects with higher maturity levels tend to be more accurate, resulting in better decision-making.

New Section

This section highlights the cost implications associated with project maturity and accuracy.

Cost Implications

• Projects that are less mature or accurate can result in significant cost differences compared to more mature and accurate projects.

• Following the PDRI process can lead to better and more realistic information for decision-making, regardless of whether a project proceeds or not.

New Section

This section discusses the key inputs and outputs for industrial projects' maturity assessment.

Key Inputs and Outputs

• The top nine key inputs for assessing project maturity in industrial projects include knowing the products, capacities, chosen technology, etc.

• These elements need to be solidified as the project progresses through different stages of maturity.

New Section

This section explains how accuracy is measured without redoing engineering work.

Measuring Accuracy

• Accuracy is challenging to measure directly without redoing engineering work.

• The PDRI measures inputs to accuracy rather than accuracy itself.

• Five key accuracy elements include team skill sets, leadership experience, front-end execution understanding, stakeholder management importance, and team commitment.

New Section

This section highlights additional factors influencing accuracy assessment.

Factors Influencing Accuracy Assessment

• Additional factors influencing accuracy assessment include leadership's experience with similar projects, contractor or engineer team experience with the location, and maintaining a stable team throughout the project.

• There are 27 elements that make up the accuracy scorecard used in assessing project accuracy.

New Section

This section explains how scoring is done for both maturity and accuracy assessments using a range from zero to five.

Scoring Methodology

• For maturity assessment, each element is measured on a scale from zero to five, with one indicating completion and five indicating not started.

• Accuracy assessment also follows a similar scoring methodology, ranging from high performing to not acceptable.

New Section

This section provides an overview of the different aspects covered in the maturity scorecard.

Maturity Scorecard

• The maturity scorecard covers various aspects such as reliability philosophy, maintenance philosophy, business objectives, technical design basis, etc.

• These elements help assess the level of project maturity and readiness for decision-making.

Understanding PDRI Ratings and Weighting

In this section, the speaker explains the differences between PDRI ratings and how they are weighted based on statistics. The importance of unbiased ratings is emphasized.

PDRI Ratings and Weighting

• PDRI ratings measure different elements of a project and are weighted based on their importance.

• Weighting ensures that certain elements have more significance than others.

• Unbiased ratings are important to get an accurate view of where a project stands.

• Each rating is based on specific criteria and definitions for each element.

• The recent change in PDRI includes more defined gradients between scores for each element.

Hiding Weights in PDRI Facilitation

This section discusses the practice of hiding weights during PDRI facilitation to avoid bias in rating. The goal is to provide an unbiased view of the project's status.

Hiding Weights in Rating

• Many facilitators hide weights during PDRI facilitation to prevent bias in rating.

• This approach ensures that participants rate elements without being influenced by their knowledge of weightings.

• The focus is on obtaining an objective assessment of the project's status.

Importance of Documentation and Communication in Maintenance Philosophy

The speaker emphasizes the importance of well-documented and well-communicated maintenance philosophy when assessing projects using PDRI.

Documentation and Communication in Maintenance Philosophy

• It is crucial to assess whether the maintenance philosophy is well-documented and effectively communicated.

• A score of three indicates that it is moderately satisfactory but not fully meeting expectations.

Changes in Definitions within Each Category

This section highlights changes made to definitions within each category, specifically focusing on the example of a plot plan.

Changes in Definitions within Categories

• The recent change in PDRI includes more specific definitions for each score within a category.

• For example, the definition of a plot plan now includes specific criteria instead of general descriptions like partially complete or majority complete.

Detailed Assessment and Scoring in PDRI

This section explains the level of detail involved in assessing projects using PDRI, with 72 questions and five potential scores for each.

Detailed Assessment and Scoring

• PDRI involves a detailed assessment with 72 questions and five potential scores.

• Each score represents a different level of completion or progress within each category.

• The definitions for each score are unique to ensure accuracy in assessment.

Application of PDRI to Renovation Projects

This section discusses how PDRI can be applied to renovation or revamp type projects, with specific considerations mentioned at the bottom of the scoring sheet.

Application to Renovation Projects

• The same criteria used for traditional projects can be applied to renovation or revamp type projects.

• Specific considerations for renovation projects are mentioned at the bottom of the scoring sheet.

• The tool is designed to be simple to use, based on Excel, allowing users to adjust scores easily.

Scoring Process in PDRI Facilitation

This section explains how scoring is done during PDRI facilitation using either arrow buttons or directly through an Excel spreadsheet.

Scoring Process

• Scoring can be done during PDRI facilitation using arrow buttons on the scoring sheet.

• Alternatively, users can directly input scores into an Excel spreadsheet provided.

• Both methods allow for easy adjustment and calculation of overall scores.

Four Main Areas for Accuracy Assurance

This section highlights four main areas that need to be addressed for accuracy assurance in projects.

Four Main Areas for Accuracy Assurance

• Research indicates that four main areas need to be addressed for accuracy assurance.

• These areas include the environment, information accuracy, budget accuracy, and time allocation.

• A total of 27 questions are used to assess these areas.

Timing of Accuracy Assessment

This section discusses the timing of accuracy assessment and suggests that it is better applied early in the project to allow for adjustments.

Timing of Accuracy Assessment

• Assessing accuracy early in the project allows time to address any issues or make improvements.

• Late assessment may not leave enough time for adjustments, leading to potential problems during project execution.

• It is recommended to assess accuracy at the end of phase two or beginning of phase three.

Importance of Providing a Positive Environment for Efficiency

This section emphasizes the importance of providing a positive environment through accurate assessments to enhance efficiency and minimize rework.

Providing a Positive Environment for Efficiency

• Accurate assessments help create an environment that allows teams to work efficiently with minimal rework.

• The goal is to provide conditions that support productivity by addressing accuracy concerns early on.

• PDRI facilitation at specific phases ensures recognition and adjustment if needed.

Construction Readiness and Deliverables

This section mentions that construction readiness will have similar considerations as PDRI but focuses on deliverables specific to construction projects.

Construction Readiness and Deliverables

• Similar considerations as PDRI will apply in assessing construction readiness.

• The focus will be on ensuring all necessary deliverables are in place before starting construction.

Plotting Projects Based on Maturity and Accuracy

This section explains how projects can be plotted based on maturity and accuracy scores using a quadrant system.

Plotting Projects Based on Maturity and Accuracy

• Projects can be plotted based on their maturity and accuracy scores.

• A quadrant system is used, with high maturity and high accuracy in the top right, and low maturity and low accuracy in the bottom left.

• The goal is to achieve high maturity and accuracy for successful project execution.

The transcript provided does not include specific timestamps for each section. Therefore, the timestamps mentioned in the summary are approximate and may not align exactly with the content of the transcript.

New Section

In this section, the speaker discusses the importance of high accuracy and maturity in project deliverables. They explain how the PDRI (Project Definition Rating Index) can be used to assess gaps and risks in project maturity. The speaker emphasizes the need for realistic assessments and the value of the scoring aspect in making informed decisions.

Importance of Accuracy and Maturity

• High accuracy indicates a good set of inputs or conditions for obtaining reliable information.

• Maturity level determines the quality of deliverables.

• The PDRI maturity score helps identify gaps and areas that require improvement.

• By closing these gaps, projects can achieve better quality assessments.

Realistic Assessments and Independent Perspective

• It is important to take PDRI assessments seriously and not manipulate scores.

• An independent team can provide a different perspective on project maturity.

• Project teams may have biased views on their own maturity levels.

Value Proposition of PDRI

• The scoring aspect is valuable but not the ultimate goal.

• Going through the PDRI process raises awareness about potential gaps and risks.

• PDRI helps make informed decisions at project gates based on accurate assessments.

New Section

In this section, the speaker presents metrics from projects plotted using PDRI. They discuss how different levels of maturity and accuracy impact project outcomes, including budget performance. The speaker highlights the value proposition of using PDRI to make realistic assessments at project gates.

Metrics from Projects Plotted with PDRI

• Projects with low maturity and low accuracy tend to go over budget (22% over budget).

• Projects with high maturity but low accuracy show improvement (6% over budget).

• Projects with high maturity and high accuracy tend to come in under budget (2% below budget).

Value Proposition of Using PDRI

• The value proposition of PDRI is to make informed decisions at project gates.

• PDRI helps identify the best opportunities for capital investment.

• Respect for project gates and their purpose is crucial.

• If a project's numbers do not support the business case, it should be reconsidered or canceled.

New Section

In this section, the speaker concludes the session by emphasizing the importance of making realistic assessments using PDRI. They highlight how PDRI enables decision-makers to evaluate project maturity and accuracy effectively.

Importance of Realistic Assessments

• PDRI allows decision-makers to assess project maturity and accuracy realistically.

• Projects that are not mature or accurate enough may require further assessment or consideration of other opportunities.

Measurement and Evaluation

• The measurement aspect of PDRI helps ensure that the right actions are taken at the right time.

• Regular evaluation using tools like PDRI ensures projects stay on track.

Conclusion

• The speaker reviews two tools discussed in this session: high accuracy and maturity assessment, as well as metrics from projects plotted with PDRI.

• Three more tools will be addressed in the next session.

Strategic Management

In this section, the speaker discusses the concept of strategic management and clarifies who "we" refers to in the context of the research team and business opportunity.

Interpretation of "We"

• The term "we" can be interpreted in two ways: as the research team or as those involved in the actual business opportunity.

• The research team consists of a combination of owners, contractors, consultants, and education providers.

• The focus is on aligning the interests of business people with engineering to ensure better outcomes.

Business Goals and Engineering Solutions

• Owners are primarily focused on selling products efficiently and increasing margins.

• Projects are necessary to build assets for producing these products.

• The goal is to align business expectations with engineering solutions to avoid conflicts later on.

Qualitative Focus Assurance

This section addresses a question about simplifying qualitative focus assurance and explains how tools like PDRI (Project Definition Rating Index) can be used for this purpose.

Simplifying Qualitative Focus Assurance

• PDRI is a simple tool that can be used for qualitative focus assurance.

• Conducting a PDRI assessment for a project can take half a day for smaller projects or a full day for larger projects.

• The value lies in honestly addressing the questions posed by PDRI to ensure completeness and maturity in decision-making.

PDRI vs. Design Assurance Tools

Here, the speaker compares PDRI with design assurance tools like DDQA (Design Development Quality Assurance) and CDDC (Conceptual Design Development Checklist).

Differences between PDRI and Design Assurance Tools

• Design reviews challenge completeness and interface between disciplines but continue throughout the project.

• PDRI takes a holistic view from a project management perspective.

• PDRI assesses design basis, including process engineering and mechanical design progress.

• PDRI also focuses on the alignment between business and engineering to avoid over or under-designing.

The speaker mentions "alphabet soup" in reference to the acronyms DDQA and CDDC but does not provide further details about them.

New Section

This section discusses the importance of the first section in the PDRI and how it carries a majority of the weight. It emphasizes the need for alignment with business objectives to ensure effective utilization of resources.

Importance of Alignment in PDRI (Project Definition Rating Index)

• The first section of PDRI holds significant weight, accounting for about half of the total points.

• Proper alignment with business objectives is crucial for effective utilization of capital.

• Designing the best solution is not enough if it does not align with the business goals.

New Section

This section addresses whether PDRI can be utilized in program management, specifically in projects with interacting elements. It also highlights the importance of breaking down large programs into individual projects within a portfolio.

Utilizing PDRI in Program Management

• PDRI can be used in program management by breaking down large projects into smaller, manageable components.

• Each component or project within a program can undergo a separate PDRI assessment.

• Interactions between different projects within a program are not addressed by PDRI alone.

• Sequence and maturity levels of each project should be considered to support a phased approach.

New Section

This section discusses whether any studies have been conducted to correlate project performance and business outcomes using various tools across different phases. It mentions ongoing or upcoming research on this topic.

Correlation Between Tool Scores and Project Outcomes

• No specific studies have been conducted yet to collate project performance and business outcomes using multiple tools across phases.

• Ongoing or upcoming research may focus on assessing how different tools, including PDRI, contribute to overall project success.

• The correlation between tool scores and end results is yet to be explored.

New Section

This section addresses the use of PDRI in validating the stage gate process. It mentions organizations that require a minimum score, such as 85%, to move out of a specific stage.

Validating Stage Gate Process with PDRI

• Some owner organizations use PDRI to validate progress through the stage gate process.

• Requiring a minimum score, such as 85%, ensures thorough evaluation and alignment with project objectives.

• The scoring metric provides a focus for improvement and decision-making during each stage.

New Section

This section concludes the discussion by highlighting the importance of scoring metrics and organizational culture in utilizing PDRI effectively.

Importance of Scoring Metrics and Organizational Culture

• Scoring metrics, like IPA's front-end loading index or customized PDRI scores, can be used to set thresholds for project authorization.

• The effectiveness of using PDRI or any other tool depends on the organizational culture and its willingness to embrace structured evaluations.

• Different organizations may have different approaches to incorporating scoring metrics into their decision-making processes.

New Section Understanding the Importance of PDRI in Project Evaluation

In this section, the speaker discusses the significance of PDRI (Project Definition Rating Index) in project evaluation and decision-making processes.

The Impact of PDRI on Project Assessment

• The speaker shares an example of a poorly executed project in the steel industry where the PDRI score was below the target value.

• It is highlighted that simply answering PDRI questions without thorough evaluation is not the correct behavior.

• While some organizations have specific score ranges for authorization, it is emphasized that the score alone does not determine project validity.

• PDRI is just one element used to evaluate projects, which also includes cost, schedule, and other parameters.

• If a project's PDRI score falls outside the acceptable range, additional work may be required before authorization.

Conclusion

The speaker concludes by thanking everyone for their time and expressing anticipation for future interactions.

Timestamps are provided based on available information.