What Is Scrum and What Is Agile?

There’s a lot of confusion about “What Is Agile” and “What Is Scrum?”. This article provides a very brief explanation.

Loose terminology is a big source of this confusion. For example, many people use the word “Agile” when they really mean “Scrum”.

What is Scrum?

Difference Between Agile and Scrum

For that reason, it is important to clearly understand the difference between Agile and Scrum. Here’s the difference:

If you want to learn more about Agile, check out this article on “What Is Agile – How Would You Define It? – What Does It Really Mean?”

What is Scrum?

Here’s the official explanation for “What is Scrum” from the Scrum Alliance:

“Scrum is a process framework used to manage product development and other knowledge work.

Scrum is empirical in that it provides a means for teams to establish a hypothesis of how they think something works, try it out, reflect on the experience, and make the appropriate adjustments.

That is, when the framework is used properly.

Scrum is structured in a way that allows teams to incorporate practices from other frameworks where they make sense for the team’s context.” – Agile Alliance

What Is a Framework?

Many people will say that it is inaccurate to call Scrum a “methodology” and that it really is a “framework”. What’s the difference? Here are a two key differences:

  • A “framework” is not very prescriptive and is normally adapted to fit a situation
  • A “methodology” is more prescriptive and provides a specific and well-defined approach for arriving at a solution

Empirical versus Defined Process Models

A related factor to understand the difference between a “framework” and a “methodology” is the difference between an “empirical” process model and a “defined” process model:

Defined Process Model

A “Defined Process Model” attempts to define every piece of work in advance in order to develop a detailed plan for completing the work. There are two very important characteristics of a Defined Process Model:

  • Repeatable – A Defined Process Model will produce the same outputs every time for the same set of inputs
  • Predictable – The results of a Defined Process Model are predictable in advance

For example, the diagram below shows a figurative depiction of a defined process using a well-defined methodology that is repeatable:

Defined Process Model

A traditional plan-driven project management approach as defined in PMBOK and a Waterfall model are examples of methodologies that follow a Defined Process Model.

Empirical Process Model

An “Empirical Process Model” is a style of work that leverages the principles of inspection, adaptation, and transparency. For that reason, an Empirical Process Control Model works best where the result that is needed is uncertain and the process to produce the result may also be not well-defined.

The diagram below shows a figurative depiction of how an empirical process model works. Basically, the process is not as well-defined and uses an incremental and iterative process based on some level of experimentation to try to arrive at an optimum solution.

Empirical Process Model

A key point is that in an empirical process model, you’re not really sure exactly what the solution will be and you’re also not exactly sure of what the optimum process for arriving at a solution is. Scrum is an example of an empirical process model.

Key Differences

The key difference between the two process models is related to the level of uncertainty in the project:

Low Level of Uncertainty

With a relatively low level of uncertainty, a defined process model might work best especially if there is a goal of being predictable because it is a predictable and repeatable model.

  • To achieve predictability, you would typically use a Defined Process Model because all of the work can be planned in advance
  • A Defined Process Model may also be more efficient because the work can be planned and organized in advance

For example, you would be very likely to use a Defined Process Model if you were building a house where it is important to have some predictability over the costs and schedule for completing the house.

Higher Level of Uncertainty

With a higher level of uncertainty, an empirical process model might work best because it provides a more adaptive approach for arriving at an optimum solution.

  • It may be less efficient than a Defined Process Model because it may require more trial-and-error but
  • It is much more likely to produce a more optimum solution, especially in an uncertain environment.

For example, if you set out to find a cure for cancer or some other disease that has no known cure, the solution is probably not well-known when you start the project and it likely requires some level of experimentation to arrive at at an optimum solution.

How Does Scrum Work?

Scrum uses an empirical process model that continuously refines both the product and the process to produce the product as the project is in progress. For that reason, Scrum works best in an uncertain environment.

Scrum Is Incremental

A Scrum process breaks up all the work into short development increments called “sprints”

  • Sprints are limited to a fixed-length that is normally 2-4 weeks long
  • The Product Owner prioritizes all work based on business value. That enables the team to deliver value as quickly as possible

Scrum Is Also Iterative

At the end of each sprint, the Product Owner and any important stakeholders review the results of the sprint and provide feedback and inputs

  • Providing direct feedback and inputs is essential to optimize the solution
  • Reviewing the results at the end of each sprint enables rapid learning for ongoing continuous improvement

Additional Resources

This is only a very brief, high-level overview of Scrum. If you want to learn much more detailed information, check out my Online Agile Project Management Training Courses. The first course is free!

Who Gets Blamed When an Agile Project Fails?

Have you ever thought about “When an agile project fails, who gets blamed”? I thought it was a very interesting question.

Who Gets Blamed When an Agile Project Fails?

How Does an Agile Project Fail?

It’s actually difficult for an Agile project to fail.

  • An Agile project typically does not have rigid cost and schedule goals that must be met and
  • An Agile/Scrum process has the capability to detect and correct potential failures early

Given that, an Agile/Scrum project should be self-correcting if it is done properly. For example, at the end of each sprint:

  • There is a Sprint Review to detect problems with the product
  • There is a Sprint Retrospective to detect and correct process problems

An Agile project should provide early warning of a potential failure with plenty of opportunity to correct any problems before the end of the project. At the end of each sprint, both the product and the process to produce the product are reviewed and corrected if necessary. If an Agile process fails, the process must have broken down somewhere; and rather than looking for an individual to blame, a more appropriate response would be to figure out what went wrong in the process to prevent it from happening again.

Fail Early, Fail Often

One of my favorite Agile mantras is “fail early; fail often”. People should not be afraid of failure and should see failure as an opportunity for learning. That is very important in an environment that is designed to support creativity and innovation. If senior management is looking for someone to blame, that’s not very consistent with an Agile culture.

How to Prevent Failure in an Agile Project

It’s relatively easy to prevent failure in an Agile project – its mostly a matter of:

  • Implementing the process effectively including Sprint Reviews and Sprint Retrospectives with an emphasis on continuously improving both the product as well as the process for producing the product as the project is in progress
  • Designing and implementing an enterprise-level transformation to align the Agile development approach with the company’s business and to create a culture that is supportive of an Agile approach

The important point is that their should be:

  • Everyone in the organization should have a spirit of shared ownership and partnership and be committed to the success of the project instead of an “arms-length” contractual relationship between the business and the project team
  • The business sponsors and users actively participate in the project in a spirit of partnership as the project is in progress to provide feedback and inputs as the project is in progress

Additional Resources

You will find much more detail on this in my Online Agile Project Management Training.

Applying Agile to Non-Software Projects – Agile Home Remodeling

A number of my students have requested some case studies that show applying Agile to non-software projects. As an example, I recently completed a home remodeling project which may seem simple and trivial; but believe me, it was not.

Applying Agile to Non-Software Projects

It is possible to apply Agile to almost any project but that doesn’t necessarily mean using Scrum. And, it certainly doesn’t mean just going through the rituals of doing Scrum mechanically. Applying Agile principles and figuring out how to apply them to non-software projects can be very challenging.

Background

I have been a project manager for a long time. I’ve managed large, complex multi-million dollar projects; but nothing compared to a recent project to do a major remodeling of the kitchen in our house. The project involved:

  • Knocking down a wall that separated the kitchen from the rest of the house to create a more open environment
  • Ripping up the concrete floor to re-route electrical and plumbing connections
  • Replacing all of the existing kitchen cabinets and appliances
  • Installation of new lighting fixtures
  • Moving the entrance-way to the master bedroom to be more consistent with the new floor plan
  • Removing a pantry and replacing it with a new pantry cabinet which required knocking down a wall and moving an intercom system
  • Repainting the entire area and many other cosmetic enhancements

Why was this project so difficult?

  • My wife was the major stakeholder in the project, she is a perfectionist, and she has a habit of changing her mind frequently about what she wants. (Her response to that is “She doesn’t change her mind, she just decides as she goes along”)
  • Multiple outside contractors did all of the work in this project
  • A major challenge was to try to manage the costs and schedule of this project within reasonable levels

Contractor Selection

The first task was to select a contractor (or contractors) to do the work. I had several choices:

Contractor “A”

Contractor “A” was the most widely-known contractor in this area. They advertise widely on television and have a good reputation for delivering a high-quality result. They would also take full responsibility for the overall solution. However, their approach is fairly rigid and controlled. Once you sign a contract with them, it is very difficult to make any changes.

Contractor “B”

Contractor “B” was much less widely-known but offered much more flexibility and willingness to work with on a design that was customized to meet our needs. They would also take overall responsibility for managing the overall solution.

Contractor “C”

Contractor “C” offered the most flexibility to meet our needs but was actually two different contractors. It was not really possible for either of them to take overall responsibility for the overall solution

  • One contractor did the demolition and prep work including electrical and plumbing to prepare the new kitchen
  • Another contractor provided the kitchen cabinets and counter-tops. They installed them after the initial demolition and prep work had been completed
  • Following the installation of the cabinets and counter-tops, the original contractor returned to do the finish work. That work included final installation of new lighting fixtures and repainting of the entire area

Choosing a Contractor

Selecting a contractor was difficult:

  • Contractor “A” was probably the lowest risk choice from a traditional project management perspective. It would require less management on my part but offered little flexibility to adapt the solution to meet our needs
  • Contractor “C” was the highest risk and involved coordinating the work of two different contractors. However, they offered the most flexibility to meet our needs
  • Contractor “B” was a compromise between those two extremes. They had the advantage that they were a single contractor who would take overall responsibility for the solution. However, their costs were considerably higher than Contractor “C”

Final Contractor Selection

We chose contractor “C” because flexibility and adaptivity to meet our needs was so important; even though contractor “C” had the highest risk and might be the most difficult to manage. However, these two contractors had a history of working together successfully on other similar projects. I also had a good feeling that I could trust and partner with these individuals to manage the overall solution. That was a key difference:

  • With contractor “A”, we would have relied on a very clear and well-defined contract to deliver the solution. However, we would have little or no flexibility to make changes (That’s what many people might call “Waterfall”)
  • Contractor “C” had a statement of work but it was understood to be flexible and subject to change. The relationship relied on a spirit of trust, partnership, and collaboration (This relationship was much more similar to Agile)

How Did the Project Work Out?

This was a difficult effort to manage.

The scope of the project changed numerous times

My wife decided that we couldn’t remodel the kitchen without replacing all the living room furniture and carpets. And, of course, other changes to the rest of the house became necessary as well which included:

  • Repainting the master bedroom,
  • Replacing pictures and reupholstering other furniture. and
  • Enhancements to other areas of the house

Nailing down the design requirements was very difficult

As I mentioned, my wife changes her mind frequently, and insists on perfection in the end-result. We looked at many different kinds of granite counter-tops and many different floor tiles before making a final selection. There were also many times when a “final selection” changed before it really became a “final selection”

This Was a Project Management Nightmare

This was not a large project but it was one of the most difficult ones that I have ever had to manage. For a traditional plan-driven project manager, this would have been a nightmare attempting to control all of these changes. It is also very challenging to be caught in the middle between a very demanding stakeholder and contractors who have to deliver the work within a given cost.

However, this is a perfect example on a small scale of what an Agile Project Manager has to do. You have to learn how to balance flexibility and adaptivity to maximize the business value of the solution with some level of planning and control,

What Were the Results?

The project turned out to be enormously successful

  • The whole project was completed in a little over three weeks from the time the work started
  • It went over the budget that that we expected to spend but the costs were still at a reasonable level
  • Most importantly, my wife was delighted with the way it came out and she is the most important stakeholder I needed to satisfy.

Finished Result

Here’s a picture of what the finished kitchen looked like:

The New Finished Kitchen

Work-In-Progress

Here’s a couple of pictures taken during the work-in-progress leading up to finishing the kitchen:

Tearing Down the Wall to the Old Kitchen
Ripping Up the Concrete Floor to Re-route Plumbing and Electrical

Overall Conclusions and Lessons Learned

Here are some of the important conclusions and lessons learned from this project:

  • Agile principles and values can be applied to some extent to almost any project. However, it requires some skill to interpret these principles and perhaps combine them with traditional project management practices.
  • The overall value that the project delivers is what is most important. The key stakeholder determines “value”. Cost and schedule goals have some value but are only one component of value and not necessarily the most important,
  • A spirit of trust and partnership is important even in a contractual situation. Over-dependence on a traditional contractual relationship can severely reduce flexibility and impact the value that the solution provides.
  • Risk management is important but attempting to minimize and over-control risk can also impact the value of the solution. Taking risks may be necessary to maximize the value of the solution.

How Does This Apply to a Business Situation?

I know this is an unusual situation but I like to use unusual situations. I think it encourages “out-of-the-box” thinking rather than viewing standard, stereotypical Agile case studies. The following is a summary of how I think these lessons-learned can be applied to a business situation:

Contractual Relationships

Most businesses could not survive without some kind of contractual relationships with outside contractors. In addition, many businesses have significant supply chains that are critical to the success of their business.

  • Typically, a firm, fixed-price contract and a competitive bidding process among multiple bidders is used to get the lowest possible price.
  • That is a relatively low-risk approach from a cost-management perspective but doesn’t necessarily result in the best overall solution.
  • When there is a lot of uncertainty in the requirements, a different approach is needed to maximize the business value of the solution. It requires a collaborative partnership with a contractor to work together to maximize the value of the solution is essential

Trust

Developing that kind of relationship with contractors requires trust. For that reason, it will not be possible to develop that kind of relationship with just any contractor. That’s why it is important for a business to have strong relationships with a selected number of contractors who can be regarded as close partners.

Risk Management

I took a risk by going with contractors that I thought were the highest risk from a project management perspective. However, that risk paid off in terms of the overall quality of the solution. A similar thing is true in a business environment. Many times you have to take a risk to maximize the value of the solution.

Productivity

The project was completed in a very short time once the work was started. That was largely due to the fact that I empowered the contractors to get the job done the best way they knew how and I didn’t attempt to micro-manage what they were doing. Conventional project management might attempt to more directly manage the work being done.

Additional Resources

You will find much more detail on this in my Online Agile Project Management Training.

Why Is Planning So Difficult? Is It a Waste of Time?

Why is planning so difficult? A lot of people seem to think that planning is very difficult and some think it is a waste of time because even very well-thought-out plans often don’t work out as expected. This issue is important because it is at the crux of selecting a methodology and planning approach for a project. Do I use Agile or plan-driven (aka Waterfall)?

Why Is Planning So Difficult?

Why Is Planning So Difficult?

Many people seem to think of planning as an “all-or-nothing” proposition – either you develop a highly-detailed plan or you do no planning at all. I don’t believe that to be the case. There seems to be two major problems associated with why people have this difficulty with planning:

Dealing With Uncertainty

Many people seem to have difficulty dealing with an uncertain environment – they want things to be crystal-clear, black-and-white and, in an uncertain environment, they think that it is a waste of time to do any planning at all.

Unrealistic Expectations

A related factor is that many people develop unrealistic expectations about planning.

  • If you develop a well thought-out plan, they expect that it should work every time.
  • Many people are also unrealistic that everything about a project will go absolutely perfectly all the time and
  • Murphy’s Law often contradicts that belief.

Planning Fundamentals

Let’s review some fundamentals about planning. We can learn a lot about how the military does planning.

Planning in the Military

Here are a few of my favorite quotes on planning in the military:

Plans are nothing; planning is everything”  – (Dwight D. Eisehhower)

What Eisenhower is saying is that documented plans should not be considered to be sacrosanct. When people document a written plan, the plan often takes on a life of its own and it becomes the “gospel” that everyone is expected to follow rigidly. However, that should not be the case and that’s not a reason to not do any planning at all. Here are a couple of examples:

  • It would be foolish for a military unit to go into battle without doing any planning at all. You should take advantage of whatever intelligence you might have about the enemy positions (as uncertain as it might be) but you shouldn’t lose sight of the uncertainty in that information.
  • In an American football game (or any other sport you want to choose), the coach prepares his team for what he thinks the strengths and weaknesses of the opposing team are; but, again, that planning is based on very uncertain information and lots of assumptions.

Here’s another quote along the same lines:

“No battle plan survives contact with the enemy”  (Helmuth von Moltke the Elder)

What Helmuth von Moltke is saying is that you shouldn’t expect that a plan won’t change at all once you start to execute it.

An Example

In World War II, Churchill and Roosevelt spent years planning the invasion of Europe that ultimately resulted in the Allied forces landing in Normandy on June 6, 1944. Both men knew that an invasion of Europe was the only way that the war could be won but there was a lot of uncertainty about:

  • Where should the invasion take place? How can the Allies preserve the element of surprise?
  • What’s the best way to do it? What are the odds of it being successful?
  • How many deaths and casualties can be expected?

This was a huge decision that had enormous impact:

  • The fate of Europe and most of the free world at that time depended on this being successful
  • Both men faced some level of opposition at home knowing the large number of casualties to be expected

It took a lot of courage to do this planning and make a decision under these circumstances knowing that there was a lot of uncertainty in the situation and the impact of the decision was so enormous. However, planning was essential – can you imagine what might have happened if the invasion was attempted without any planning at all?
Source: Churchill and Roosevelt Spent Years Planning D-Day

What Does This Have to Do With Agile?

This whole issue about planning is at the crux of the controversy about “Agile versus Waterfall”. Many people see the choice between Agile and Waterfall as a binary and mutually-exclusive choice and planning is at the center of this controversy:

  • Some people in the Agile community might say that its a waste of time to do planning in an uncertain environment and you should just use an Agile approach and let the project plan evolve as the project is in progress
  • Some people in the traditional plan-driven project management community might say that it would be foolish to attempt to do a project of any significant scope without a detailed plan for it to be successful

The truth is somewhere between those extremes – it’s not an “all or nothing” choice and you should adapt the methodology and the level of planning to fit the nature of the project. The level of uncertainty in the project is a big factor in making that choice. In an uncertain environment, it might be foolish to attempt to develop a highly detailed plan but uncertainty is never an absolute and it would be equally foolish not to take advantage of whatever information you might have.

How Do You Put This Into Practice?

A lot of people might see “Agile” and “Waterfall” as totally incompatible with each other. It’s like mixing oil and vinegar – they just don’t mix well. And, if you look at this from a mechanical process perspective, that might be true.

In order to learn how to blend these two approaches together in the right proportions to fit a given situation,

  • You have to understand both approaches at a deeper level and get past some of the strong stereotypes that exist about both “Agile” and “Waterfall”.
  • It’s really a choice of selecting a more plan-driven approach or a more adaptive approach based on the level of uncertainty in the situation and there is a whole spectrum of alternatives as shown below:
Levels of Agility

Rather than thinking of “Agile” and “Waterfall” as binary and mutually-exclusive choices and trying to force-fit a project to one of extremes, a better approach is to fit the methodology to the nature of the project and the level of uncertainty and the planning approach is a major factor in making that determination

Overall Summary

Here’s a summary of the key points I want to make in this article:

  1. Planning is not an “all or nothing” proposition
    • The planning approach should be directly related to the level of uncertainty in the environment
    • Planning in an uncertain environment can be difficult but that should not be an excuse for not doing any planning at all
    • However, to quote Eisenhower, “A plan is nothing – planning is everything” – don’t get locked into thinking that a written plan is sacrosanct and doesn’t need to be changed to adapt to the level of uncertainty in the environment
  2. The level of uncertainty and the planning approach is probably the most important factor in selecting a project management approach for projects
    • Rather than thinking about “Agile” and “Waterfall” as binary and mutually-exclusive alternatives,
    • Its more accurate and more objective to think of a spectrum of alternatives from heavily plan-driven at one extreme to heavily adaptive at the other extreme

Additional Resources

You will find much more detail on this in my Online Agile Project Management Training.

Agile Project Management for Executives

I have just released a new online training course called “Agile Project Management for Executives”.

Agile Project Management for Executives

The Agile Bandwagon

In many areas, “Agile” is becoming a hot new buzz word and everyone wants to jump on the “Agile bandwagon”. They may not fully understanding why they’re getting into it and exactly what they expect to get out of it. In addition, many companies also make the mistake of assuming that whatever is good for the development process is good for the business as a whole and that is not necessarily the case.

Agile Bandwagon

Agile Project Management for Executives Course Summary

Agile has huge potential benefits for a business; however, it is easy to get carried away with some of the hype that exists about Agile. To avoid that, it is important to develop an objective understanding of its benefits and limitations to know how and when to apply it successfully. The right approach is to not necessarily to just implement Agile for the sake of becoming Agile, but figure out how it’s going to help your business and what problems it will solve. The typical questions and challenges this poses for business managers and executives are:

  • How do I reconcile an Agile development approach with my existing business management and project management processes?
  • Do I need to unravel all of my existing management processes in order to adopt an Agile development approach?

This course will help you answer those questions. It also includes assessment tools and planning tools that are designed to help you develop a very effective Agile Project Management approach that is very well-aligned with your business.

Intended Audience

There are three potential audiences for this course:

1. Senior-level Executives

The first audience is senior-level executives who want to make their business more agile. The course will help develop a well-integrated approach to fit an Agile development process to their business

2. Business Sponsors

The next audience is Business Sponsors of an Agile initiative who want to learn more about Agile Project Management. The course will help them prepare to provide more effective leadership for the initiatives that they are responsible for

3. Product Owners

The final audience is for Agile Product Owners.  Many of the people who are selected to perform that role are not well-prepared for what it requires and the role is not well-understood. The course will help them to better understand how to effectively perform the Agile Product Owner role

Why Is This Course Unique and Important?

For many years, many people have treated Agile as a development process. However, in recent years it has become apparent that the implementation of Agile as a well-integrated, enterprise-level business strategy is not well-understood.

1. Business Perspective

A lot of the Agile training that exists today is very focused on implementing Agile as a development process and on the “mechanics” of how to do Scrum. There is a relatively weak focus on Agile from a business perspective. For example, my own Certified Scrum Product Owner certification was heavily focused on the “mechanics” of how to do Scrum. It didn’t really directly address the role of the Product Owner as a business decision-maker at all.

2. Objective, Pragmatic Approach

This course is not a sales-pitch for Agile. It recognizes that there is not a binary and mutually-exclusive choice between “Agile” and “Waterfall” as many people seem to think. Instead, it objectively presents Agile and traditional plan-driven project management approaches as complementary to each other rather than competitive.

3. In-depth Training

This course is not a superficial seminar on how to implement Agile. It is a very substantive, university-level course that is over four hours long. It provides a very in-depth understanding of Agile from a business perspective

4. Complementary to Agile Project Management Approach

This course is also designed to complement all of my Agile Project Management courses. Implementation of Agile at an enterprise-level requires a collaborative partnership between a business executive and a senior-level Agile Project Manager. That relationship should be based on a mutual understanding of how an Agile approach might apply to their business.

Additional Resources

You will find much more detail on this in my Online Agile Project Management Training.

What Are the Critical Skills of a Product Owner in Agile?

I recently participated in an online discussion on the question of “What are the Critical Skills of a Product Owner?” This is a very good question because the role of a Product Owner is not very well-understood. The actual role that a Product Owner plays can vary significantly in the real-world depending on the nature of the company’s business and the scope and complexity of the projects that the Product Owner is responsible for.

What are the Critical Skills of the Product Owner?

What Does the Scrum Guide Say?

The Scrum Guide defines the role of the Product Owner. However, it recognizes that the role varies widely across organizations. Here’s what the Scrum Guide has to say:

“The Product Owner is responsible for maximizing the value of the product resulting from work of the Development Team. How this is done may vary widely across organizations, Scrum Teams, and individuals.”

“The Product Owner is the sole person responsible for managing the Product Backlog. Product Backlog management includes:”

  • Clearly expressing Product Backlog items;
  • Ordering the items in the Product Backlog to best achieve goals and missions;
  • Optimizing the value of the work the Development Team performs;
  • Ensuring that the Product Backlog is visible, transparent, and clear to all, and shows what the Scrum Team will work on next; and,
  • Ensuring the Development Team understands items in the Product Backlog to the level needed

“The Product Owner may do the above work, or have the Development Team do it. However, the Product Owner remains accountable.”

Impact of the Nature of the Company’s Business

The nature of the company’s business will have a very big impact on the role of the Product Owner. In this regard, there are two major types of companies that are most significant:

  • Product-oriented Companies
  • Project-oriented Companies

Product-oriented Companies

Product-oriented companies who are in the business of selling products to external customers are at one extreme. In those companies, a Product Owner may have the full responsibilities of a Product Manager, including product profit-and-loss responsibility.

In this world, the critical skills of a Product Owner are essentially the same as the skills of a good Product Manager

Project-oriented Companies

At another extreme, are companies that are not really in the product development business at all. The work is more project-oriented to develop projects for internal use inside the company. In that kind of environment, the role of a Product Owner is likely to be very different. What is typical in this role is the role of the Product Owner is somewhat of a combination of a “Business Analyst on steroids” and a “Project Manager on steroids”.

Product Manager versus Business Analyst Role

A Product Owner has some attributes of a Business Analyst:

  • Both have a responsibility to represent the requirements of the business solution, but the Product Owner role is much more than an ordinary Business Analyst. A Product Owner has decision-making responsibility on the requirements where a normal Business Analyst does not have that kind of authority. 
  • The Product Owner also has some attributes of a Project Manager as he/she is responsible for the successful completion of the project. That responsibility is also much more than a normal Project Manager. A Project Manager is normally responsible only for delivering defined requirements without responsibility for the overall project’s business success. 

Critical Product Owner Skills

In this world, the critical skills of a Product Owner are:

  • Business Analysis Skills – Some “Business Analyst” skills are necessary for succinctly and accurately defining requirements but also have the domain knowledge and business knowledge to be a decision-maker to determine and prioritize what those requirements should be
  • Project Management Skills – Some “Project Management” skills are necessary to make good risk-based decisions on managing the project to make it successful from an overall business perspective (not simply meeting defined requirements)
  • Overall Management Skills – Above all else, the Product Owner is ultimately responsible for the success or failure of the project from a business perspective. He is an important decision-maker and is sometimes referred to as the “CEO of the project”.

Impact of the Scope and Complexity of the Project

Beyond the nature of the company’s business discussed above, the role of the Product Owner can also vary widely due to the scope and complexity of the project.

  • At one extreme, you might have a small, single-team Agile project with a very limited scope and complexity
  • At another extreme, you might have a much larger and more complex enterprise-level project with multiple teams

Naturally, that will also have a very big impact on the role of the Product Owner.

What Does a Product Owner Really Do?

So, what does a Product Owner really do? Here’s a very good article on that subject:

The Top 10 Responsibilities of a Product Owner

Additional Resources

You will find much more detail on this in my Online Agile Project Management Training.

What Are the Advantages and Disadvantages of Agile and Scrum?

I have often been asked “What are the advantages and disadvantages of Agile/Scrum?” so I thought it would be useful to summarize what I believe are the most important advantages and disadvantages.

Advantages and Disadvantages of Agile/Scrum

Advantages of Agile/Scrum

1. Flexibility and Adaptivity

An Agile/Scrum approach is best-suited for a relatively uncertain environment. In that kind of environment:

  • It is very difficult, if not impossible, to accurately define the requirements and design for the solution in detail prior to the start of the project
  • Flexibility and adaptivity are essential to further define and elaborate the requirements and design of the solution as the project is in progress

2. Creativity and Innovation

In the highly competitive environment that we live in today, no one wants to buy average, run-of-the-mill products.  People expect a higher level of excellence and that requires creativity and innovation.  An Agile/Scrum approach emphasizes creativity and innovation to maximize the business value of the solution. An over-emphasis on planning and control tends to stifle creativity and innovation.

3. Time-to-Market

An Agile/Scrum approach typically results in faster time-to-market due to shorter startup times. An incremental development effort will also allow early delivery of at least a portion of the solution without the entire solution to be 100% complete

4. Lower Costs

An Agile/Scrum approach can lower the costs of a project in several ways:

  • Significantly reduced overhead resulting from reducing unnecessary documentation and control requirements
  • Higher productivity of the project team
  • Reduced “feature bloat” from using an incremental development effort and prioritizing the requirements. Using that approach, it will become apparent when the project begins to reach a point of diminishing returns where the incremental value of the features no longer exceeds the incremental development cost

5. Improved Quality

In an Agile/Scrum project, quality is an integral part of the development process rather than a sequential activity.  The developers know that quality is not “someone else’s responsibility”

6. Customer Satisfaction

An Agile/Scrum approach should result in higher customer satisfaction and more effective solutions because the customer is heavily involved in providing feedback and inputs throughout the development process

7. Employee Satisfaction

An Agile/Scrum approach should also result in higher employee satisfaction from all employees that are engaged in the effort because they are much more engaged to take responsibility for their own work as part of an empowered team

8. Organizational Synergy

An Agile/Scrum approach can improve organizational synergy by breaking down organizational barriers and developing a spirit of trust and partnership around organizational goals.

Disadvantages of Agile/Scrum

1. Training and Skill Required

An Agile/Scrum approach requires a considerable amount of training and skill to implement successfully.  Many project teams don’t fully understand the need for training and skill or don’t want to put the effort into it. They attempt to do Agile/Scrum mechanically without fully understanding the principles behind it and that is typically not very effective

2. Organizational Transformation

An Agile/Scrum approach may also require some level of organizational transformation to make it successful.  It require the business users to work collaboratively with the development team in a spirit of trust and partnership.  That may require breaking down some organizational barriers that make that difficult or impossible to do

3. Scalability

It can be difficult to scale an Agile/Scrum approach to large, complex projects.  There are some models for doing that (Scrum-of-Scrums, LeSS, and SAFe are examples) but none of those are a cookbook solution that are easy to implement.

4. Integration with Project/Program Management

An Agile/Scrum approach may not be totally appropriate for projects that require a more plan-driven approach to achieve some level of predictability. However, there are many ways to create a hybrid approach that blends a traditional plan-driven approach and an Agile/Scrum approach in the right proportions to fit the situation

Overall Summary

Agile is not a “silver bullet” and it is not a solution to every problem you might have. However, if Agile is applied intelligently in the right situations, it has huge advantages and the advantages can easily outweigh the disadvantages.

Additional Resources

You will find much more detail on this in my Online Agile Project Management Training.

What Is Distributed Project Management? Why Does it Make Sense?

“Distributed Project Management” is a new approach to project management.   Here’s a brief overview of what it is all about.

What is Distributed Project Management?

“Distributed Project Management” is very important to help people see the relationship of “project management” and Agile in a very fresh new perspective.  It has the potential to redefine many of the heavily-ingrained notions that we have about what “project management” is.

What Is Distributed Project Management?

There are a number of people in the Agile community that believe that “project management” is not consistent with Agile.

  • Some people have said that “project management is antithetical to Agile”. 
  • That opinion is based on a very narrow and stereotypical view of what “project management is that has been well-ingrained into our minds for years. 
  • In that view, all project management functions are typically done by a single person called a “Project Manager”.

I think it is time to take a broader and more modern view of what “project management” is.

How Is Project Management Implemented in an Agile Team?

There is actually a lot of “project management” going on in an Agile environment, but many people won’t recognize it as “project management” because:

  1. It’s a different kind of project management, and
  2. The project management functions have been distributed among multiple people on the team

1. It’s a Different Kind of “Project Management”

We need to broaden our thinking about what project management” is 

  • The traditional view is based heavily on planning and control to achieve predictability over project costs and schedules.  
  • A more modern and broader view of “project management” is based on delivering business value. 
    • That doesn’t mean that meeting cost and schedule goals is unimportant.
    • Achieving cost and schedule goals is only one component of business value and not necessarily the most important component. 
    • Creativity and innovation to maximize the value of the solution can be at least equally important

2. The Project Management Functions Have Been Distributed Among the Team

The functions that would normally be performed by someone called a “Project Manager” at the team level have been distributed among other members of the team.  As a result, you typically may not find anyone at the team level in an Agile project called a “Project Manager”.

In an Agile team, everyone on an Agile team has some kind of responsibility that might normally be performed by someone called a “Project Manager”:

Product Owner Role

The Product Owner comes closest to the overall responsibilities of a project manager:

  • He/she has overall responsibility for the success or failure of the project.
  • However, the Product Owner role actually goes beyond a project management role
  • It is more like a product manager role with overall business responsibility for the project
Developer Role

Developers have responsibility for:

  • Planning and managing their own work,
  • Reporting on progress, and
  • Integrating their work with others on the team
Scrum Master Role

The Scrum Master is responsible for:

  • Facilitating the work of the team,
  • Coaching the team in Agile practices and
  • Removing any obstacles that might be impeding the team’s progress

A project manager in a traditional plan-driven environment would normally perform those functions.   A “Distributed Project Management” approach distributes these functions among multiple people.

Why Does This Make Sense?

In the environment we live in today:

  • Solutions can be much more complex and the level of uncertainty can be much higher. That makes it very difficult, if not impossible, to completely define a solution prior to the start of a project. 
  • That environment requires a much more flexible and adaptive approach.
  • In that environment, it is essential to further elaborate the requirements and the design of the solution as the project is in progress.
  • That calls for a very different approach to project management.

Distributing the project management functions among the different Agile team roles provides a much more dynamic approach.  

  • Instead of centralized control where all decisions are made by a project manager;
  • Decision-making is more decentralized among the various roles on an Agile team
    • The team, as a whole, is self-organizing and empowered
    • That approach is very well-suited for an environment with a high level of uncertainty

What’s the Impact on Traditional Project Managers?

This approach may be threatening to many traditional project managers because, in many cases,

  • It could eliminate the role of a project manager at the team level in an Agile project, and
  • It also could require a significant adaptation for many project managers who are used to being in control of a project.

At the team level, if a project manager is involved in an Agile project at all, he/she may play more of a coaching and mentoring role rather than a management and control role.  There is a much more significant role for project managers for:

  • Larger and more complex projects that require multiple teams and
  • Projects that require a hybrid approach such as Agile contracts.

For the project management profession to continue to thrive, we need to recognize this fundamental shift in thinking and develop a broader vision of what “project management” is.

Additional Resources

You will find much more detail on this in my Online Agile Project Management Training.

How Do You Choose the Best Methodology for a Project?

I often see questions on “How do you choose the best methodology for a project?”

choose the best methodology for a project

Is There a Best Methodology for a Project?

I don’t think that there is one single “best” methodology that works for all projects.  A lot of people make the mistake of force-fitting a project to some standard methodology.

  1. Some project managers will try to use a traditional plan-driven methodology for a project (what many people loosely call “Waterfall”).
    • It may be the only project management approach that they know.
    • It has also been widely-accepted as the only way to do project management
  2. Many other people have the misconception that there is a binary and mutually-exclusive choice between “Agile” and “Waterfall”. As a result, they will attempt to force-fit a project to one of those extremes

The “best” approach is to go in the other direction and fit the methodology to the nature of the project. 

  • That takes more skill but it definitely can be done
  • You should also recognize that there is not a binary and mutually-exclusive choice between “Agile” and “Waterfall”
  • There is a whole spectrum of different approaches ranging from heavily plan-driven at one extreme to heavily adaptive (or Agile) at the other extreme
Range of Agility

Factors to Consider

There are a number of factors that influence the selection of the best approach for a particular project.

1. Level of Uncertainty

First and probably the most significant factor in choosing an approach, is the level of uncertainty in the project. A project with a high level of uncertainty would be best-suited for a more adaptive (Agile) approach. Attempting to force-fit such a project to a traditional plan-driven project management approach could be disastrous.

  • It would force you to make a lot of assumptions to try to resolve the uncertainty; and, in many cases, those assumptions may be wrong and require a lot of re-planning and possible re-work
  • The emphasis on planning and control in a traditional plan-driven project is not conducive to changes. That will make it difficult to maximize the value of the solution in an uncertain environment

2. Need for Creativity and Innovation

Next, in today’s competitive environment, creativity and innovation can be very important to create very competitive business solutions. An approach with a heavy emphasis on planning and control can stifle creativity and innovation.

3. Customer Relationship

Finally, managing customer expectations is probably one of the most critical aspects of any project.  If the results of a project are not consistent with customer expectations, the project will likely not be viewed as successful no matter how good you think it is.  The nature of the customer relationship can range between:

A. Contractual Style of Relationship

A contractual style of relationship is where there are very definite and well-defined customer expectations that must be met.  In this type of relationship, the customer may not take any responsibility for the success of the project.  The customer defines requirements and expects the project team to do whatever is necessary to meet those requirements. In this style of relationship, there is limited participation by the customer in the project

Naturally,  the contractual style of relationship is well-suited to a project with a relatively low level of uncertainty. It must be possible to define the customer’s requirements in some level of detail prior to the start of the project.  It would be much more difficult to make a contractual-style relationship work in a project with a high level of uncertainty.

B. Collaborative Style of Relationship

A collaborative style of relationship is where there is a shared responsibility for the success of the project. In this environment both the project team and the customer take an active role in defining the direction of the project as it is in progress

What’s the Right Style of Relationship?

Of course, the customer has to be amenable to whatever type of relationship you choose.  If the project has a high level of uncertainty, that would lean towards more of a collaborative relationship; however:

  • The customer has to be open to that kind of relationship for it to be successful. 
  • This is a big problem in many companies where it is difficult to break down organizational boundaries between organizations
  • It requires establishing truly collaborative relationships based on a spirit of shared responsibility, trust, and partnership.

3. Project Team Capabilities

The final major factor in selecting a project approach is, of course, the capabilities of the project team.   

  • An Agile approach requires a lot of training and skill and a hybrid Agile approach  can require even more training and skill. 
  • Naturally, it does not make any sense to choose an approach that the team is not capable of implementing.

Why Is This Important?

There are two major factors that require us to broaden the way we think about “project management” today:

  • Solutions tend to be much more complex and the level of uncertainty is much higher
  • Competitive pressures frequently require much higher levels of creativity and innovation

For those reasons, force-fitting all projects to a standardized plan-driven approach is not necessarily the best approach for all projects.

Overall Summary

A project should be focused on producing value for the customer and its very important to understand what “value” means to the customer:

  • First of all, meeting cost and schedule goals is only one component of value, and it may not be the most important component of value to the customer
  • Second, there have been many projects that have met their cost and schedule goals but failed to deliver an acceptable level of business value
  • Finally, “Value” can be a very elusive goal but, in any case, it’s what the customer thinks that “value” is that counts

There is no “best” process. Saying that “Agile is better than Waterfall” is like saying “A car is better than a boat”. Both have advantages and disadvantages depending on the environment you’re in:

When Does an Agile Approach Work Best?

An Agile model tends to work best in projects where:

  • There is a relatively high level of uncertainty and a flexible and adaptive approach is needed to resolve the uncertainty as the project is in progress
  • Creativity and innovation are needed to maximize the business value of the solution

When Does a Plan-driven Approach Work Best?

A traditional plan-driven model (what many people loosely call “Waterfall”)  tends to work best where:

  • There is a relatively low level of uncertainty, the solution is well-defined, and some level of planning and control are needed to maximize predictability of costs and schedules
  • The organization is not really  well-prepared to implement an Agile approach and/or the project team is not trained in Agile

Additional Resources

You will find much more detail on this in my Online Agile Project Management Training.

In addition, you may also be interested in the following articles related articles:

Why is Change Management in an Agile Transformation important?

Why is Change Management for an Agile transformation so important? Implementing an Agile transformation can require a big shift in thinking and possibly also require changing a well-established corporate culture for many companies.  That is not an easy thing to do and it requires some skill and planning to do it successfully.

The Need for Change Management in an Agile Transformation

In general many companies need to move from an excessive emphasis on planning and control to a more flexible and adaptive approach with more emphasis on creativity and innovation in a very uncertain environment.  That requires:

  • Developing a spirit of trust and partnership among all parts of the organization at every level
  • Breaking down organizational barriers that might prevent a collaborative, cross-functional approach
  • Developing a clear, unifying vision for the organization that creates a common purpose that is well-aligned with the company’s business objectives

Why Is Change Management Difficult?

Those are not easy things to accomplish and creating lasting organizational change is difficult.  People resist change and will naturally revert back to the old, comfortable way of doing things if the change management effort is not successful.

Change Management in an Agile Transformation

Kotter’s Change Management Principles

The best source on this is John Kotter’s book “Leading Change”. Kotter identifies eight errors that companies make in change management initiatives:

1. Allowing Too Much Complacency

This probably could be better stated…it isn’t necessarily a matter of “allowing too much complacency”. The real issue is that if there isn’t a feeling of urgency for making a significant change, it will be difficult to get support for making the change.

2. Failing to Create a Sufficiently Powerful Guiding Coalition”

Overall leadership is extremely important – all the key leaders have to be on board with making a broad-based, cross-functional change and providing the guiding leadership to make it happen.

3. Underestimating the Power of Vision

A clear vision is needed for what the organization will look like after the change is complete. If there is no vision, it will be difficult to guide the change in the right direction.

4. Under-communicating the Vision

Major change is usually impossible unless most employees are willing to help, often to the point of making short-term sacrifices. But people will not make sacrifices, even if they are unhappy with the status quo, unless they think the potential benefits of change are attractive and unless they really believe that a transformation is possible.”

5. Permitting Obstacles to Block the New Vision

The important points that Kotter brings up are:

  • Implementation of any kind of major change requires action from a large number of people
  • New initiatives fail when employees, even though they embrace a new vision, feel dis empowered by huge obstacles in their paths
  • Occasionally, roadblocks are only in peoples’ heads – In many cases, the blockers are very real

6. Failing to Create Short-Term Wins

Many times the best approach is to not take on too much at once but focus on some short-term wins that show progress.

7. Declaring Victory Too Soon

  • People can be tempted to declare victory in a major change effort with the first major performance improvement
  • While celebrating a win is fine, any suggestion that the job is mostly done is generally a terrible mistake
  • Until changes sink down into the company culture(3-10 years) new approaches are fragile and subject to regression

8. Neglecting to Anchor Changes Firmly in the Corporate Culture

Culture and values are extremely important – if people are simply mechanically implementing the change without any real change in corporate culture and values to support it, the change may be somewhat fragile and not long-lasting.

Three Most Critical Principles

All eight of the issues that Kotter has defined are important, but from my experience, there are three that are most critical that most frequently derail an Agile transformation.  These are:

1. No Burning Platform

This is based on Kotter’s first error “Not Creating a Sense of Urgency”.  There needs to be something that creates some urgency about making a change because maintaining the current situation is very painful and untenable.The phrase “burning platform” originated with a fire on an oil-drilling platform off the coast of the United Kingdom some years ago.  The phrase can have several contexts –

  • One context was that there were serious safety issues with the platform that were not addressed until the platform caught fire because there didn’t seem to be a sufficiently urgent need to address them.

  • Another context was that once the platform was on fire, there was an urgent need for the employees to do something to save their own lives – staying on the platform at that point was an untenable situation.

2. No Vision for the Future

This is based on Kotter’s third error “Underestimating the Power of Vision”.  Taking the time to define a vision for an Agile transformation is extremely important – many people make the mistake of using a one-size-fits-all approach to force-fit a company to some kind of “textbook” model.The best approach is to fit the model to the company’s business and a pure, top-to-bottom Agile approach may or may not be the best fit.  It may require more of a hybrid approach to achieve that kind of alignment, at least in the short-term.

3. Failing to Show Short-term Progress

This is based on Kotter’s sixth error “Failing to create short-term wins”.  There are always naysayers and skeptics who will remain on the sidelines waiting to see if the change is likely to be successful before they jump on the bandwagon.  That is why it is important to get started and demonstrate progress as quickly as possible.  From an Agile perspective, it is important to set clearly-defined and measurable goals that show progress and regularly communicate that progress to everyone involved.

Overall Summary

Implementing Agile successfully at an enterprise-level many times requires a significant transformation. That can be a difficult thing to do and it requires some understanding of change management to do it successfully. It is actually very similar to a business process reengineering project.

Additional Resources

You will find much more detail on this in my Online Agile Project Management Training.

Blending Agile and Traditional Project Management