Committee
Audit Committee, 25 Jun 2008
25 Jun 2008 · S3 · Audit Committee
Item of business
“Review of major capital projects in Scotland—How government works”
Mr Black:
Watch on SPTV
This is the first systematic review of publicly funded major capital projects in Scotland. The scale of capital investment in Scotland's public sector is substantial, and it is growing. When we conducted the review, more than 100 major projects were in progress, with a programme value planned to reach £10.5 billion by 2011 as new projects come on stream.The Scottish Government, its agencies and non-departmental public bodies, and the national health service completed 43 projects in the five years up to March 2007. We looked at the performance of all of those in respect of costs, the time taken and the quality of what was specified.In addition, we looked at 15 current projects. I emphasise that the report provides a snapshot in time for those 15 projects. The Audit Scotland review took place between October 2007 and February 2008, and the projects will have moved on since then. For example, one of the projects reviewed was the Stirling-Alloa-Kincardine rail link, which as we all know is now fully operational.It is also worth commenting on the long gestation period for such major projects. Most projects took more than two years from initial approval to completion and, in some cases, the time was longer—some projects started before devolution. The guidance on how to estimate costs and on project management has evolved since then and some of the projects would be approached differently if they were being started now. We need to be aware of that context.I will highlight the report's main findings under three headings: the performance of completed projects; the performance of projects that are still in progress; and project management and governance issues.First, I will talk about the performance of completed projects. Any project has two key decision points. The first is when the project is given the go-ahead. The early cost and time estimates on which key decision makers base the initial project approval must be as accurate as possible. I shall return to that in a moment, because that is one of the report's main findings on the early stage in the life of projects. The second key decision point for any project is shortly before a contract is awarded. Once a contract is agreed, significant changes to a project are likely to be costly and disruptive and may threaten value for money.Exhibit 2 in the key messages summary and exhibit 5 on page 12 of the main report illustrate the main findings of that part of the work. They show that, in general, the achievement of cost and time targets improved significantly as projects progressed. Initial estimates of time and cost were often too optimistic, but the general picture is of improvement when contracts are awarded.Four fifths of projects were completed within 5 per cent of the contract price. The combined final cost for all completed projects—about £800 million—was just 1 per cent more than the combined contract price when the contracts were let.The project team did not analyse reasons for cost and time variances for all 43 projects, but it examined five completed projects in some detail. Exhibit 7 on page 13 shows three completed projects with large cost increases—they are marked with red traffic lights. Most cost increases are attributable to inaccurate cost estimates, but external factors contribute from time to time. One example of an unforeseeable external factor was the need for the scope of the Beatson oncology centre project to be changed to comply with new regulations on radioactive materials that were imposed after the London bombings in 2005.As I hinted, the main area of weak performance that the report highlights is the unreliability of initial forecasts at the project approval stage. Only about two fifths of all projects were completed within the costs that were estimated when the projects were initially approved. For 25 projects whose cost estimates were too low, the final cost was on average 39 per cent higher than the initial estimate. The risks will be clear to committee members: more projects will be started than can be afforded; and the rising costs that are encountered as projects are implemented will crowd out other highly desirable projects that are due to start later. Therefore, I have recommended that the Scottish Government and public bodies improve early cost estimating and planning.I will not talk about performance against time in the same detail. Suffice it to say that a similar picture of overoptimistic initial forecasts of timescales applies, but that estimates of the likely completion date when contracts are awarded are much more reliable. The phenomenon is equally evident in relation to time as it is to cost.There is good evidence that public bodies get the projects that they have specified. However, more could be done to assess the outcome of projects and to show the benefits to the public. For example, few projects reported using measures such as design quality or environmental performance. Almost half of projects had not been evaluated after completion to assess whether the benefits had been achieved and had justified the investment.I turn to projects that are in progress. Clearly, it is not possible to report on the results of projects that are in progress, because audit has perfect hindsight and imperfect foresight. Given that more than 100 projects, worth nearly £5 billion, are currently in progress, it would be impractical to examine every one. However, the project team did assess the progress of a sample of 15 on-going projects against the same criteria of time, cost and quality. Those projects had a combined estimated cost of almost £2 billion, which amounts to about 38 per cent of the combined value of all on-going projects. The team looked at at least one project in each of the main Scottish Government portfolios.As I mentioned, my report provides a snapshot, and the status of projects will have moved on since the time of the assessments. Nine of the projects that we examined had reached the main contract stage and three have subsequently done so. Given that they have reached that stage, there should be an increase in the certainty of the cost estimates that are now being applied. However, four of the current projects had significant increases in project costs before reaching the contract stage.The two projects affected by the largest increases were both transport projects. The first is the project to complete the M74 in Glasgow. At the time of our report, the latest cost estimate was £692 million. The second was the £85 million Stirling-Alloa-Kincardine rail link. The cost of both of those projects has more than doubled since the original project approval and both have been significantly delayed. Given the size and importance of those projects, we have included a more detailed summary of the progress of each between pages 22 and 24 of the report. We did not carry out a full, detailed audit of those specific projects, but the team did sufficient work to provide a high-level picture of the history of both projects for the committee's information. Both projects are now the responsibility of Transport Scotland, but I emphasise that both projects predate the establishment of Transport Scotland, which came into existence in 2006. Transport Scotland inherited the projects. It immediately assumed responsibility for the M74 project when it was established, and it took on the Stirling-Alloa-Kincardine rail link in August 2007.I turn finally to project management and governance. Good project management and governance are essential to deliver projects to cost, time and quality. Although room for improvement exists in some areas, the general conclusion in the report is positive. Overall, project management and the governance of individual projects are broadly effective. We give examples in the report of the Scottish Prison Service and Transport Scotland completing large and ambitious programmes within the contract costs.However, in general, there is a need for improvement in the early stages of a project and, in particular, as I have said, in the early cost and time estimating. The report also highlights the scope to improve project appraisals and to ensure that good quality business cases are prepared for every project.One of the issues that we touch on is competition. The report highlights difficulties in attracting competition in some projects, despite a sound approach being taken in most cases. That is due in part to increasing national and international demand for contractors. Projects are also experiencing higher levels of inflation in construction costs, which reflects the high demand for construction services. The current market means that there is a risk that suppliers might be less willing to compete for capital projects. Looking ahead, I think that there might be risks if the public sector does not adjust to those changing market conditions.The Scottish Government has been taking steps to strengthen the strategic oversight and control of the capital programme, which is a commitment that it inherited from the previous Administration. I encourage the Scottish Government to continue to strengthen leadership, co-ordination and management of investment programmes throughout Scotland. One of the significant benefits of that is that it would help the Scottish Government to ensure that its investment programme as a whole is properly matched to the capacity of the market to deliver projects, so that competition is achieved.I make a number of recommendations throughout the report, which are brought together on page 5 of the key messages and repeated on page 4 of the main report. Most of those are intended to reinforce existing good practice and are directed at the Scottish Government and public bodies in general.In addition, we have done a lot of detailed work behind that, and Audit Scotland is publishing on its website a more detailed good-practice checklist that will, we hope, help public bodies to identify whether any action is needed to improve the management and governance of any current major projects.I hope that the report is a useful contribution to public reporting on the performance of major capital projects. There is a requirement for regular and consistent public performance reporting in such a large and important area of public spending. It is interesting and significant that the report is the first to bring all the information together. As ever, my colleagues and I are happy to answer any questions that the committee may have.
In the same item of business
The Convener:
Lab
For item 2, I invite the Auditor General to introduce the Audit Scotland report on major capital projects.
Mr Robert Black (Auditor General for Scotland):
Good morning. Before I start, I ask Barbara Hurst to draw to your attention one or two small textual errors in the report. This is the first time that such e...
Barbara Hurst (Audit Scotland):
We apologise for the errors in the report. They are minor proofing errors; nevertheless, they should not have happened. They are in part 3, which is on proje...
The Convener:
Lab
Sorry—which paragraph is that?
Barbara Hurst:
It is in the second key message on page 19.That should actually read that nine projects had awarded the main construction contract and three have since reach...
George Foulkes (Lothians) (Lab):
Lab
May I ask one question? Are all of the projects that we are talking about directly funded projects under the old system? There are no private finance initiat...
Mr Black:
That is right.
George Foulkes:
Lab
Thank you—I wanted to be clear about that.
Mr Black:
This is the first systematic review of publicly funded major capital projects in Scotland. The scale of capital investment in Scotland's public sector is sub...
The Convener:
Lab
There are clearly some serious issues, with implications for not only the short term but the long term. I am intrigued by your saying, for example, that over...
Mr Black:
Expertise is an important issue. At various points in the report, we highlight the absolute importance of having good project management and good advice for ...
Murdo Fraser (Mid Scotland and Fife) (Con):
Con
The report is interesting and there is a lot of meat in it that we must consider. I will examine some of the conclusions on page 12 in part 2, which examines...
Mr Black:
The advice that I am getting from the team is that the lessons that come out of the report are indeed being taken seriously. In my opening remarks, the messa...
Angela Cullen (Audit Scotland):
We echo the Auditor General's opening remark that the long duration of some of the projects, from the early estimates to where they are now, has not helped. ...
Murdo Fraser:
Con
Thank you; that is helpful. I have another question on a slightly different subject. Mr Black, in your response to George Foulkes's question, you said that a...
Mr Black:
Unfortunately, I regret to say that we cannot really answer that question because an audit of all PFI projects would be a significant task in its own right. ...
Murdo Fraser:
Con
Nevertheless, it would be a very interesting and useful piece of work, particularly given the current political debate.
Mr Black:
There has been a lot of academic and specialist research on the subject over the years. In the interests of helping the committee, I invite Dick Gill, who is...
Dick Gill (Audit Scotland):
As Robert Black has said, a lot of research has been done into the performance of PFI projects in the public sector in the United Kingdom. To use a bit of a ...
Willie Coffey (Kilmarnock and Loudoun) (SNP):
SNP
I would like to ask Mr Black a couple of questions on project planning and the outturn side of projects. In your report, you say that a clear need exists to ...
Mr Black:
Your first point concerned when projects are specified and put together. We make the straightforward recommendation that a well-specified outline business ca...
Angela Cullen:
Part 4 of our report concerns project planning and how to improve early estimates, and it highlights some of the things that the Auditor General has mentione...
Willie Coffey:
SNP
What about the use of quality standards, methods and tools? We have seen a couple of frightening examples—there was no provision for inflation in one project...
Mr Black:
I might ask the team to help answer the question about quality standards. We make the general point that there is insufficient evidence that quality standard...
Angela Cullen:
It is exhibit 13, on page 29.
Mr Black:
Exhibit 13 is not dreadfully scientific, but it essentially shows construction cost inflation compared with general inflation. It highlights the absolute nee...
Dick Gill:
We have not made specific recommendations about public bodies adopting specific quality standards. A number of the bodies that we looked into had formally ad...
The Convener:
Lab
Mr Gill said that with PPP we get what it says on the tin—we know what we are getting. Mr Black referred to concern about inflation in construction costs. Wh...
Mr Black:
That is an extremely important issue. In exhibit 14, we tried to capture in a single table the six major procurement routes and their advantages and disadvan...
Jim Hume (South of Scotland) (LD):
LD
There has been inflation in the construction industry during the past 10 years. Figures A and B in exhibit 5 show the difference between projects' final outc...