| 1. |
|
What is Economic Appraisal and When is it required? |
| 1.1 |
|
What is Economic Appraisal? |
| 1.1.1 |
|
Economic Appraisal - hereafter referred to simply as "appraisal" - is a key tool for achieving value for money and satisfying public accountability requirements. It is a systematic process for examining alternative uses of resources, focusing on assessment of needs, objectives, options, costs, benefits, risks, funding, affordability and other factors relevant to decisions. Appraisal is:-
- designed to assist in defining problems and finding solutions that offer the best value for money (VFM).
- a way of thinking expenditure proposals through, right from the emergence of the need for a policy, programme or project, until its implementation.
- the established vehicle for planning and approving public expenditure policies, programmes and projects.
|
| 1.1.2 |
|
The principles of appraisal are applicable to all decisions, even those concerned with small expenditures. However, the scope of appraisal is very wide. It is about assessing VFM in terms of the national interest. Costs and benefits should generally cover all those falling on United Kingdom residents. It is also important to assess the specific regional impact on Northern Ireland. There is a role for narrower appraisals, for example of the commercial or financial impact upon a particular public body, but these should generally supplement an appraisal from a national or regional perspective, they should not generally be conducted instead of it.
|
| 1.1.3 |
|
The basic elements of appraisal are listed at 1.4 below and explained in the Section 2. Other sections elaborate on more specific aspects.
|
| 1.1.4 |
|
Good appraisal leads to better decisions and VFM. It facilitates good project management and project evaluation. Appraisal is not optional; it is an essential part of good financial management, and it is vital to decision-making and accountability.
|
| 1.2 |
|
When is Appraisal Required?
|
| 1.2.1 |
|
The principles of appraisal apply to all decisions and proposals involving expenditure or resources. They apply equally to policies, programmes and projects. DFP requires the principles of economic appraisal to be applied, with appropriate and proportionate effort, to all decisions and proposals for spending or saving public money, including EU funds, and any other decisions or proposals that involve changes in the use of public resources.
|
| 1.2.2 |
|
For example, appraisal must be applied irrespective of whether the relevant public expenditure or resources:
- involve capital or current spending, or both;
- are large or small;
- are above or below delegated limits.
Examples of Decisions that Require Appraisal
| Policy and programme development |
Decisions on the level and type of services or other actions to be provided, or on the extent of regulation. |
| New or replacement capital projects |
Decisions to undertake a project, its quality, scale, location and timing, and the degree of private sector involvement. |
| Use or disposal of existing assets |
Decisions to sell land, or other assets, or relocate facilities or operations, whether to contract out or market test services. |
| Specification of regulations |
Decisions on the standards for health & safety, environmental quality, sustainability, or to balance the costs and benefits of regulatory standards and how they can be implemented. |
| Procurement decisions |
Decisions to purchase the delivery of services, works or goods, usually from private suppliers.
|
|
| 1.2.3 |
|
It is important to begin applying appraisal early in the gestation of any proposal that has expenditure or resource implications. The justification for incurring any expenditure at all should be considered. Appraisal should be applied from the emergence of a need right through to the recommendation of a particular course of action. It should continue to be applied, where applicable, in the subsequent assessment of bids from the private sector obtained through a tendering process, until a contract is awarded.
|
| 1.2.4 |
|
Retrospective appraisal, that is, going through the motions of appraisal after decisions have been taken or expenditure committed, is bad management practice. Appraisal should not be used merely as the means to refine the details of a predetermined option, or to provide post hoc justification for decisions or actions already taken.
|
| 1.2.5 |
|
Approvals in principle should not be granted, nor should commitments to funding be given (e.g. through a Letter of Offer), prior to the completion of a satisfactory appraisal and business case. The importance of appraisal to the approval process is elaborated in Section 9.
|
| 1.2.6 |
|
Appraisal reports contain information on the relative merits of different potential investments. Departments should use the results of appraisals as an input to the prioritisation of their spending plans.
|
| 1.3 |
|
Appropriate and Proportionate Effort
|
| 1.3.1 |
|
Appraisal itself uses up resources. The effort that should go into it and the detail to be considered is a matter for case-by-case judgement, but the general principle is that the resources to be devoted to appraisal should be in proportion to the scale or importance of the objectives and resource consequences in view. Similar principles apply to ex post evaluation.
|
| 1.3.2 |
|
Judgement of proportionate effort should take into consideration the totality of the resources involved in a proposal. However, particular weight should be given to the total public funds (including EU funds) involved, since it is primarily for these that public bodies are accountable to the taxpayer.
|
| 1.3.3 |
|
It is also important that the appraisal is appropriate in the sense that the correct methodology is used and tailored to suit the case in hand, because there are variations in how the steps of appraisal apply in different spending areas. Judging this is a matter of experience and Departmental economists should be consulted where there is any doubt.
|
| 1.3.4 |
|
Irrespective of the amount of effort applied, appraisals should normally seek to take account of all the costs and benefits arising from a proposal, whether they fall to the public sector or to other sectors of the economy. This is because the general aim is to make best use of all the resources in the economy. However, some appraisals are more restricted in scope, as is explained at 1.5 below.
|
| 1.3.5 |
|
Appraisal is a way of thinking which is indispensable even when dealing with small amounts of expenditure or resources. It is always appropriate to establish the need for a proposed expenditure or change of resource use, consider alternative options, and weigh up the costs and benefits of the alternatives. However, small scale decisions do not require as much appraisal or evaluation as larger scale decisions. Appendix 1 - Appraisal and Evaluation of Small Expenditures provides practical advice on how to decide the proportionate appraisal effort when dealing with small expenditures, including the use of pro formas.
|
| 1.4 |
|
Basic Elements of Appraisal
|
| 1.4.1 |
|
Appraisal may take various forms. Appendix 2 - Comparison of Economic, Commercial and Affordability Appraisal explains the main forms of economic appraisal and how it is distinguished from commercial appraisal. However, irrespective of the precise form of an appraisal, a number of basic elements are common to most of them. The following ten key steps should generally be addressed:
- explain the strategic context
- establish the need for expenditure
- define the objectives and constraints
- identify and describe the options
- identify and quantify the monetary costs and benefits of each option
- assess risks and adjust for optimism bias
- weigh up non-monetary costs and benefits including New TSN and Equality
- calculate Net Present Values and appraise uncertainties, including appropriate sensitivity analysis
- record proposed arrangements for financing, management, marketing, procurement, monitoring and post project evaluation
- assess the balance of advantage between the options and present the results and conclusions
|
| 1.4.2 |
|
Where funding of the private or voluntary sectors is in view, then, in addition to the ten key steps, assessment of the following three criteria is also a basic appraisal requirement:
- additionality
- viability
- cost-effectiveness
|
| 1.4.3 |
|
These basic steps are summarised in a fuller checklist on pages 9 & 10 above. Section 2 is devoted to explaining the ten key steps in more detail. Section 3 explains them in relation to policy appraisal. Section 4 explains additionality, viability and cost-effectiveness, and expands on the appraisal of funding of the private, voluntary and community sectors. The particular requirements for certain cases such as PPP, IT and accommodation projects are explained in subsequent sections.
|
| 1.5 |
|
Other Forms of Appraisal
|
| 1.5.1 |
|
Other forms of appraisal may be required in addition to an economic appraisal. For example, an affordability appraisal is generally required. (See section 2.9.2 for elaboration). Another example is the necessity to assess the commercial viability of proposals when appraising assistance to the private, voluntary and community sectors, as is explained in Section 4 below. This normally includes assessment of the general financial position of the applicant, consideration of its management capability, marketing appraisal, identification of relevant financial cash flows, and calculation of NPVs on a commercial appraisal basis.
|
| 1.5.2 |
|
The differences between economic appraisal and commercial appraisal can be a cause of confusion. Appendix 2 - Comparison of Economic, Commercial and Affordability Appraisal of the NI Practical Guide defines the main forms of economic appraisal, lists some common errors in appraisal and explains how economic appraisal is distinguished from commercial appraisal. It also includes a checklist to help identify what items to include in each. Commercial appraisal calculations, where required, should normally be done separately from, and in addition to, the calculation of NPVs on an economic appraisal basis.
|
| 1.5.3 |
|
A commercial appraisal, or affordability appraisal, or any other appraisal of some specific aspect of a proposal, should never be seen as an alternative to an economic appraisal covering the ten steps listed at 1.4 above.
|
| 1.6 |
|
Management of Appraisals and Evaluations
|
| 1.6.1 |
|
Appraisal and evaluation are stages in the general management of projects, programmes and policies. Responsibilities for carrying out appraisals and evaluations should be clearly defined. Departments should ensure that appropriate procedures are in place, and that they are properly applied and kept up to date. It is essential that staff engaged in PE and resource decisions recognise the need to undertake appraisal and evaluation, seek specialist help where appropriate and ensure that appraisals and evaluations are carried out.
|
| 1.6.2 |
|
Conducting an assessment can be resource-intensive. Appraisals and evaluations should be carried out collaboratively wherever possible between stakeholders, but lead responsibilities need to be well defined, and accountability for accuracy and thoroughness clearly understood. Carrying out assessments should never be regarded as a specialist activity, and therefore sidelined.
|
| 1.6.3 |
|
It should generally be the responsibility of policy and executive divisions to take the lead in carrying out appraisals, drawing on expert advice, where appropriate.
|
| 1.6.4 |
|
In order to ensure an independent and objective approach, evaluations should be led by individuals or teams who have had no responsibility for or involvement in the management or implementation of the proposal under consideration. However, they must have the co-operation of those who have been involved and possess the necessary information.
|
| 1.6.5 |
|
Departments and Agencies should consider how appraisals and evaluations are integrated with decision-making processes and governance structures. To ensure a coordinated approach to conducting assessments, the Green Book encourages consideration of:
- Establishing formal evaluation or assessment units, or other centres of technical expertise;
- Formalising access to internal and external auditors. In complex cases, it may be helpful to discuss appraisal methodology with sponsor departments, DFP or the Northern Ireland Audit Office;
- Providing incentives for conducting thorough and timely appraisals; and evaluations; and
- Maintaining an accessible archive.
|
| 1.6.6 |
|
For individual assessments, early consideration should be given to:
- The availability and cost of financial and specialist resources that may be needed;
- The possible need for quality assurance, for example, by economists and other experts and by service providers;
- How the findings are to be disseminated (e.g. publication of assessments; dissemination via web sites, etc);
- The possibility of deferring a proposal pending further research; and,
- Establishing a project plan for the assessment, setting out key milestones, resources and work streams.
|
| 1.6.7 |
|
Economists within your Department have an important role to play. They can advise on the full range of issues relating to business cases, including for example appraisals, feasibility studies, business plans and evaluations. They can supply advice on the appropriate techniques to use, help to draft terms of reference, provide quality assurance, assist with the selection and management of external consultants and help to undertake relevant analysis. Where possible, those undertaking appraisals, evaluations and other studies should be independent of those quality-assuring them.
|
| 1.6.8 |
|
It is particularly important to involve economists in the more costly, complex or contentious cases before committing resources to them. Departments should consult their economists in all cases requiring DFP approval, and should take account of their views before submissions are made to DFP.
|
| 1.7 |
|
Issues Relevant to Appraisal and Evaluation
|
| 1.7.1 |
|
The Green Book refers to a wide range of generic issues that may need to be considered as part of any assessment. The following list should be checked for relevance to options under appraisal, and used for later evaluations:
- Strategic impact - new proposals can be said to have strategic impacts on organisations if they significantly affect the whole or major part of an organisation over the medium to long term. Proposals should therefore be considered in terms of their potential scale of impact, and how they fit in with the strategy of the organisation(s) they affect.
- Economic rationale - proposals need to be underpinned by sound economic analysis, which should be provided by a cost benefit analysis in an option appraisal. See NI Practical Guide sections 2.1 & 3.1.3, and Green Book Chapter 5.
- Financial arrangements and affordability - proposals need to be affordable, and an affordable financial plan needs to be developed. See NI Practical Guide section 2.9 and Green Book Chapter 6
- Achievability - all proposals should be assessed for their achievability, and recognised programme and project management arrangements set up as necessary. See NI Practical Guide section 10 and Green Book Chapter 6.
- Commercial and partnering arrangements - proposals need to take account of commercial, partnering and procurement arrangements; what can be delivered in the market; how costs and benefits can be guaranteed through commercial arrangements; how contracts will be managed through to completion. See NI Practical Guide section 5 and Green Book Chapter 6.
- Regulatory impact - the impacts of new proposals on businesses, voluntary sector and charities should be assessed. A regulatory impact assessment (RIA) is a policy tool that assesses the impact, in terms of costs, benefits and risks of any proposed regulation that could affect businesses, charities or the voluntary sector. It is Government policy that all government departments and agencies where they exercise statutory powers and make rules with general effect on others must produce an RIA. They should also produce an RIA for proposed European legislation that will have an effect on businesses, the public sector, charities or the voluntary sector in the UK. Although the trigger for producing an RIA is that the proposal could affect businesses, charities or the voluntary sector, the RIA itself should cover the full range of economic, social and environmental effects, in line with the Green Book methodology. Guidance on RIA is available at http://www.cabinet-office.gov.uk/regulation/ or via the OFMDFM Integrated Impact Assessment website http://www.ofmdfmni.gov.uk/policylink-integrated-impact-assessment.
- Legislation - consideration should be given to legislation specific to the case in hand, as well as statutes that affect many proposals, such as the Human Rights Act, or the Data Protection and Freedom of Information Acts.
- Information management and control - The information requirements of proposals, including the data needed for later evaluation, and the supporting IT that may be required. Further guidance is available from BDS.
- Environmental impacts - The effects on the environment should be considered, including air and water quality, land use, noise pollution, and waste production, recycling and disposal. Further guidance is available from DOE and at http://www.ofmdfmni.gov.uk/policylink-integrated-impact-assessment.
- Rural issues - The government is committed to ensuring that all its policies take account of specific rural circumstances. Appraisers should assess whether proposals are likely to have a different impact in rural areas from elsewhere. Further guidance is available from DARD and at http://www.ofmdfmni.gov.uk/policylink-integrated-impact-assessment.
- Equality - Impacts on various groups in society should be considered as part of an appraisal. The NI Practical Guide section 2.7.13 describes how equality and other distributional issues should be brought into the appraisal process.
- Health - the impacts of proposals on health should be considered, and evaluation made of the impact on health of poverty, deprivation and unemployment, as well as poor housing or workplace conditions. DHSSPS can provide advice on Health Impact Assessment.
- Health and safety - the health and safety of people at work or arising from work activity may need to be safeguarded. Obviously this is of particular concern in construction. HSENI (Health and Safety Executive for Northern Ireland, DETI) and CPD (Central Procurement Directorate, DFP) can provide further advice.
- Consumer focus - Assessments may need to involve consideration of the cost and quality of goods and services, as well as access to, choice of, and information about them. See The Policy Hub website http://www.policyhub.gov.uk
- Regional perspectives - The Policy Hub provides guidance on how regional perspectives are best incorporated into the policy making process.
- European Union - It will often be important to take account of proposals and activities in other European Union countries, as well as specific legislation and regulations. State aid rules are particularly important to consider, as these prescribe the extent to which government can intervene. DFP's European Division can provide general advice on EU matters. DETI's Policy Services Unit advises on State Aid - see section 4.8 below.
- Design quality - The design quality of facilities can be important in ensuring that objectives are successfully achieved. See the Commission for Architecture and the Built Environment (CABE) website http://www.cabe.org.uk Further advice can be provided by DCAL and DFP's Central Procurement Directorate (CPD).
|
