Evaluation of Technology Programme for Soil and Groundwater Pollution Summary and conclusionsFrom July to November 2002, KPMG carried out an evaluation of the Danish Environmental Protection Agency's Technology Program for soil and groundwater pollution. The Environmental Protection Agency initiated the evaluation in order to obtain an overall view of the results of the program, knowledge sharing and possible effects and to collect information as to whether:
The evaluation contains several different data collection and analysis activities. The process and the evaluation elements chosen, of which questionnaires are the most frequently used, are illustrated below. The evaluation is described in detail in Chapter 1. The process and the evaluation elements chosen Below, we summarise the results and conclusions of the evaluation. The Technology ProgramThe Technology Program was established in 1996 in relation to an amendment of the Danish Waste Disposal Site Act according to which the local authorities (the counties) were given the overall responsibility for the implementation of charting, investigating and cleaning up waste pursuant to the act. In this connection, a development program was established, the so-called Technology Program, which was to finance the testing and development of improved and cheaper preventive measures. The Environmental Protection Agency was made responsible for the administration of the Technology Program. The basis for the establishment of the program is described in "Program for technology development, soil and groundwater pollution, the Environmental Protection Agency, December 1996". This program also describes the organisation, administration and general function of the various players included in the administration of the program. Organisation. The Waste Deposit Board has been set up by the Minister for the Environment and is therefore the top-level responsible body for the program. The Environmental Protection Agency presents proposals for principles and program areas to the Waste Deposit Board. The Board assesses, on an overall level, the need for technology developments and each year recommends principles and program areas, including the allocation of the appropriation. The Environmental Protection Agency is responsible for the administration and allocation of the appropriation. The annual programs are prepared by the Agency in cooperation with the reference group of the program which is to ensure that the activities under the program are coordinated in relation to other activities in the area. Subsequently, the Agency is in charge of implementing specific actions, i.e. it initiates, monitors, reports and publishes field as well as investigation projects. The activities of the program are implemented in close cooperation with the local authorities (the counties), in particular appointed experts and project leaders. Appropriation. For the implementation of the program, an amount of DKK 10 million has been set aside under the Appropriation Act in 1996 and DKK 15 million annually in the period from 1997 to 2001, however, under the Appropriation Act for 1998, an additional appropriation of DKK 4.4 million was made. For the period 1996 to 2001, the total appropriation amounted to DKK 89.4 million. Activities and consumption. In the evaluation period from 1996 to end-2001, a total of 112 projects were initiated, including 45 field projects amounting to a total of DKK 55.9 million and 67 investigation projects totalling DKK 25.7 million. Activities and the allocation of the appropriation broken down by year are shown in the following table: Activities and costs
Source: Project calculations from the Environmental Protection Agency During the period, an annual average of 22 projects were initiated (variation from 14-30 projects annually). The costs have been allocated with 30% to investigation projects, 65% to field projects, 5% to experts and 0.5% to publication, tender etc. As the assistance of experts is attached to the field projects, the appropriation has been allocated according to the assumptions in the Technology Program, i.e. 30% to investigation projects and 70% to field projects. Target areas. The program focuses on six target areas which in particular need testing of new technology. The target areas selected include the types of pollution which represent the most serious environmental and health problems and which involve significant costs for cleaning up. The six target areas comprise the following types of pollution listed according to priority:
The distribution of the 45 initiated field projects on the six target areas is shown in the following table. Target areas
The Technology Program is described in detail in Chapter 2. Administration and cooperationAnnual programs. Draft of annual programs is prepared by the Environmental Protection Agency and is discussed with the reference group of the program prior to the presentation of the final draft of the annual program to the Waste Deposit Board for approval. The annual programs are published on the Internet and submitted to the local authorities (the counties), the Waste Deposit Board, experts and the reference group. In general, it seems that the annual programs are coordinated with other systems within the soil pollution area. However, about 20% of the counties and experts believe that the coordination is only made to a limited extent or not at all. Field projects. The field projects are administered by the Environmental Protection Agency in cooperation with the local authorities (the counties), their consultants and contractors as well as the appointed experts who are attached as specialists in the areas selected. In cooperation with the local authorities (the counties) and experts, the Environmental Protection Agency chooses sites suited for technology testing. When site and technology have been chosen, the experts assist the counties and their consultants with the preparation of technically relevant projects which can bring about new knowledge of the technology. The above players are also included in the steering group of the field project. All players believe that the cooperation related to field projects - choice of sites and technologies, preparation of technically relevant projects as well as implementation of the project - is satisfactory. The Environmental Protection Agency has chosen to include counties as well as experts actively in the choice of sites and technologies and has in this way succeeded in satisfying the counties and the experts and in securing a high professional standard in the choice of projects. The in-depth analysis of selected field projects also shows that rules and procedures for the implementation and allocation of appropriations to field projects have been met. Investigation projects. The Environmental Protection Agency initiates and monitors the investigation projects, possibly in cooperation with a steering group set up by the Agency if required. Tenders for the projects are called for in accordance with the Agency's rules governing invitations to tender which until 1 July 2001 implied that projects exceeding DKK 500,000 should be subject to public tender, or two tenders should be called for. The evaluation has shown that these rules have been followed. The cooperation regarding investigation projects also develops satisfactorily. However, some contracting parties have indicated that often there is no correlation between the appropriation allocated to the project, the time factor and the performance expected by the Environmental Protection Agency. The Agency manages the projects strictly in order to ensure that the performance is in accordance with agreement. The in-depth analysis of selected investigation projects also shows that rules and procedures for the implementation and allocation of appropriations to investigation projects have been met. Consultants as stakeholders. Consultants represent significant stakeholders in the Technology Program, in investigation projects where the Environmental Protection Agency enters into an agreement with the consultant as well as in the field projects where the counties enter into an agreement with the consultant. In connection with the investigation projects, the Environmental Protection Agency has used a fairly wide spectrum of consultants and research institutions - 20 different consultants have been used to implement 67 investigation projects. The number of consultants on field projects with whom a total of 13 counties have made an agreement is more limited. Ten consultants have been used to implement 45 field projects in 13 counties. For field as well as investigation projects, the trend is towards concluding agreements with certain consultants in a fairly large number of projects and concentrating knowledge sharing and specific expert competence on new preventive technologies in the soil pollution area with a limited number of consultants. Administration and cooperation are described in detail in Chapter 3. Program and project goalsProgram goals. The evaluation shows that the projects under the Technology Program have widely met the overall goals.
More than 90% of the respondents find that the technologies can be used under Danish conditions and for typical components to some, a high and a very high degree. This is also supported by the fact that all the technologies tested lie within the six target areas which have been selected as particularly significant under the Technology Program. More than 60% of the respondents find that the technology projects test the limits of potential technologies within cleaning levels, treatment technologies, reduction of costs and documentation to some, a high and a very high degree. However, a significant number of the users also find that these goals have only been met to a modest degree or not at all. Therefore, the replies also show that is still important to develop new technologies in respect of reduction of costs, documentation of effects and new preventive technologies. The local authorities (the counties) assess that the Technology Program as a whole has facilitated the choice of optimum technologies to be used for polluted sites. This also applies to risk assessments. However, the replies also show that some of the users believe that it is still necessary to improve the basis for the risk assessment of soil pollution as only 30-40% of the users believe that the basis for risk assessments has been improved to a high or very high degree. This also applies to the choice of optimum technologies where 40-50% believe that the basis for choosing optimum technologies has been improved to a high or very high degree. Both areas should therefore still be given high priority in relation to the Technology Program. Knowledge sharing in relation to the projects completed has been extremely good. The evaluation shows that the majority of the respondents agree that the results of the technology projects have been made available for the interested parties. This is also supported by the calculations in Chapter 5 which show the extent of knowledge sharing for the individual projects. Project goals. It is estimated that the project goals for the field projects have been met. The replies indicate that the majority agrees that the most relevant projects have been completed and that the result and quality of the projects have been on a high technical level. This also applies to the investigation projects completed. Based on these replies, we assess that the Environmental Protection Agency has largely complied with the goals and targets set and provided grants for projects within the limits defined and that the Technology Program has contributed to improving the knowledge basis of users, both as regards the choice of suited technologies and the general knowledge of soil pollution. Program and project goals are described in detail in Chapter 4. Knowledge sharing and applicationKnowledge sharing. Our general conclusion is that the knowledge sharing from field and investigation projects completed under the Technology Program is considerable. Knowledge has primarily been shared through the Environmental Protection Agency's own media (the publication 'Ny Viden', environmental reports and www.mst.dk) or through the Danish Academy of Technical Sciences (ATV)'s specialist meetings. However, many projects have also been communicated through other media, including AVJ Info, theme meetings for local authorities (the counties), but also international magazines and conferences. As regards the field projects, 17 environmental reports, 21 status memoranda and a large number of other publications and presentations have been prepared. As regards the investigation projects, 29 environmental reports or internal work reports have been prepared. Some of the comments in the questionnaires are related to knowledge sharing in respect of the projects under the Technology Program. In general, the comments express praise, both from those who are to use the results of the projects and from those who are to complete the projects. However, the latter also believe that things can be better. Knowledge. Another relevant issue is whether the users of the projects, counties and consultants, have knowledge of the results of the projects. The investigation shows that in general the knowledge of consultants of available data on the projects is significant, however, there is a wide variation among consultants, probably because consultants seek knowledge which, from a commercial point of view, gives the greatest advantages. In general, the local authorities (the counties) have less knowledge of the projects than do the consultants, and the variation between the individual counties is not as significant. The Technology Program primarily aims at giving the counties the best possible basis for prioritising sites and preventive technologies and at making optimum decisions. For this purpose, the counties must either possess the necessary knowledge themselves, or they will have to buy it from consultants. Applicability and application. We are of the opinion that, under the Technology Program, field and investigation projects have been completed which are highly applicable and relevant for counties as well as for consultants and which are widely used and will also be used in future. However, some projects are almost unknown and not used at all. Knowledge sharing and application are described in detail in Chapter 5. ConclusionThe Technology Program was established in 1996 for the purpose of developing new technologies for cleaning up polluted sites. The program first and foremost aims at developing new, effective and cheap technologies so that the maximum number of sites can be cleaned up at the minimum time and cost. Under the Technology Program, a total of 112 projects have been completed from 1996 to end-2001 all of which comply with the limits and goals of the Technology Program. The program has clearly contributed to improving the basis for risk assessments related to present pollutions as well as to the choice of preventive technologies which offer optimum solutions for specific types of pollution. Under the program, knowledge has been gained of a number of new technologies which offer a high cleaning effect and which therefore show great promise as the preventive technologies of the future. Overall assessment. The administration of the program, which has been the responsibility of the Environmental Protection Agency, has been very satisfactory, including the qualified and differentiated utilisation of the appropriation to the Technology Program. The program has been administered in close cooperation with counties, consultants and research institutions which has ensured the high technical quality of the projects and guaranteed that these have been directly applicable in relation to the preventive measures of the counties for soil and groundwater pollutions. The Environmental Protection Agency has also arranged for the communication of results from the Technology Program to the direct users (counties and consultants) who have in this way been able to use the results for other preventive measures. The communication has worked very satisfactorily. Accordingly, we believe that the Technology Program has contributed significantly to technological developments in the area and that experiences and knowledge have in a satisfactory way been communicated to the end users (counties and consultants). Public financing? Although, in our opinion, the program has been successful, it should be considered whether public financing is necessary to ensure technological developments. The need for and reasons for using public financing for technological developments should be seen in relation to the fact that the public authorities are responsible for implementing and financing cleaning up of pollutions prior to 1 January 2001. Accordingly, the public authorities are also responsible for ensuring that the financing for cleaning up is used in the best and most efficient way so that a maximum number of sites can be cleaned up for the appropriation provided under the Appropriation Act. It therefore seems fair that the public financing of the Technology Program continues until cheaper and more effective technologies have been developed for the most typical pollutions in Denmark or until the need for public financing of cleaning efforts has decreased significantly. Proposed improvementsIn our examination and evaluation, we have also focussed on areas where the Technology Program can be improved and adjusted. We have identified the following ideas and proposals for adjustments and improvements which should be included in the future plans of the Environmental Protection Agency (however not evaluation of financial and administrative consequences):
International knowledge sharing. Several respondents state that knowledge sharing with foreign countries should be improved so that the knowledge achieved can also be used by others. Some also indicate that, under the Technology Program, it should also be possible to support the publication of scientific results in foreign journals.
|