4.3 Performance
3. Although the number of applications received under MI1 was initially quite low, it rose fairly quickly to pre-MI1 levels. However, the data systems established as part of MI1 allowed for the early identification of problems, and led to MI2, which has been much more successful in reducing the intake of applications.
The department established excellent monitoring systems in support of the implementation of the first set of Ministerial Instructions. This allowed them to quickly identify the escalating number of applications under MI1, and to identify the main reasons for the problem. This enabled CIC to design the new instructions to overcome these problems. Key provisions in MI2 — particularly the overall cap and sub-caps, the language requirement, and the removal of problematic NOCs — have been successful in controlling intake.
4. While MI2 has been more successful than MI1 in limiting applications, the transfer of the eligibility decision to the CIO under MI2 was viewed as potentially problematic, particularly by staff in the missions. The scope of this evaluation did not allow for an assessment of the impact of this change.
Although most key informants asserted that MI2 is superior to MI1 in almost every respect, there were some concerns regarding the transfer of the final eligibility decision from the missions to the CIO. This was primarily due to the fact that CIO staff do not have the local knowledge necessary to detect misrepresentation in applications, which will increase the risk of fraud. Allowing missions to reverse positive eligibility decisions is one way in which this issue could be addressed; providing additional mission-specific training to staff at the CIO could also contribute to alleviating concerns.
Recommendation 1: CIC should conduct a more formal assessment of the impact of further centralization of the processes historically undertaken in missions. Specifically, this assessment should examine the risks associated with centralizing decision-making, particularly in relation to the potential of not detecting fraud. This study should also include the identification of mitigation strategies, as required.
5. The implementation of MI1 contributed to a substantial reduction in the backlog, although there was a subsequent, and unanticipated, development of an MI1 backlog.
The government set the goal of reducing the FSW application backlog by 50% by 2013 and actually achieved this goal by April 2011. However, because MI1 did not ultimately reduce the volume of applications being received, a substantial backlog of MI1 applications accumulated during this time. The inclusion of the MI1 backlog in this assessment reduces the overall reduction of backlog to 23%.
While the overall backlog is decreasing and is expected to continue decreasing, a ministerial directive stipulated that MI2 applications be processed before those submitted under MI1, and MI1 files be processed before addressing the pre-existing backlog. This means that the time required for a final decision for the group in the pre-C50 backlog — almost 300,000 persons — will likely increase by several years.
6. While it was not possible to conclude that CIC costs were reduced as a result of centralizing the front-end processing of FSW applications, the CIO did achieve a number of objectives that contribute to improving the efficiency of the overall process.
In order to conduct a proper cost-effectiveness analysis of a program or initiative, it is necessary to have very detailed cost data related to the activities under study, and a baseline against which to compare current costs. While CIC has a well-established activity-based costing model, the data related to processing overseas applications was not sufficiently detailed to support an analysis of these costs before and following the introduction of MI.
Recommendation 2: As part of its overall approach to program performance measurement, CIC should ensure that there is financial data that is sufficiently robust and detailed to support the on-going analysis, and periodic evaluation, of program costs.
Although it was not possible to assess cost-effectiveness, the evaluation did find that centralization has reduced the time required to process applications, improved the consistency of the implementation of MI, and on-going decision-making and record-keeping, and reduced the clerical workload in missions. These impacts, by improving performance or reducing the resources required to process applications, contribute to the efficiency of the overall process.
Link
http://www.cic.gc.ca/english/resources/evaluation/min-instruct/section4.asp#s4_4
Please give your view...
whether the "several years" highlighted above is applicable to pre-June or pre-Feb...
.
