The audit was undertaken in a manner consistent with the TB Policy on Internal Audit and related guidelines and procedures, and with generally accepted auditing standards.
The methodology consisted of a review of pertinent documentation, systems, practices, procedures, and interviews with appropriate Department of Justice management and staff at headquarters and in the Ontario, Atlantic, and Quebec regions.
In conducting this audit, the audit team:
As of March 31, 2010, there were approximately 233 acquisition cards in the Department. During the timeframe of the audit, the audit team tested 165 acquisition cards in use at headquarters and in three regional offices.
In determining the sample size for the transaction testing, the audit team obtained an Excel file, downloaded from the card provider’s reporting system, containing all acquisition card statements for headquarters and the Atlantic, Quebec, and Ontario regions for both fiscal years. The file included 18,562 transactions, stratified as follows:
| Region | 2009-2010 | 2010-2011 |
|---|---|---|
| Headquarters | 3,564 | 5,204 |
| Atlantic | 181 | 632 |
| Quebec | 2,765 | 3,963 |
| Ontario | 1,077 | 1,176 |
| Total | 7,587 | 10,975 |
The audit team used the statistical sampling software IDEA to determine an appropriate sample size. Based on the total number of transactions for the two fiscal years audited, IDEA provided a sample of 360 transactions to review in order to obtain a sound representation of the complete transaction population. For the two fiscal years, IDEA outlined 180 transactions to be tested for each fiscal year. The sample size was determined based on the following parameters:
A 95% confidence level signifies that 95 out of 100 items sampled will accurately represent the population being sampled.
Once a sample size for each fiscal year was determined, the audit team determined that a sample of 45 transactions to review was reasonable for each of the three regions and headquarters. Given the large number of transactions associated with cardholders in headquarters, Quebec, and Ontario as compared to the fewer transactions in the Atlantic region, the audit team used professional judgment to conclude that 20 transactions per fiscal year would be appropriate to be tested in the Atlantic Region and that 25 transactions needed to be allocated to the other three locations.
Using professional judgment and based on preliminary information obtained during the planning phase interviews with headquarters and the three regions, the audit team determined that the 25 transactions should be allocated to the remaining three locations as follows:
In summary, the sample size of transactions reviewed for each location per fiscal year was as follows:
Total 180 transactions
Once the audit team determined the sample size, the audit team modified the reporting system transaction information as follows:
Once the reporting system’s database was modified by the audit team to adjust for transactions that would not be reviewed, the remaining transactions were imported into IDEA and the software was used to select a random sample of transactions for each region, based on the sample size per year as identified above.
The audit team determined that the above sample of 180 transactions for each fiscal year was sufficient information to make conclusions in relation to the audit objective.
Audit testing revealed the following results by location and fiscal year for compliance with section 34:
| Section 34 Compliance | ||
|---|---|---|
| 2009-10 | 2010-11 | |
| Headquarters | 96% | 100% |
| Atlantic Region | 100% | 100% |
| Quebec Region | 100% | 100% |
| Ontario Region | 94% | 100% |