Indicator 14: State reported data (618 and State Performance Plan and Annual Performance Report) are timely and accurate.

Overview of the State Performance Plan Development: See Indicator 1 for a description of this process.

(The following items are to be completed for each monitoring priority/indicator.)

Monitoring Priority Effective General Supervision Part C / General Supervision
Indicator 14 State reported data (618 and State Performance Plan and Annual Performance Report) are timely and accurate. (20 U.S.C. 1416(a)(3)(B) and 1442)
Measurement State reported data, including 618 data, State performance plan, and annual performance reports, are:
  1. Submitted on or before due dates (February 1 for child count, including race and settings; and November 1 for dispute resolution); and
  2. Accurate, including covering the correct year and following the correct measurement.
States are required to use the "Indicator 14 Data Rubric" for reporting data for this indicator (see Attachment B).

Overview of Issue/Description of System or Process:

  1. Submitted on or before due dates (February 1 for child count, including race and ethnicity, settings and November 1 for exiting, personnel, dispute resolution); and Records indicate full compliance with submitting the above-mentioned reports on the required dates of February 1 and November 1.
    • State reported data reports are submitted electronically, via E-mail.
  2. Accurate (describe mechanisms for ensuring error free, consistent, valid and reliable data and evidence that these standards are met).

With the exception of two measures (i.e., reasons for delays in intake past 45 days and delays in one or more services), which are manually reported by CFCs, Illinois' Cornerstone and EI Central Billing Office (EI-CBO) systems include almost all client data and billing information. Few data elements are housed only locally. These systems allow CFC staff to record client demographic, assessment, family fee, and provide service authorizations. To be accepted by the system, data must pass a series of edits. Authorizations are processed for payment by the EI-CBO, which also verifies and enters insurance information.

A variety of edit rules require data to be internally consistent or coordinators are required to take additional steps to correct it. CFCs are limited to how much the system information can be altered to correct errors. There is a HEAT ticket system that requires CFC to request data changes to address specific data entry errors. The CFC manager must approve these requests. Service coordinators take laptops into family's homes to conduct intake and IFSP meetings, when appropriate. This means that data related to the case is entered immediately, minimizing various data retention and entry errors.

The Illinois EI Program uses analysis of data from its management information systems to support accurate and timely data entry. Monthly, the Department monitors and provides to CFCs data on 29 performance measures. These data are discussed at quarterly CFC managers' meetings. In SFY 05, nine measures were used to establish incentive payments as part of performance contracts, with payments made to CFCs that fall in the top 12 for each measure. Basic minimum performance standards are established on four measures that may result in a penalty adjustment if basic performance is not met.

The monthly statistical reports, combined with the performance-contracting framework, create an environment that foster attention to detail in regards to data entry. Most measures carry a 1-25 ranking of the CFCs against each other. No CFC wants to be near or at the bottom, even of if it is a measure that does not carry incentive funding. This requires CFCs to make sure data is entered in a timely and accurate way.

The Statewide Data Manager reviews statistics each month to find oddities that merit further review. He forwards questions to the Program Coordinator and her staff, to Cornerstone staff, to the EI Monitoring Program, or to CFCs, as appropriate. Rapid changes in performance by particular CFCs raise questions, as does performance that is out of line with that of similar CFCs. This attention is intended to help identify and address downward trends early, to help highlight successful changes in practice, and to identify possible data manipulation. Questions to Cornerstone in particular help find problems in the data or help make refinements in how reports are calculated and used.

Implementation of the EI Monitoring Program has given the program another level on which it can review data for accuracy. EI Monitoring has reviewed all CFCs and checked a variety of details in the paper files to determine if they agree data entered in the Cornerstone system. For instance, IFSP dates were checked for consistency between the paper file copy and entries in the system.

All new service coordinators must apply for an Early Intervention credential, which is granted based upon the applicant holding an appropriate degree, as defined in state rule. A new employee is not issued a Cornerstone ID, which allows data entry into the system, until an Early Intervention credential is awarded, initiating a 90-day period in which the service coordinator must attend two three-day training sessions. The first session is a systems overview. The second provides instruction on the use of the Cornerstone system in context with the policies and procedures for service coordination. Additional training activities for new service coordinators occur onsite at the CFC. When any changes to the Cornerstone system are made, service coordinators are notified of these changes through on-line notices and explanations.

The Illinois Cornerstone system is a statewide database application that is used by all Child and Family Connections (CFC) offices. The application includes a number of edit checks on numeric data, character data, and data fields, as well as content-specific edit checks and logical consistency checks. The design of the Cornerstone system, including all of the edit and logical consistency checks help ensure the quality and consistency of the data.

Several other controls and checks have also been implemented.

  • Monthly, CFC offices receive an Early Intervention statistical report, which includes 32 data elements. These reports are reviewed and analyzed by each CFC office and by the lead agency. These reports have been used to identify and quickly resolve data problems.
  • Quarterly, CFC offices receive other data reports from the lead agency that are used to facilitate data review for accuracy. For example, CFC offices receive a report which lists the names of children in the program that are not enroll in the state Medicaid/Child Health Insurance Program and do not have a family fee. CFC office are asked to research each case to ensure that an application to the state Medicaid/Child Health Insurance Program is submitted or a family fee is assessed, when appropriate.
  • CFC offices have the capacity to establish and run data reports directly from the system to meet their own quality assurance needs.
  • Cornerstone provides a series of edit rights so that a service coordinator or his/her supervisor can correct data under specified circumstances. Corrections that fall outside these guidelines must be address through the HEAT ticket process, with each request reviewed and approved by Bureau staff. These requests are monitored and technical assistance is provided to CFC staff, when indicated.
  • Each CFC office received an on-site monitoring visit during which monitoring staff reviewed both electronic and hard-copy files to verify that required data elements were correctly entered/ documented.
  • All new service coordinators receive training on use of the Cornerstone system. Training on system modifications or procedure clarifications are provided to all service coordinators, when needed.

Baseline Data for FFY 2004 (2004-2005)

Submitted on or before due dates (February 1 for child count, including race and ethnicity, settings and November 1 for exiting, personnel, dispute resolution)

Report Date Due Date Sent Mechanism for Assuring Deadlines were met
December 1, 2004 Child count, including race and ethnicity, settings February 1, 2005 January 31, 2005 E-mail Confirmation
December 1, 2003 Exiting, personnel, dispute resolution November 1, 2004 October 29, 2004 E-mail Confirmation, Overnight delivered & Fax Confirmation
December 1, 2002 Exiting, personnel, dispute resolution November 1, 2003 October 30, 2003 E-mail Confirmation
December 1, 2001 Exiting, personnel, dispute resolution November 1, 2002 October 31, 2002 Overnight delivered & E-mail confirmation

Discussion of Baseline Data:

  1. Submitted on or before due dates (February 1 for child count, including race and ethnicity, settings and November 1 for exiting, personnel, dispute resolution

The Bureau of Early Intervention was able to document through E-mail confirmations that required information was submitted on or before due dates (February 1 for child count, including race and ethnicity, settings and November 1 for exiting, personnel, dispute resolution) during the 2004 - 2005 time-period.

FFY Measurable and Rigorous Target
2005
(2005-2006)
100 percent of state reported data will be timely and accurate.
2006
(2006-2007) 
100 percent of state reported data will be timely and accurate.
2007
(2007-2008) 
100 percent of state reported data will be timely and accurate.
2008
(2008-2009)
100 percent of state reported data will be timely and accurate.
2009
(2009-2010)
100 percent of state reported data will be timely and accurate.
2010
(2010-2011)
100 percent of state reported data will be timely and accurate.
2011
(2011-2012) 
100 percent of state reported data will be timely and accurate.
2012
(2012-2013) 
100 percent of state reported data will be timely and accurate.

Improvement Activities/Timelines/Resources

  1. Submitted on or before due dates (February 1 for child count, including race and ethnicity, settings and November 1 for exiting, personnel, dispute resolution)
    • A system will be established and maintained to track State reported data, including 618 data, State performance plan, and annual performance reports.
  2. Accurate (describe mechanisms for ensuring accuracy)
    • Two new staff joined the Bureau of Early Intervention in May 2005, with the addition of a third staff person in July 2005. The additional staff resources brings the Bureau to its full staffing level (9 staff) and will improve the Bureau's capacity to provide technical assistance and support to CFCs to maintain data integrity and to follow-up any issues identified during monthly data analysis and reporting.
    • Strategies are being considered to reformat the required service coordination training, including the use of the Cornerstone system. Methodologies, including online, rather than face-to-face, training sessions are being considered. Use of this technology may be used to address future MIS system training needs for current service coordinators.

The improvement activities described in the SPP are ongoing efforts. The following are new improvement activities to be implemented through FFY12/SFY13.

New Improvement Activity Timelines & Resources

  • Access to Early Intervention Cornerstone data will be improved to expedite the process of generating reports. Currently, Cornerstone is not a stand-alone system for EI, but is inclusive of other community health programs, which make it less flexible.
  • By July 1, 2011, Business Objects will be implemented, which will provide a more efficient way to access EI Cornerstone data directly. The process will create a "universe" that will consist of only EI data. EI data can then be queried from information specific to EI, rather than querying the entire Cornerstone system and then sorting EI data from other program data.
  • Resources include the Bureaus of Early Intervention and Performance Support Services.
  • Additional data will be provided to CFC offices so they can monitor compliance with Indicators 1, 7 and 8C and address child-specific and system issues in a timely way.
  •  Beginning in January 2011 and on an ongoing basis, a system will be implemented that will provide a monthly list to each CFC office of all children that have not had transition meetings
  • Resources include the Bureaus of Early Intervention and Performance Support Services.
  • Beginning in July 2011and on an ongoing basis, "mini APR tables" will be provided to CFC offices on a quarterly basis, so that they can monitor performance on Indicators 1, 7, and 8C.
  • Resources include the Bureaus of Early Intervention and Performance Support Services.