Methodology

'Situated evaluation' was the methodological framework within which the evaluation of IT, an innovative initiative in ESLARP, was conducted. In Bruce's (1995) view, an innovation is:

...the manifestation of a set of beliefs and values about change...We use the term situated evaluation to emphasize the unique characteristics of each situation in which the innovation is used. Our guiding assumption is that the innovation comes into being through use. The object of interest is not the idealized form in the developer's head, but rather the realization through use.
Given the infancy of the information technology program in ESLARP, this evaluation focused on both, the idealization of the innovation and its realization.

Sources of Data: The two primary sources of data were people, and documents (print and electronic) at UIUC and in ESL. Access to them and/or their availability were determined by willingness of those contacted to participate in the evaluation, the time constraints of the semester, as well as the evaluator having been an "outsider" to ESLARP. On occasion, sources of information on the Internet were suggested by some of the faculty and staff members, which proved to be useful.

Tools of Data Collection: Observations, questionnaires, interviews, and review of documents were the methods used to collect data. The design and use of the tools was shaped by the issues of participatory action research, innovations, and the situated evaluation model. The questionnaire for the faculty and staff at UIUC consisted of 15 open-ended questions. The questionnaire for the NTAC staff consisted of 13 open-ended questions. An interview schedule was used to collect data from James Jones, the director of ESL-CAN, and Reverend Watson, the Pastor of Mt. Sinai Baptist Church.

Next  Findings

Return to Contents