Return-Path: <nifl-4eff@literacy.nifl.gov>
Received: from literacy (localhost [127.0.0.1]) by literacy.nifl.gov (8.10.2/8.10.2) with SMTP id e7GMs3817615; Wed, 16 Aug 2000 18:54:03 -0400 (EDT)
Date: Wed, 16 Aug 2000 18:54:03 -0400 (EDT)
Message-Id: <c5.862b7fb.26cc7527@aol.com>
Errors-To: rgspacone@aol.com
Reply-To: nifl-4eff@literacy.nifl.gov
Originator: nifl-4eff@literacy.nifl.gov
Sender: nifl-4eff@literacy.nifl.gov
Precedence: bulk
From: Rgspacone@aol.com
To: Multiple recipients of list <nifl-4eff@literacy.nifl.gov>
Subject: [NIFL-4EFF:1157] NIFL-4EFF Evaluation Report (Moderately Long)
X-Listprocessor-Version: 6.0c -- ListProcessor by Anastasios Kotsikonas
X-Mailer: AOL 4.0 for Windows 95 sub 107
Content-Transfer-Encoding: 7bit
Content-Type: text/plain; charset="US-ASCII"
Status: O
Content-Length: 8611
Lines: 153
NIFL-4EFF Evaluation Report
I. Background
Last May, I invited subscribers to evaluate the NIFL-4EFF Discussion List. My
goal: to use the information to improve the list. I wondered how effective
the list was as an EFF information exchange network and EFF discussion forum.
I wondered how well -- and in what ways -- the list was meeting its own
purposes and meeting the interests of its subscribers, and I wondered how
well the two were matched.
Overall, this list features targeted discussion about Equipped for the Future
(EFF), the National Institute for Literacys long-range initiative to develop
adult literacy and lifelong learning standards for program improvement and
system reform. In particular, the list aims to feature targeted discussion
about EFF for practitioners who are using the EFF Content Framework and
Standards. As one who participated in this evaluation observed: "I think the
stated purposes of the list seem to be more to share the practical aspects of
and support for doing EFF..." I wondered what other subscribers thought
about the focus of discussion here and, as you will see, the subject did come
up in the comments.
Altogether, 41 subscribers participated in the NIFL-4EFF evaluation
(approximately 8% of all NIFL-4EFFers). The evaluation form contained four
questions: 1. What do you like about the NIFL-4EFF list? 2. How do use the
NIFL-4EFF messages? 3.What suggestions do you have to improve or change the
list? and 4. Other comments? The second question, which was multiple choice
revealed: 88% read and think about the messages; 78% pass them onto peers and
colleagues; 12% have used messages in class with students; and 12% said they
have quoted messages in publications or articles they have written.
II. Findings: The Value of This List
Participants value the 4EFF list for three main reasons: 1. it's a good place
to learn about the EFF initiative and how it's developing and changing;
2. it provides insights to how many others are processing EFF issues and
integrating the EFF Content Framework and Standards with programs; and 3. the
discussion list lessens the feeling of isolation and helps connect colleagues
who share an interest in EFF across the country.
In terms of the content in messages, there was a large consensus among
respondents regarding what they like the most: "Thoughtful, detailed
questions and answers by people doing the work regarding the varied issues of
putting EFF into practice." The perceived need to reinvent the wheel of
teaching and learning is lessened when diverse practitioners share
information through the list, such as EFF instructional plans and curriculum;
teaching techniques and materials. The following comments reflect what the
large majority of evaluators said they enjoy:
* "I like the broad mix of participants and the depth of information they
share about implementing EFF. Ive seen more concrete programming ideas on
this list than on most others."
* "Reading this listserv helps me to see how practitioners view EFF,where
there is clarity and where there is confusion and gives me ideas for the
structure and organization of my own work."
* "I particularly learn a lot from reading about how instructors are using
EFF as a planning tool and how they are developing lessons which incorporate
EFF. The list helps keep me informed of current thinking and practices."
Whereas, I think the evaluations validated the focus on EFF practices, a
number of respondents expressed an interest in also having more theoretical,
philosophical and policy based threads of discussion:
* "The variety of participation, from instruction to policy including both
theoretical/philosophical and practical suggesting, making the list very
interesting and valuable to me as an ABE instructor and EFF advocate."
* "I've learned a lot about policy and the history of policy around literacy
through this list. Drawing on this knowledge helps me in my job. I always
like to hear what literacy means and what it looks like to them."
Additionally, participants value receiving information about the EFF web site
and the NIFL-4EFF archives, which they use to research EFF topics and review
the history of the EFF initiative and past threads of discussion. I was
struck by the number of respondents who mentioned their own learning outcomes
and how they use the discussion list as a tool for professional development:
I learn from others and their experiences. It has introduced me to new ways
of thinking and teaching. I think I have become a better resource to other
teachers as a result... Another participant who is a staff developer wrote,
"The list provides me with stories other than my own to share with others
during EFF trainings. I also appreciate a forum for gathering my own thoughts
and finding out where I am with EFF through the act of writing for an
audience."
Finally, subscribers view the list like an EFF community center helping to
develop a professional learning community among adult literacy education
practitioners:
* "It helps me feel connected to something larger and spurs me into action.
When I meet the list participants at meetings or conferences, I feel I
already know them and their program so helps us interact and work together
better. Adult education has tended to be rather isolated and this list helps
me think of things I might not have otherwise considered."
* "It helps keep me enthused about EFF and gives me ideas for my own program.
Its good to know we are not alone."
* "It helps me keep the faith. I check it regularly and frankly would feel
lost or at least lonely without it...I look forward to the thoughts, comments
and sharings of my colleagues daily."
III. Suggestions to Improve the NIFL-4EFF List
One practitioner's comment about how to improve list seemed to capture the
collective spirit of respondents: "More people on it both to participate and
because its a great place to learn about EFF." I thought the paradox in
achieving this was aptly expressed by a practitioner who wrote, "I wish
people would respond to the postings more. I understand why we don't -- it
takes all our time just to do EFF; its hard to make time to write about it
too! However, the list would be richer if more people would respond more
substantially to each other."
Content-wise, subscribers want more of what they already appreciate in the
list: the open exchange of information and ideas about EFF and, in
particular, more focused discussions about putting EFF into practice in a
variety of specific teaching and learning settings. Other suggestions
include: regular updates on what the EFF development team and partners are
doing; ways EFF is being marketed to the general public and specific
agencies; summaries of what projects are being done in various states; and
more information about what the future holds for the EFF initiative. More
structured discussions like the one with staff from the Genesis Center in
Rhode Island is in the works, and Ill be posting more on this and other ideas
later.
Many particpants in the evaluation raised their concerns about netiquette, or
the basic ground rules for using a discussion list, including: the lack of
relevance of certain messages to EFF; the need to be concise (under two
screens is recommended for a typical message); remembering the subject line
should always specify what a message is about; knowing when and how to reply
to an individual rather than to the whole list; how to subscribe and
unsubscribe. I believe some of these problems will be alleviated when we
change the distribution of messages and I become responsible for posting them
to the list. I remain confident that this change will occur in the near
future but we are still working through some technical difficulties to make
it happen. And I will continue to post regular netiquette tips and reminders
to the general list.
Thanks again to all of you who participated in this evaluation activity. I
enjoyed the positive feedback I received and the constructive criticism! As
a result, I now have good ideas to pursue and concrete plans to carry out to
bring more EFF information and focused discussions your way. Let's see how
the list grows and develops to continue supporting you and your EFF work. We
will formally evaluate this list twice a year, in the spring and the fall,
but I welcome your comments anytime <rgspacone@aol.com> and appreciate your
participation.
Ronna Spacone
NIFL-4EFF List Moderator
rgspacone@aol.com
This archive was generated by hypermail 2b30 : Mon Oct 29 2001 - 15:04:14 EST