by Julie Athman Ernst
Recognizing that recreational fishing and hunting can create strong connections to the environment and that youth involvement in fishing and hunting is declining, the Minnesota Department of Natural Resources (DNR) developed the Fishing: Get in the Habitat! MinnAqua Leader’s Guide for educators in formal and nonformal education settings. The guide aims to increase students’ understanding of Minnesota fish, aquatic resources, and resource management; involve students in aquatic-related service learning projects; and connect students to their local aquatic resources through the recreational activity of angling.
The guide is organized into six chapters: 1. Aquatic Habitats, 2. Minnesota Fish, 3. Water Stewardship, 4. Fish Management, 5. Fishing Equipment and Skills, and 6. Safety and the Fishing Trip. MinnAqua intends for educators to use the guide by selecting one lesson per chapter, along with implementing a fishing trip and an aquatic-based service-learning project. While MinnAqua has distributed the guide primarily through workshops, educators can also request the guide by mail.
Due to the amount of time and money invested into the guide, MinnAqua wanted to know whether program outcomes were being achieved. MinnAqua also was interested in data that could inform decisions relating to future dissemination of the guide, training workshops, and follow-up support. Here’s what we learned through an evaluation conducted in response to those needs:
Assessment of Dissemination Methods
About three-fourths of the respondents received the guide through a MinnAqua workshop; workshops ranged from one to eight hours. Respondents’ rated the workshop overall as effective. Workshop effectiveness was significantly related to length of workshop, with those attending longer workshops rating the workshop as more effective. Effectiveness of the workshop in motivating educators to want to use the guide was also significantly related to length, with those attending longer workshops rating it as more effective in motivating them to want to use the guide.
There were mixed reactions as to whether the workshop should be required; some felt it necessary and the best dissemination approach, while others thought it wasn’t needed. About half of the respondents who had attended a workshop indicated they would have been motivated to access the guide from a website without participating in the workshop, and three-fourths indicated they would have been able to use the guide without the workshop.
While many indicated knowing the underlying purpose of the guide, none of the respondents were able to fully state its purpose. Further, almost all of the respondents thought the guide was to be implemented in whatever way best fit their educational needs (as opposed to MinnAqua’s intention of one activity per chapter, plus a fishing trip and service project). Respondents’ understanding of both the purpose of the guide and how the guide is to be implemented was not related to how they obtained the guide.
Assessment of Implementation
About one-third of respondents indicated they had used some part of the guide. Use was not related to how respondents obtained the guide or to their perceptions as to the effectiveness of the dissemination method in general or the effectiveness of the workshop. Use also was not related to respondents’ understanding of the purpose of the guide or their understanding of how MinnAqua intends it to be implemented. Further, use was not related to whether respondents encountered or anticipated encountering obstacles. Regarding follow-up, two-thirds of respondents indicated support would encourage their general use of the guide, requesting assistance particularly in the areas of implementing the fishing trip and service-learning project.
Assessment of Program Outcomes
When educators implemented the guide in the way MinnAqua intended (one activity per chapter, the fishing trip, and the service-learning project), short-term program outcomes generally were achieved. Students’ knowledge about aquatic habitats, Minnesota fish, and fish management increased, as did their procedural knowledge of and skills in water stewardship and fishing and their science process skills. Students’ awareness of the roles the DNR and Minnesota citizens play in conservation also were increased. While awareness of local aquatic issues increased, there appears to be room for additional awareness-building, as generally low levels of awareness were suggested by post-test scores. Because instructors were directed to implement one activity per chapter, it could be that implementing multiple activities could result in stronger increases of awareness, knowledge, and skills.

Third- and fourth-grade students participate in a MinnAqua fishing trip.
Students seemed to appreciate Minnesota’s aquatic resources, were aware of the need for natural resource conservation, and appeared interested in fishing prior to their participation in the guide. Thus, while MinnAqua can’t attribute participation in the guide to these outcomes, perhaps these dispositions make the guide more appealing to students and contribute to the building of other understandings and skills.
Recommendations for MinnAqua
- Use multiple forms of dissemination for the guide. Results suggested there is not a one-size-fits-all approach to dissemination of the guide. Some respondents thought they needed the training workshop, and others didn’t. Further, whether respondents used the guide was not related to how they obtained it; thus, there doesn’t appear to be one method of dissemination that is clearly best when the goal is use of the guide.
- Disseminate the guide through workshops when the aim is motivating instructors to use it. While actual use did not appear to be related to whether or not participants had attended a workshop, motivation to use the guide may likely be related to use. Workshops seemed to be successful in motivating instructors to use the guide, but not as useful in helping instructors learn to use it, as respondents felt they would have been able to use it without a workshop.
- When using workshops as a form of dissemination, offer workshops that are of longer duration. Those who attended longer workshops (between four and eight hours) rated the workshop as more effective than those attending shorter workshops (less than four hours). If MinnAqua invests in workshops, the workshops need to be longer rather than brief, introductory sessions for participants to perceive the workshop as effective, and in particular, effective in motivating them to want to use the guide. Longer workshops also may reduce participants’ feelings of being rushed and provide an opportunity to explore more of the guide.
- Emphasize overall purpose of the guide in whatever dissemination method is used. MinnAqua invested much effort in determining this purpose and wants to make sure this purpose is being achieved. Thus, while educators appear to be able to implement the guide without knowing MinnAqua’s purpose for it, making sure educators understand the purpose seems important from MinnAqua’s perspective.
- Merge the intent behind follow-up support (encouraging use of the guide) with the use of workshops for guide dissemination. Many of the suggestions for follow-up support were topics that could be addressed through a dissemination workshop. For example, workshop leaders could provide time and assistance during the workshop for incorporating activities into lesson plans, locating equipment, brainstorming service project ideas, identifying community partners or local angling experts, etc. Or the guide could be disseminated by mail or electronically, with MinnAqua offering workshops as a form of follow-up support instead of as the avenue for dissemination.
Implications for the Interpretive Community
What does this mean for the interpretive community and the programs we develop to foster resource stewardship? This evaluation provides further evidence of the potential of youth-based programming in efforts toward resource conservation. Through its activities, fishing trip, and service-learning project, the guide aims toward short-term goals of awareness, appreciation, knowledge, and skills. In turn, these short-term outcomes influence medium-term outcomes, such as skill development in issue investigation and participation in fishing, which in turn contribute to the long-term outcomes of participation in local communities as informed decision makers, stewards of aquatic resources, and responsible, life-long participation in recreational fishing.
Since these underlying program assumptions are supported by research literature, we might assume the guide is achieving the ultimate goal of resource conservation. On the other hand, this chain of outcomes illustrates a challenge inherent in our educational or interpretive efforts toward resource stewardship. Often our more significant behavioral goals are assumed to follow, and instead we focus on the short-term outcomes that are more easily emphasized in our programs and materials and measured in evaluation. At some point we need to ask, for example, if our goal is increasing youth involvement in fishing, how can our programs actually get kids fishing? Or if our goal is resource stewardship, how can our programs get kids participating as stewards of the resources around them?
In MinnAqua’s case, Minnesota youth may already appreciate their aquatic resources, be aware of the need for natural resource conservation, and have an interest in fishing—outcomes that are often targeted in our interpretive and educational efforts. MinnAqua may need to reconsider these outcomes. For example, are there barriers that intervene between children’s interest in fishing and the actual behavior of recreational fishing? Perhaps the guide could address those barriers, and a desired program outcome instead might be reducing barriers to youth participation in fishing or getting teachers who aren’t inclined toward fishing to use the guide, rather than inspiring an interest in fishing.
A second implication relates to the incongruence between the implementation MinnAqua intended and educators’ tendency to implement the guide in whatever way suits their needs. This challenge is familiar to many nonformal environmental educators. While some implementation is probably preferable to no implementation, it is unlikely that the desired outcomes (and ultimately resource conservation) will be achieved when implementation is limited to an activity or two, or if implementation is something other than deliberate and sequential. On the other hand, teachers generally are more likely to use a curriculum that is “flexibly adaptive,” a curriculum that allows for teachers to adapt it to their needs and classroom context. Consequently, the following questions may be worth considering as you begin the program development process:
- How can we design programs in which a variety of forms of implementation can lead to the desired results?
- How can we design programs so that ideal implementation is feasible for intended users?
- How can we support users in ideal implementation of the programs we develop?
- How can we develop programs that encourage deliberate, purposeful use rather than a less-focused, pick-and-choose approach, or do teachers not even want such a structured program?
A final implication is a reinforcement of the value of program evaluation. Much time, effort, and resources were invested into the initial development of the guide and its revision. Through this evaluation, MinnAqua has a more clear understanding of the benefits of that investment, as well as data necessary for sound decision-making relating to future dissemination. And while not a primary purpose for this evaluation, the results of this evaluation can be useful in marketing of the program, as well as for being accountable to stakeholders.
For More Information
Fishman, B. & Krajcik, J. (2003). What does it mean to create more sustainable science curriculum innovations? A commentary. Science Education, 87(4), 564-573.
Acknowledgements
This evaluation was funded by the Minnesota Department of Natural Resources. The author wishes to gratefully acknowledge the assistance of MinnAqua staff, and in particular Jenifer Matthees, as well as the Minnesota educators and program leaders and their students who participated in the evaluation.
Julie Athman Ernst, Ph.D., is an associate professor at the University of Minnesota, Duluth. Contact her at jernst@d.umn.edu or 218-726-6761. For a copy of the final evaluation report, which contains a logic model, evaluation questions, instruments, and results, visit www.mndnr.gov/minnaqua.
A bat fell to the ground and was quickly snatched up by a weasel. The bat pleaded for his life. The weasel was having none of it, stating, “I am a natural enemy of all birds, therefore I must eat you!” The bat, thinking quickly, replied, “But I am not a bird, I am a mouse.” Somehow the weasel was convinced, and he set the bat free.



In these tough economic times, it seems that everything you read begins with the phrase, “In these tough economic times.” Understandably, we have become consumed by the financial crisis that has dominated headlines, wreaked havoc on the job market, and devastated the global economy. It seems that everything we do is defined in terms of “surviving” the economic downturn—a term that can be taken literally, as interpretive organizations, sites, and programs, not to mention the livelihoods of those who oversee them, are endangered.
