{"id":212,"date":"2018-04-18T16:51:10","date_gmt":"2018-04-18T16:51:10","guid":{"rendered":"https:\/\/in.nau.edu\/cstl\/?page_id=212"},"modified":"2025-03-26T22:57:10","modified_gmt":"2025-03-26T22:57:10","slug":"evaluation-assessment","status":"publish","type":"page","link":"https:\/\/in.nau.edu\/center-stem-teaching-learning\/evaluation-assessment\/","title":{"rendered":"Evaluation & Assessment"},"content":{"rendered":"

NAU Evaluation & Assessment<\/h1>\n
The NAU Evaluation & Assessment team<\/a> (NAU Vice President of Research Office) focuses on strategies to measure the learning outcomes of students and teachers to inform and strengthen evidenced-based education in science, technology, engineering and mathematics (STEM).<\/span><\/p>\n
The team has played a key role in $17 million dollars of successfully funded grants. Federal and state agencies, as well as foundations, are more likely to support proposals with well-developed evaluation plans. Proposals that include qualified evaluators and robust evaluation methods communicate to program officers and review committees that a professionally-designed plan is in place for utilizing data to improve programs or projects (formative evaluation) as well as identifying credible and objective end-of-project findings (summative evaluation).<\/span><\/p>\n
We offer:<\/strong><\/p>\n
\n
Program evaluation<\/li>\n
Education research<\/li>\n
Assessments\n
\n
STEM programs, local, state, & national projects\/programs<\/span><\/li>\n<\/ul>\n<\/li>\n
Formal and informal education<\/span>\n
\n
Pre-K-12 students, higher education students, teachers, administrators, program coordinators, non-profit and informal organizations, and community members. Studies conducted by the CSTL employ a broad range of both quantitative and qualitative methods of social science research. This leads to better understanding of how STEM educational programs are working, which program activities are going well, what should be improved, and the overall program value and impact. We define research as in-depth inquiry into the learning processes and educational outcomes in order to generate new knowledge.<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n \n \n <\/span>\n <\/a><\/span>\n\n
If you are considering a STEM-related grant which has an education or outreach component, please <\/span>contact us<\/a> to set up a consultation. The best time to plan an evaluation is while a grant or project proposal is in the early stages of development. We know, however, that deadlines can be tight, and we will do everything we can to work within your timelines.<\/span><\/p>\n\n
\n \n
\n
Capabilities Accordion Closed<\/span><\/h4>\n <\/span>\n <\/div>\n <\/a>\n
\n \n\n
Depending on the needs of your project or team, we offer:<\/span><\/p>\n
\n
Program and research design and planning: Proposal development, logic modeling, selecting theories and methods appropriate to the context<\/span><\/li>\n
Needs assessment: Identifying the specific educational or support needs in a population or a group of people<\/span><\/li>\n
Formative (process)evaluation: Determining how the program is operating, whether the program being implemented as planned, what is working and what needs improvement<\/span><\/li>\n
Summative (outcome) evaluation: Determining whether a project or program met its goals and objectives (did it make a difference)<\/span><\/li>\n
Communication: Writing internal and external reports, data analysis, creating data visualizations, presenting findings to funders, project staff, stakeholders, and participants<\/span><\/li>\n
Learning assessments: Identifying what do students and\/or teachers know, understand, and do with their knowledge as a result of their educational experiences<\/span><\/li>\n
Technical assistance and capacity building: Professional development sessions for building staff and stakeholder capacity in assessment, research, and\/or evaluation<\/span><\/li>\n
Questionnaire and survey design: Identifying purposes, audiences, questions, and tools, both on- or off-line<\/span><\/li>\n
Focus groups or interviews: Selecting respondents, framing questions, facilitating, and analyzing results<\/span><\/li>\n
Observations: Conducted using objective or participant-observation strategies<\/li>\n
Classroom or site walk-throughs: Observation of set-ups, signage, participant or activity flows<\/span><\/li>\n
Document\/Content analysis: Identifying common or contradictory themes, messages across documents<\/span><\/li>\n
Social Network Analysis: Identifying relationships and communication patterns within and across groups, departments, organizations, or communities<\/span><\/li>\n
Systems Analysis: Modeling or tracking the flow of materials, energy, or information within systems to identify ways that structures impact behavior, including feedback, unexpected consequences, and opportunities for leveraging change<\/span><\/li>\n<\/ul>\n<\/body><\/html>\n\n <\/div>\n<\/div>\n\n
Guiding Principles<\/b><\/p>\n
We follow the American Evaluation Association (AEA) <\/span>Guiding Principles for Evaluators<\/span><\/i>: Systemic Inquiry, Competence, Integrity\/Honesty, Respect for People, and Responsibilities for General and Public Welfare (2004). We also use the <\/span>Program Evaluation Standards<\/span><\/i> developed by the Joint Committee on Standards for Educational Evaluation (Yarborough, Shulha, Hopson & Caruthers, 2011).\u00a0<\/span><\/p>\n
Evaluation Framework<\/b><\/p>\n
Simply put, evaluation determines the merit and worth of a project or program. As the W.K. Kellogg Foundation suggests, evaluation is a learning and management tool that can and should be used from the start of the design of program through determining the program\u2019s impact\u2014its value and worth for the time and money invested (W.K. Kellogg Foundation, 2000).<\/span><\/p>\n
The following framework provides a general overview of the process that our evaluators employ. As this model shows, our process typically follows an iterative framework of design-test-revise.<\/span><\/p>\n
$\"\"$ Evergreen, 2013, modified from CDC, 2008<\/figcaption><\/figure>\n
<\/p>\n
Logic Model<\/h4>\n
$\"CSTL$ <\/p>\n
We apply the above framework by developing a logic model for every evaluation project. The logic model acts as a tool to guide the design, implementation, and adjustment of an evaluation plan as well as the project or program being evaluated (W.K. Kellogg Foundation, 2000).<\/span><\/p>\n\n
\n \n
\n
Theory & methods Accordion Closed<\/span><\/h4>\n <\/span>\n <\/div>\n <\/a>\n
\n \n\n
Theory<\/strong><\/p>\n
The NAU Evaluation group uses a range of designs including qualitative, quantitative, and\/or mixed methods. Our designs are grounded in theory-based and evidence-based approaches adapted to stakeholder interests, program requirements, and what makes sense for the specific context.<\/span><\/p>\n
Methods<\/strong><\/p>\n
We draw upon various theory-based methods for evaluation, research, and assessment such as appreciative inquiry (Cooperrider & Whitney, 2004), data-based school improvement (Love, 2002), design-based research (Barab & Squire, 2004; Bell, 2004), design-based implementation research (Fishman, Penuel, Allen & Cheng, 2013), developing assessments for the Next Generation Science Standards (NAP, 2014) participatory action research (Whyte, 1991), systems-focused evaluation (Williams & Hummelbrunner, 2009), empowerment evaluation (Fetterman, 2001), and utilization-focused evaluation (Patton, 2008, 2012).<\/span><\/p>\n<\/body><\/html>\n\n <\/div>\n<\/div>\n\n\n
\n \n
\n \n
\n
\n Selected projects Tab Open<\/span>\n <\/h4>\n <\/div>\n <\/a>\n <\/li>\n
\n \n
\n
\n Partners Tab Closed<\/span>\n <\/h4>\n <\/div>\n <\/a>\n <\/li>\n
\n \n
\n
\n Past & present funders Tab Closed<\/span>\n <\/h4>\n <\/div>\n <\/a>\n <\/li>\n
\n \n
\n
\n Future audiences Tab Closed<\/span>\n <\/h4>\n <\/div>\n <\/a>\n <\/li>\n <\/ul>\n \n
\n \n
\n
Selected projects Accordion Open<\/span><\/h4>\n <\/span>\n <\/div>\n <\/a>\n
\n \n\n\n
Higher education<\/strong><\/h4>\n
\n
Southern Nevada-Northern Arizona Louis Stokes Alliance for Minority Participation (SNNA-LSAMP) (PI Elder), funded by the National Science Foundation<\/span><\/li>\n
Scholarships in Science, Technology, Engineering and Mathematics (S-STEM): Transfers to Graduates in Engineering, Math and Science at Northern Arizona University (Transfer- GEMS) (PI Entin), funded by the National Science Foundation<\/span><\/li>\n
Integrative Biosciences: Genes to Environment Ph.D. Program (PIs Gehring, Whipple & Watwood)<\/span><\/li>\n
Research Experience for Undergraduates: Human Impacts on the Colorado Plateau: Placed Based Research and Training (PI Whipple), funded by the National Science Foundation<\/span><\/li>\n
Initiative for Maximizing Student Diversity Program at Northern Arizona University, funded by the National Institutes of Health (PI Gibb)<\/span><\/li>\n<\/ul>\n
Teacher preparation and induction<\/strong><\/h4>\n
\n
Educating the STEM Teacher from Recruitment to Induction, Robert Noyce Teacher Scholarship Program (PI Guerrero), funded by the National Science Foundation<\/span><\/li>\n
Rio Salado College Science and Math Innovative Learning Environment for Encore Careers in Teaching (PI Gresko), funded by the National Science Foundation<\/span><\/li>\n<\/ul>\n
Teacher professional development<\/strong><\/h4>\n
\n
Advanced Technical Education (ATE) Program: Geospatial Connections Promoting Advancement to Careers and Higher Education (GEOCACHE) (PIs Rubino-Hare & Blevins), funded by the National Science Foundation<\/span><\/li>\n
APS Stem Focus Schools for the Future (PI Kesler), funded by the APS Foundation<\/span><\/li>\n
Innovative Technology Experiences for Students and Teachers (ITEST): Power of Data (POD) project (PI Rubino-Hare), funded by the National Science Foundation<\/span><\/li>\n<\/ul>\n
Citizen science<\/strong><\/h4>\n
\n
PLACE4FEWS – PPSR: Local Awareness and Community Engagement for Food, Energy, and Water Systems (PIs Ruddell and Ryan), Funded by the National Science Foundation<\/span><\/li>\n<\/ul>\n
Out-of-school time education<\/strong><\/h4>\n
\n
PLANETS – Planetary Learning that Advances the Nexus of Engineering Technology and Science (PI Clark), funded by the NASA Science Mission Directorate<\/span><\/li>\n<\/ul>\n\n\n <\/body><\/html>\n\n <\/div>\n<\/div>\n\n \n
\n \n
\n
Partners Accordion Closed<\/span><\/h4>\n <\/span>\n <\/div>\n <\/a>\n
\n \n\n\n
We have been fortunate to partner with so many wonderful organizations. If you wish to partner with us, please <\/span>contact us<\/span><\/a>.<\/span><\/p>\n
\n
The Arboretum at Flagstaff<\/span><\/li>\n
Grand Canyon Trust<\/span><\/li>\n
Grand Canyon Youth<\/span><\/li>\n
Flagstaff Unified School District Camp Colton<\/span><\/li>\n
California State University at Dominguez Hills<\/span><\/li>\n
Occidental College<\/span><\/li>\n
Maricopa Community College District<\/span><\/li>\n
University of Nevada Las Vegas<\/span><\/li>\n
Museum of Science, Boston<\/span><\/li>\n
Northern Arizona University<\/span>\n
\n
Physics and Astronomy<\/li>\n
Biological Sciences<\/li>\n
School of Earth Sciences and Sustainability<\/li>\n
School of Forestry<\/li>\n
Merriam Powell Center for Environmental Research<\/li>\n
School of Informatics, Computing and Cyber Systems (SICCS)<\/li>\n
College of Engineering, Forestry and Natural Sciences<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n <\/body><\/html>\n\n <\/div>\n<\/div>\n\n \n
\n \n
\n
Past & present funders Accordion Closed<\/span><\/h4>\n <\/span>\n <\/div>\n <\/a>\n
\n \n\n\n
\n
NASA<\/li>\n
NSF Louis Stokes Alliance for Minority Participation (LSAMP)<\/span><\/li>\n
NSF Advanced Technical Education (ATE)<\/span><\/li>\n
NSF Robert Noyce Teacher Scholarship Program<\/li>\n
NSF Scholarships in Science, Technology Engineering & Mathematics (S-STEM)<\/li>\n
NSF International Research Experiences for Students (IRES)<\/span><\/li>\n
NSF Research Experiences for Undergraduates (REU)<\/span><\/li>\n
NSF Integrative Graduate Education and Research Traineeship (IGERT)<\/span><\/li>\n
Science Foundation Arizona<\/li>\n
APS Foundation<\/li>\n
Nina Mason Pulliam Charitable Trust<\/li>\n
NIH Initiative for Maximizing Student Diversity (IMSD)<\/li>\n
Arizona Department of Education Math and Science Partnerships (MSPs)<\/span><\/li>\n
Technology Research Initiative Fund (TRIF)<\/span><\/li>\n<\/ul>\n\n\n <\/body><\/html>\n\n <\/div>\n<\/div>\n\n \n
\n \n
\n
Future audiences Accordion Closed<\/span><\/h4>\n <\/span>\n <\/div>\n <\/a>\n
\n \n\n\n
We are always looking to continue to grow. In particular, we are interested in:<\/span><\/p>\n
\n
Broader Impacts<\/span><\/li>\n
Informal STEM education<\/span><\/li>\n
Volunteer and\/or community initiatives<\/span><\/li>\n
Higher education initiatives STEM outreach<\/span><\/li>\n
Communicating STEM to public audiences<\/span><\/li>\n
University-community partnerships<\/span><\/li>\n
Curriculum and instructional development<\/span><\/li>\n
User interface testing & evaluation<\/span><\/li>\n
Health and\/or behavioral health<\/span><\/li>\n
Local, State, Regional or National Research Laboratories and Educational Agencies<\/span><\/li>\n<\/ul>\n\n\n <\/body><\/html>\n\n <\/div>\n<\/div>\n\n <\/div>\n\n\n
\n
\n\n
\n
\n
Contact Center for STEM Teaching and Learning<\/h3>\n <\/div>\n
\n \n
\n