Image of WMU student center in the fall

The Evaluation Center

2023-24 Annual Report

The Evaluation Center was established in 1965 at The Ohio State University and relocated to Western 麻豆传媒应用 University in 1973. It is a research unit that reports to the Vice President for Research and Innovation. Our mission is to advance the theory, practice, and use of evaluation through scholarship, education, partnership, leadership, and stewardship. 

Letter from the Executive Director

As I reflect on the 2023-24 fiscal year, it is with pride and gratitude that I share some of The Evaluation Center鈥檚 accomplishments and milestones. September 1, 2023, marked the center鈥檚 50th anniversary at Western 麻豆传媒应用 University, celebrating half a century of leading the evaluation field from our home in Kalamazoo (following eight years at Ohio State University). Our 50th year of operation at WMU coincided with multiple standout achievements:

We鈥檙e thrilled with these accomplishments. We鈥檙e just as proud of our decades-long track record of providing evaluation guidance, insights, and engagement opportunities through the Evaluation Checklists Project, Evaluation Cafe, , and , all of which remain open-access. 

Photo of center of Campus

2023-24 Activities

The Evaluation Center continued to advance the theory, practice, and use of evaluation by sharing insights through presentations, publications, workshops, and more. Our efforts extended beyond knowledge sharing to fostering meaningful connections and strengthening the evaluation community. 
October 16, 2023
Headshot of Thomaz Chianca

Thomaz Chianca, Ph.D.

Managing Partner

COMEA Relevant Evaluations

 

 

 

Photo of Jane Davidson outdoors

Jane Davidson, Ph.D.

Founder, Real Evaluation

 

 

 

 

Drs. Chianca and Davidson visited The Evaluation Center to discuss their work with Save the Children International and the Laudes Foundation. They provided an in-depth view of a retrospective impact evaluation they did in Ethiopia for Save the Children that ended up as the main case study they developed for an they recently launched.

 
March 13, 2024
Photo of Felicia Bohanon against a grey background

Felicia R. Bohanon, Ed.D.

Executive Director, Office of Precollegiate Programs, Northern Illinois University

President, American Evaluation Association

 

 

 

Dr. Bonahan鈥檚 visit included in-person meetings with Evaluation Center and Evaluation Lab staff, doctoral students, and 麻豆传媒应用 Association for Evaluation board members. She also gave a presentation for our Evaluation Cafe series titled 鈥淭he Synergy of Evaluation and Story.鈥 Her time at WMU continued the twelve-year tradition of official visits by American Evaluation Association presidents.

Photo of students in a classroom during a presentation

Our Evaluation Caf茅 features discussions and presentations about evaluation over the lunch hour. Caf茅 presenters introduce new ideas, solicit feedback on real-world evaluation issues, and share recent evaluation work. This longstanding speaker series is offered both in-person and virtually, with the new hybrid format leading to increased participation.

In 2023-24, The Evaluation Center hosted 12 presentations featuring 16 speakers on diverse topics. 

photo of a Zoom screen during meeting

EvaluATE hosts a series of , which are facilitated conversations to support peer-to-peer learning about evaluation. , located within The Evaluation Center, is the evaluation hub for the National Science Foundation鈥檚 Advanced Technological Education program.

In 2023-24, EvaluATE hosted 12 webchats on the following topics:

  • Collecting and Reporting Demographic Data
  • Post-Evaluation Action Planning
  • Asset-focused Evaluation Reporting
  • Managing Evaluation Projects
  • Qualitative Evaluation
  • Preparing for the 2024 ATE Survey
  • Completing the 2024 ATE Survey
  • Reflecting on 2023
  • Lessons from ATE evaluators
  • Creating Evaluation Summaries
  • Publishing your Evaluation Findings & IRB Woes
  • Finding and Hiring an Evaluator
  • The Role of AI in Evaluation
Photo of Megan Lopez giving a presentation at a conference in front of a digital screen

Evaluation Center staff regularly present at national and regional conferences. In 2023-24, our staff gave 12 presentations at five conferences.

Becho, L.W. (2024, April). Stories from an evaluator. Invited presentation at the Tennessee Tech University annual symposium for Program Planning and Evaluation, Virtual.

Becho, L. W., & Lopez, M. (2023, July). Crafting clear and concise logic models for successful ATE proposals and evaluations. Presentation at the High Impact Technology Exchange Conference, Atlanta, GA.

Becho, L. W., Leung, K., & Lewis, J. (2023, October). Developing and assessing success metrics for work-based learning. Presentation at the Advanced Technological Education Principal Investigators Conference, Washington, DC.

 (2023, October). Celebrating ATE鈥檚 evolution through findings from the ATE Survey. Presentation at the Advanced Technological Education Principal Investigators Conference, Washington, DC.

 (2023, October). What PIs need to know about preparing NSF annual reports 鈥 Now! Presentation at the Advanced Technological Education Principal Investigators Conference, Washington, DC.

 (2023, October). Words create worlds: Using appreciative inquiry and the power of stories for strategic thinking. Presentation at the American Evaluation Association Conference, Indianapolis, IN.

Echols-Miller, E., Osbourne, J., Watts, B., & Wingate, L. (Oct. 13, 2023). Fulfilling the multi-faceted commitments of university-based evaluation centers. Presentation at the American Evaluation Association annual conference, Indianapolis, IN.

Marshall, V. (2023, July). From evaluation to action: Using evaluation findings to improve your project. Presentation at the High Impact Technology Exchange Conference, Atlanta, GA. 

Marshall, V. (2023, October). Values and valuing in evaluation: A mixed method study. Poster at the American Evaluation Association Conference, Indianapolis, IN.

Marshall, V., & Slowinski, M. (2023, July). Workplace-based learning in ATE. Poster at the High Impact Technology Exchange Conference, Atlanta, GA. 

Marshall, V., & McKeown, G. (2023, October). Facilitators to evaluation in ATE. Breakfast roundtable at the Advanced Technological Education Principal Investigators Conference, Washington, DC.

Robertson, K. N., & Wingate, L. A. (2024, April). Valeo: Practical evaluation training powered by Western 麻豆传媒应用 University. Western 麻豆传媒应用 Evaluators Network. [virtual] 

Evaluation Center staff members published 18 blogs in 2023-24.

Becho, L. W., & Harnar, M. (2023, November). . AEA365 blog. 

Hooker, S. (2023, November). . AEA365 blog. 

Hooker, S. (2024, January). . EvaluATE blog.

Hooker, S. (2023, July). . EvaluATE blog.

Marshall, V. (2024, May). AEA365 blog.

Marshall, V., & Becho, L. W. (2024, March). . EvaluATE blog. Western 麻豆传媒应用 University.

Marshall, V. (2024, June). EvaluATE blog. 

Robertson, K. & Wingate, L. A. (2023, December 1). . AEA365 blog. 

Robertson, K. & Wingate, L.A. (2024, April). EvaluATE blog. 

Robertson, K. & Wingate, L.A. (2023, August). . EvaluATE blog. 

Robertson, K. & Wingate, L.A. (2023, July). . EvaluATE blog. 

Robertson, K. & Wingate, L.A. (2023, July). . EvaluATE blog. 

Robertson, K. & Wingate, L.A. (2023, July). . EvaluATE blog. 

Robertson, K. & Wingate, L.A. (2023, July). EvaluATE blog. 

Watts, B. (2023, November). AEA365 blog.

Wingate, L. A. (2023, November 28). AEA365 blog.

Wingate, L. A. (2023, November 26). . AEA365 blog.

Youker, B. (2023, December). . AEA365 blog.

JMDE logo Journal of MultiDisciplinary Evaluation spelled out below JMDE

The Evaluation Center is home to the . Center staff regularly publish articles on evaluation theory, practice, and methods. 

 

In 2023-24, we published nine articles in as many journals.  

Lee-Easton, M., Magura, S., Abu-Obaid, R., Reed, P., Allgaier, B., Fish, E., Maletta A.L., Amaratunga P., Lorenz-Lemberg B., Levitas, M., & Achtyes, E. D. (2024). Polysubstance use patterns among individuals applying for opioid-use disorder treatment in the U.S. Journal of Substance Use, 1鈥8. .

Lee-Easton, M. J., & Magura, S. (2023). Discrepancies in ratings of behavioral healthcare interventions among evidence-based program resources websites. Inquiry: A Journal of Medical Care Organization, Provision and Financing, 60, 469580231186836.

Lee-Easton, M. J., Magura, S., Abu-Obaid, R., Reed, P., Allgaier, B., Fish, E., Maletta A.L., Amaratunga P., Lorenz-Lemberg B., Levitas, M.,  & Achtyes, E. (2024). Direct-to-definitive urine and oral fluid test results for unscreened and rarely screened drugs in individuals applying for methadone treatment in 7 U.S. states. Journal of Psychoactive Drugs, 1鈥12. .

Magura, S., Lee-Easton, M. J., Abu-Obaid, R., Reed, P., Allgaier, B., Fish, E., Maletta A.L., Amaratunga P., Lorenz-Lemberg, B., Levitas, M., & Achtyes, E. D. (2024). Prevalence and drug use correlates of inadvertent fentanyl exposure among individuals misusing drugs in seven U.S. states. Journal of Addictive Diseases, 1鈥9. .

Magura, S., Lee-Easton, M. J., Abu-Obaid, R., Reed, P., Allgaier, B., Fish, E., Maletta A.L., Amaratunga P., Lorenz-Lemberg B., Levitas M. & Achtyes, E. D. (2023). Comparing presumptive with direct-to-definitive drug testing in oral fluid vs. urine for a U.S. national sample of individuals misusing drugs. Drug and Alcohol Dependence, 250, .

Magura, S., Lee, M.J., Abu-Obaid, R.N., Landsverk, J., DeCamp, W. Rolls-Reutz, J. & Perkins, D.F. (2023). The influence of evidence-based program registry websites for dissemination of evidence-based interventions in behavioral healthcare. Evaluation and Program Planning, 97(102214).

Montrosse-Moorhead, B., Schr枚ter, D., & Becho, L.W. (2024). The garden of evaluation approaches. American Journal of Evaluation, 42(2), 166-185. 

Youker, B.W., & Ballard, A. (2024). Goal-free evaluation: An orientation for foundations鈥 evaluations 鈥 Updated 2024. The Foundation Review, 16(1). (Original work published 2014.)

Youker, B.W. (2024). Scriven's goal-free evaluation. Journal of Multidisciplinary Evaluation, 20 (47).

Image of laptop with EvaluATE homscreen and a cup of coffee on the desk

hosts open-access webinars to support evaluators and project staff with practical tools and insights. Each session is recorded and made available to the evaluation community, ensuring continued access to critical learning materials at any time.

In 2023-24, EvaluATE held five webinars:

Evaluation essentials for non-evaluators: Understanding the basics and benefits of evaluation.

. Strategies and insights into evaluation plans for NSF ATE proposals (Mentor Connect).

. Evaluation essentials for non-evaluators: Understanding the basics and benefits of evaluation (Mentor Connect).

. Transforming STEM education: Unleashing qualitative insights for inclusive learning environments.

Brianna Hooks Singletary standing at a podium giving a presentation

hosts workshops at various conferences to promote sound evaluation practice. In 2023-24, EvaluATE presented four workshops at three conferences:

Becho, L.W., & Lopez, M. (2023, October). Interpreting Evaluation Data 鈥 Unlocking Insights for Project Improvement. Preconference workshop at the Advanced Technological Education Principal Investigators Conference, Washington, DC.

Becho, L.W., Brobst, J., Brown, E., Gruber, J., Heath, B., LoRe, S., & Tewalt, T. (2023, July). ATE Evaluators: Connect, Share, Learn. Special Interest Group (SIG) at the High Impact Technology Exchange Conference, Atlanta, GA.

Lopez, M., & Wingate, L.A. (2024, April). A grants professional鈥檚 guide to getting the most out of your evaluation. Workshop at the Florida Council for Resource Development conference, Miami, FL.

Lopez, M., & Wingate, L.A. (2024, April). Strategies and insights for evaluation planning for federal grant proposals. Workshop at the Florida Council for Resource Development conference, Miami, FL.

Outdoor photo of WMU logo on a sign with flowers growing around it

2023-24 Grants and Contracts

The center's portfolio included 11 grant and contract-funded projects in 2023-24. They span the areas of human services, higher education, and substance abuse and addiction treatment.

These projects are worth more than $14 million over their total award periods. Projects active in this fiscal year are listed below. The award values reflect the overall value of these grants and contracts, not necessarily the amount received in 2023-24.

TitleSponsorInvestigatorsStart DateEnd DateTotal Award
Evaluation of American Heart Association of 麻豆传媒应用 Social Responsibility ProjectAmerican Heart AssociationLori Wingate4/5/20246/30/2024$20,089
Evaluation of Electronic Case ReportingCouncil of State and Territorial EpidemiologistsLori Wingate and Brad Watts6/1/20237/31/2024$299,641
EvaluATE 4.0: Evaluation Resource Hub for Advanced Technological EducationNational Science FoundationLyssa Wilson Becho and Lori Wingate1/15/201912/31/2024$4,973,312
EvaluATE 5.0: Evaluation Resource Hub for Advanced Technological EducationNational Science FoundationLyssa Wilson Becho, Lori Wingate, and Megan Lopez1/1/202412/31/2028$6,211,812
Faculty Online LearningNational Science FoundationMelissa Dancy10/15/20219/30/2026$256,319
Creating Statewide Community Partnerships: Spanning Boundaries between Public Health, Emergency Housing & Criminal JusticeNational Institute of Health via Face Addiction NowBrad Watts9/22/20239/21/2024$209,734
Evaluation of Goodwill Lifeguides ProgramGoodwill Industries of SW 麻豆传媒应用Kelly Robertson and Lyssa Wilson Becho5/1/20227/31/2023$22,500
Evaluation of School Infrastructure ProgramsDepartment of EducationBrad Watts10/1/20189/30/2023$350,000
麻豆传媒应用 Primary Care Association Health Center Careers Training Program麻豆传媒应用 Primary Care AssociationBrad Watts10/2/202310/31/2024$43,734
Advancing the Use of Oral Fluids to monitor Therapeutic and Illicit Drugs in Outpatient Clinical and Field SettingsU.S. Department of Health and Human ServicesSteve Magura9/30/20192/29/2024$1,447,335
Evaluation of WMU's Professional Development InstituteWestern 麻豆传媒应用 UniversityKelly Robertson8/1/20239/30/2024$9,000
Evaluation of Research University AllianceNational Science Foundation via University of 麻豆传媒应用Brad Watts2/1/20213/31/2024$230,713
Evaluation of WeTalkWestern 麻豆传媒应用 UniversityBrad Watts7/31/20235/31/2024$14,800
Evaluation Center staff in front of a WMU banner

2023-24 Staff Highlights

Explore the achievements and contributions of The Evaluation Center team.

Celebrating 50 Years of Impact at WMU

Evaluation Center 50th anniversary logo

In 2023-24, The Evaluation Center celebrated its 50th anniversary at Western 麻豆传媒应用 University with a yearlong tribute to its legacy and contributions to evaluation.