The State of Evaluating Race-Focused Humanities Programs in 2024

Risk Management in Research & Evaluation Projects

When applying for the INcommon Grant Program, research and evaluation projects face unique risk management challenges. A key regulation that applies to this sector is the requirement to comply with the National Science Foundation's (NSF) guidelines for research involving human subjects, which mandates adherence to specific ethical standards and Institutional Review Board (IRB) approvals. For instance, if a research project involves assessing the impact of a public humanities program on community engagement, it must obtain prior approval from an IRB and follow NSF's guidelines for human subject research.

One verifiable delivery challenge unique to research and evaluation projects is ensuring the validity and reliability of the data collected, particularly when assessing complex social phenomena such as racial and ethnic disparities. This requires careful design of evaluation methodologies, rigorous data analysis, and often, the use of mixed-methods approaches to triangulate findings. For example, a project evaluating the effectiveness of a humanities-based intervention aimed at reducing racial bias must employ robust statistical methods and qualitative data collection techniques to capture nuanced changes in participants' attitudes and behaviors.

Eligibility Barriers and Compliance Traps

Research and evaluation projects under the INcommon Grant Program must navigate several eligibility barriers and compliance traps. One major risk is failing to meet the NSF's research and evaluation standards, which can lead to grant disqualification. Applicants must also be aware of potential biases in their research design and data analysis, as these can undermine the credibility of their findings and lead to non-compliance with the grant's requirements. Furthermore, projects involving collaborations with multiple stakeholders, such as community organizations and educational institutions, must ensure that all partners are aware of and comply with the grant's terms and conditions.

Another significant risk is related to the grant's focus on public humanities projects. Applicants must ensure that their research and evaluation plans are closely aligned with the grant's objectives and that their methodologies are tailored to assessing the impact of humanities-based interventions. For example, a project focused on evaluating the impact of a public history program on community cohesion must demonstrate how its research design and evaluation methods will capture the program's effects on social outcomes.

Measuring Success and Reporting Requirements

The INcommon Grant Program requires research and evaluation projects to report on specific outcomes and key performance indicators (KPIs). Applicants must ensure that their projects are designed to measure outcomes that align with the grant's priorities, such as advancing crucial conversations around race and ethnicity through the humanities. KPIs may include metrics such as the number of participants engaged in project activities, changes in participants' knowledge or attitudes, and the project's overall impact on community dialogue and understanding.

To meet these reporting requirements, research and evaluation projects must have robust data collection and analysis systems in place. This may involve using standardized survey instruments, conducting in-depth interviews or focus groups, and analyzing administrative data to assess project outcomes. For example, a project evaluating the effectiveness of a humanities-based curriculum in promoting diversity and inclusion must collect and analyze data on student outcomes, teacher feedback, and community engagement.

Q: How can I ensure that my research and evaluation project complies with the NSF's guidelines for human subject research? A: To ensure compliance, familiarize yourself with the NSF's guidelines and consult with your organization's IRB to obtain prior approval for your research design and methods.

Q: What are the most significant risks associated with research and evaluation projects under the INcommon Grant Program? A: Key risks include failing to meet NSF research and evaluation standards, biases in research design and data analysis, and non-compliance with grant requirements.

Q: How can I design my project to meet the grant's reporting requirements and measure success? A: Ensure that your project is designed to measure outcomes aligned with the grant's priorities, and establish robust data collection and analysis systems to track KPIs such as participant engagement and project impact.