This program supports research on strategies focused on improving the use, usefulness, and impact of evidence in ways that benefit young people ages 5-25 in the United States.
Funding
Research Grants
on Improving the Use
of Research Evidence
Status:
Open
Open date:
March 7, 2024
Next Deadline:
May 1, 2024 3:00 pm EST
Awards
Introduction
Research Interests
Eligibility
Review Criteria
Research Grants on Improving the Use of Research Evidence
Awards
Major Research Grants
- $100,000 to $1,000,000 over 2-4 years, including up to 15% indirect costs.
- Studies involving secondary data analysis are at the lower end of the range (about $100,000-$300,000), whereas studies that involve new data collection can have larger budgets (typically $300,000-$600,000). Generally, only proposals to launch experiments in which settings (e.g., schools, child welfare agencies, justice settings) are randomly assigned to conditions are eligible for funding above $600,000.
- 2024 application deadlines for major research grants are: January 10, May 1, and August 7 at 3:00 PM ET.
Officers’ Research Grants
- $25,000–$50,000 over 1-2 years, including up to 15% indirect costs.
- Studies may be stand-alone projects or may build off larger projects. The budget should be appropriate for the activities proposed.
- 2024 application deadlines for Officers’ research grants are: January 10 and August 7 at 3:00 PM ET.
In addition to financial support, the Foundation invests significant time and resources in capacity-building for research grantees. We provide opportunities to connect with other scholars, policymakers, and practitioners, and we organize learning communities that allow grantees to discuss challenges, seek advice from peers and experts, and collaborate across projects. To strengthen grantees’ capacities to conduct and implement strong qualitative and mixed-methods work, the Foundation also provides access to a consultation service focused on those methods.
Introduction
Synopsis
Research grants on improving the use of research evidence fund research studies that advance theory and build empirical knowledge on ways to improve the use of research evidence by policymakers, agency leaders, organizational managers, intermediaries, and other decision-makers that shape youth-serving systems in the United States.
Background
Research evidence can be a powerful resource for policymakers, agency leaders, organizational managers, and others who make high-stakes decisions that shape youth-serving systems. In addition to informing policy formation and service delivery, evidence from systematic research can deepen decision-makers’ understanding of issues, generate reliable assessment tools, support strategic planning, and guide program improvement. But only if it is used.
The research on research use
There is a growing body of evidence on the science of using research evidence. While prevailing strategies to bring research evidence into policy and practice rest on models that increase decision-makers’ access to rigorous evidence and incentivize or mandate the adoption of programs with evidence of effectiveness, research evidence remains under-used.
One of the most common issues in letters of inquiry is a lack of sufficient grounding in the existing empirical literature on the use of research evidence. We strongly encourage applicants to review the resources for applicants, which comprise foundational texts on the use of research evidence as well as historical and more recent work by grantees.
Recent scholarship points to the limitations of models that prioritize research production and dissemination without adequate attention to would-be users’ realities. Decision-makers may be experts on their systems, but, even with access to rigorous research, they may not have the capacity or resources to critically evaluate, prioritize, and apply the findings. What’s more, the research may not be relevant to their specific contexts or communities.
In order to harness the full power of research evidence, decision-makers need deep engagement and support. Across disciplines and policy areas, studies are remarkably consistent in their identification of specific conditions that enable the use of research evidence:
- research is timely and relevant, addressing decision-makers’ needs and local contexts
- trusted relationships between researchers, intermediaries, and decision-makers enable collective sense-making of research and deliberation over how to use it
- evidence use is integrated into decision-makers’ existing routines, tools, and processes.
Toward new strategies
While an extensive body of knowledge provides a rich understanding of specific conditions that foster the use of research evidence, we lack robust, validated strategies for cultivating them. What is required to create structural and social conditions that support research use? What infrastructure is needed, and what will it look like? What supports and incentives foster research use? And, ultimately, how do youth outcomes fare when research evidence is used? This is where new research can make a difference.
Definitions
Strategies
Replicable methods, activities, or policies intended to improve the use of research evidence or to maximize its positive impact on decision-making and youth outcomes.
Research evidence
A type of evidence derived from studies that apply systematic methods and analyses to address predefined questions or hypotheses. These includes descriptive studies, intervention or evaluation studies, meta-analyses, and cost-effectiveness studies conducted within or outside research organizations.
Use of research evidence
The use of research evidence refers to the multiple ways research can be used, including: applying research evidence directly to a decision (instrumental use), the influence of research evidence on decision-makers’ understanding of problems and potential solutions (conceptual use), supporting existing stances or positions (strategic use), building trust with colleagues or educating constituents (relational use) or mandating decision-makers to engage with research (imposed use).
To learn more about the Foundation’s thinking about data vs. research evidence, see “Studying Ways to Improve the Use of Research Evidence: Distinguishing Data from Research Evidence,” by former Senior Program Officer Lauren Supplee.
Decision-makers
Those who create policies or make other high-level decisions that shape practice in youth-serving systems. Decision-makers include but are not limited to individuals or agencies with formal policymaking or policy implementation authority (e.g., school district leaders, state child welfare agency managers, county legislators, etc.); advocates who influence policymaking or policy implementation; or intermediaries such as professional associations (e.g., National Conference of State Legislatures, Council of Great City Schools, etc.) that provide information, consultation, and technical assistance to inform their members’ decision-making.
Research Interests
This program supports research on strategies focused on improving the use, usefulness, and impact of evidence in ways that benefit young people ages 5-25 in the United States. We welcome impact studies that test strategies for improving research use as well as whether improving research use leads to improved youth outcomes. We also welcome descriptive studies that reveal the strategies, mechanisms, or conditions for improving research use. Finally, we welcome measurement studies that explore how to construct and implement valid and reliable measures of research use.
We are particularly interested in research on ways to improve the use of research evidence by state and local policymakers, mid-level managers, and intermediaries. These decision-makers play important roles in deciding which programs, practices, and tools to adopt; deliberating ways to improve existing services; shaping the conditions for implementation; and making resource allocation decisions.
We invite studies from a range of disciplines, fields, and methods, and we encourage investigations into various youth-serving systems, including justice, housing, child welfare, mental health, and education. Previous studies have drawn on conceptual and empirical work from political science, communication science, knowledge mobilization, implementation science, and organizational psychology, among other areas.
Finally, we welcome critical perspectives that inform studies’ research questions, methods, and interpretation of findings.
We welcome studies that pursue one of three aims:
Building, identifying, or testing ways to improve the use of existing research evidence
This may include:
- Studies of strategies, mechanisms, or conditions that foster more routine and constructive uses of existing research evidence by decision-makers.
- Studies that test the effects of deliberate efforts to improve routine and beneficial uses of research in decision-making.
For example, prior work suggests that decision-makers often lack the institutional resources and some of the requisite skills to seek out and use research, and certain organizational norms and routines can help overcome those barriers. Studies might examine efforts to alter the decision-making environment by comparing the effectiveness of different ways (e.g., technical assistance, research-practice partnerships, cross-agency teams, etc.) to connect existing research with decision-makers, or by exploiting natural variation across decision-making environments to identify the conditions that improve research use.
Building, identifying, or testing ways to facilitate the production of new research evidence that responds to decision-makers’ needs
This may include:
- Studies to identify strategies for altering the incentive structures or organizational cultures of research institutions so that researchers conduct more practice- or policy-relevant studies and are rewarded for producing research that decision-makers consider useful.
- Studies to identify the relationships and organizational structures that lead to the prioritization of decision-makers’ needs in developing research agendas.
- Studies that examine ways to optimize organized collaborations among researchers, decision-makers, intermediaries, and other stakeholders to benefit youth.
For example, one might investigate the effectiveness of funders’ efforts to incentivize joint work between researchers and decision-makers. Others might test curriculum and training initiatives that develop researchers’ capacity to conduct collaborative work with practitioners.
Testing whether and under what conditions using research evidence improves decision-making and youth outcomes
This may include:
- Studies that examine the impact of research use on youth outcomes and the conditions under which using research evidence improves outcomes.
- The notion that using research will improve youth outcomes is a long-standing assumption, but there is little evidence to validate it. We suspect that the impact of research on outcomes may depend on a number of conditions, including the quality of the research and the quality of research use. One hypothesis is that the quality of the research and the quality of research use will work synergistically to yield strong outcomes for youth.
- Studies to identify and test other conditions under which using research evidence improves youth outcomes.
For example, recent federal policies have instituted mandates and incentives to increase the adoption of programs with evidence of effectiveness from randomized controlled trials, with the expectation that the use of these programs will lead to better outcomes. Do these policies actually increase the use of those programs and improve child outcomes?
These research interests call for a range of methods, including experimental or observational research designs, comparative case studies, or systematic reviews.
- Where appropriate, consider using existing methods, measures, and analytic tools for assessing research use so that your findings can be compared and aggregated across studies (see Gitomer and Crouse [2019] Studying the Use of Research Evidence: A Review of Methods).
- Existing measures may not be well-suited for some inquiries, so you may also propose to adapt existing measures or develop new ones. We strongly encourage applicants to utilize a new open-access methods and measures repository that shares existing protocols for collecting and analyzing data on research use
- Mixed methods studies that collect and integrate multiple types of data may be particularly advantageous given the difficulty of relying solely on self-report methods to study evidence use in complex deliberations and decision-making contexts.
Eligibility
Eligible Organizations
- The Foundation makes grants only to tax-exempt organizations. We do not make grants to individuals.
- We encourage proposals from organizations that are under-represented among grantee institutions, including Historically Black Colleges and Universities (HBCUs), Hispanic-serving Institutions, Tribal Colleges and Universities (TCUs), Alaska Native-Serving Institutions, Native Hawaiian-Serving Institutions, and Asian American Native American Pacific Islander Serving Institutions (AANAPISIs).
Eligible Principal Investigators
- The Foundation defers to the applying organization’s criteria for who is eligible to act as a Principal Investigator or Co-Principal Investigator on a grant. In general, we expect that all investigators will have the experience and skills to carry out the proposed work.
- We strive to support a diverse group of researchers in terms of race, ethnicity, gender, and seniority, and we encourage research projects led by Black or African American, Indigenous, Latinx, and/or Asian or Pacific Islander American researchers.
Eligible Studies
- Only studies that 1) align with the stated research interests of this program and 2) relate to the outcomes of young people between the ages of 5 and 25 in the United States are eligible for consideration.
- We do not support non-research activities such as program implementation and operational costs, or make contributions to building funds, fundraising drives, endowment funds, general operating budgets, or scholarships. Applications for ineligible projects are screened out without further review.
Review Criteria
All letters of inquiry are initially reviewed by internal staff with social science expertise. On occasion, internal reviewers will request more information from applicants or solicit expert opinions to better assess a project. In general, however, given the breadth of studies proposed in letters of inquiry, internal reviewers may lack deep knowledge of an applicant’s specific area of work, so avoid disciplinary jargon and use language appropriate for an educated lay audience.
We begin application reviews by looking at the importance of the research questions or hypotheses. Then we evaluate whether the proposed research designs and methods will provide strong empirical evidence on those questions.
For major research grants applications, based on internal review of the letter of inquiry, the Foundation either invites a full proposal for further consideration, or declines the application. We do not accept unsolicited full proposals. Officers’ research grants are awarded on the merit of the letter of inquiry alone.
- Fit with Research Interests
- The proposed study aligns with this program’s research interests and pursues one of three aims:
- Building, identifying, or testing ways to improve the use of existing research evidence.
- Building, identifying, or testing ways to facilitate the production of new research evidence that responds to decision-makers’ needs.
- Testing whether and under what conditions using research evidence improves decision-making and youth outcomes.
- The proposed study relates to the outcomes of young people between the ages of 5 and 25 in the United States.
- The proposed study aligns with this program’s research interests and pursues one of three aims:
- Conceptualization and Relevance
- The letter of inquiry reflects a mastery of relevant theory and empirical findings.
- The letter of inquiry provides a clear operational definition of the use of research evidence for the purposes of the proposed project.
- The letter of inquiry states the theoretical and empirical contributions the study will make to the existing research base.
- The letter of inquiry discusses how the findings will be relevant to policy or practice.
- Methods
- The proposed study employs rigorous methods (quantitative, qualitative, or mixed) that are commensurate to its goals.
- The study’s design, methods, and analysis plan fit the proposed research questions.
- The description of the research design makes clear how the empirical work will test, refine, or elaborate specific theoretical notions.
- Quantitative analyses might emphasize hypotheses and plans for testing them, while qualitative analyses might elaborate on how the research will illuminate processes underlying specific programs, policies, or practices.
- Plans for case selection, sampling, and measurement clearly state why they are well-suited to address the research questions or hypotheses.
- For example, samples must be appropriate in size and composition to answer the study’s questions. Qualitative case selection—whether critical, comparative, or otherwise—must also be appropriate to answer the proposed questions.
- The quantitative and/or qualitative analysis plan demonstrates awareness of the strengths and limits of the specific analytic techniques and how they will be applied in the current case.
- If proposing mixed methods, plans for integrating the methods and data are clear and compelling.
- If proposing quantitative methods, the letter of inquiry demonstrates that the study will have adequate statistical power to detect meaningful effects.
- The letter of inquiry demonstrates adequate consideration of the gender, ethnic, and cultural appropriateness of concepts, methods, and measures.
- Feasibility
- The proposed methods, time frame, staffing plan, and other resources are realistic.
- The letter of inquiry assures that data will be successfully collected, describes the team’s prior experience collecting such data, and identifies strategies for maximizing response rates and access to data sources.
- Prior training and publications demonstrate that the research team has a track record of conducting strong research and communicating it successfully.
- Be sure to demonstrate that the research team is well-positioned to address the varied tasks demanded by the study’s conceptualization and research design. This might include combining expertise across disciplines or methods.
- Be specific about the value of each member’s contributions to the team. We strongly discourage teams that comprise many senior investigators for very limited time and effort or otherwise make cursory nods to multi-disciplinary or mixed-role project teams. Instead, clearly justify the unique value of each team member and the specific role each will play in different stages of the project.
Where appropriate, we value projects that:
- harness the learning potential of mixed methods and interdisciplinary work
- involve practitioners or policymakers in meaningful ways to shape the research questions, interpret preliminary and final results, and communicate their implications for policy and practice
- combine senior and junior staff in ways that facilitate mentoring of junior staff
are led by members of racial or ethnic groups underrepresented in academic fields - generate data useful to other researchers and make such data available for public use
- demonstrate significant creativity and potential to advance the field, for example by introducing new research paradigms or extending existing methods, measures and analytic tools to allow for comparison across studies.
