Using a Research-Practitioner Partnership approach to developing a shared evaluation and research agenda for CSforALL: RPPforCS is a National Science Foundation funded project.
The four-year project will:
-
Develop a Connected Community of Practice.
-
Develop & manage a participant-driven, multi-site research agenda.
-
Convene a Researcher-Evaluator Working Group (R-EWG) to develop a process for advancing the shared-research agenda.
-
Collect qualitative and quantitative data about RPPforCS projects’ implementation and common impact data.
-
Provide an infrastructure for dissemination of project work.
The RPPforCS project connects the teams through virtual meetings (webinars), in-person meetings, and meetings of the R-EWG. Here you will find information about the participating grant teams, project activities, and resources from the project.
Welcome Cohort 4!
The latest group of CSforAll: RPPs has been approved by the NSF, and you can find a list of those partnerships as of September 11th, 2020, here.
Our Core Leadership Team:
This material is based upon work supported by the National Science Foundation (Award No. 1745199). Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.
Other Partner Organizations:
Expanding Computing Education Pathways (ECEP)
Here is our 2020 Survey Highlights Screencast:
For the full report, CLICK HERE​
​
For a transcript of this video, CLICK HERE
Resources Created through RPPforCS
​
-
What can SageFox do for you?SageFox specializes in both formative and summative program evaluation and research on educational projects. We can both help with the development of a grant proposal or come in as partners on an existing project. In both circumstances, we would work with you to develop a research or evaluation plan that is tailored to your project. This would include: Co-development of a logic model to deeply understand the approach the project will take to realize its objectives and goals Development or adaptation of instruments to measure the project objectives Implementation of these tools, including surveys, tests, focus groups, interviews, classroom observations, etc. Regular reporting of outcomes to your team and providing suggestions for increasing the effectiveness of the project Helping your team think through the consequences of the evaluation or research Supporting the reporting to the funding agency Helping disseminate the results of your project
-
How does SageFox approach formative evaluation?Our focus is on providing information that will help improve the project as it moves forward and makes important decisions about future growth. As such, we involve all major stakeholders in the information-gathering process and collaborate with project leadership to make sense of their feedback.
-
How does SageFox approach summative evaluation?Summative evaluation is meant to provide an overview of whether and how your project has met its stated goals. Our focus is not only on providing information that tells you how well you have met the objectives of the project but also on trying to understand why you may not have met certain goals. As such, we prefer to collaborate with your team not only in gathering the summative data but also in interpreting what it means in the context of your project. SageFox’s collaborative approach and on-going communication means there are no surprises in summative reporting.
-
How does SageFox approach research?We believe research should furthers the state of knowledge in the fields of education and evaluation while being of use to educational practitioners in developing and implementing projects. As such, we focus not only on the best way to answer a research question but also on how it may inform future projects in the field. We have performed research both as principal investigators on dedicated research grants and also closely collaborate in dissemination efforts following program evaluations.
-
How should I work with SageFox?Although we can work with an existing project, we can be more valuable to you if we can be part of the team developing the initial grant proposal. We suggest that you contact us early enough that we can use our experience with other projects to help you frame your grant and ensure that the evaluation or research component is integrated well into the rest of the proposal. Once a grant is funded, our preferred relationship with our clients is one where we work very collaboratively and where the communication level is high enough that we can respond well to the project‘s changing needs.
-
How much will it cost?Typically, an evaluator should cost about 10% of the overall project budget, depending on the nature of the work. For educational research, this proportion may be higher depending on what proportion of the project is based on research.
-
Conflict of Interest PolicyINTRODUCTION This policy governing financial conflict of interest applies to all Investigators employed by SageFox Consulting. In the event a financial conflict of interest is discovered, all relevant activities may be suspended until the financial conflict of interest is resolved or other action deemed appropriate is implemented. Violation of any part of these policies may also constitute cause for disciplinary or other administrative action pursuant to Institutional policy. DEFINITIONS Conflict of Interest Administrator means the individual at SageFox who advises on conflict of interest matters. Family means any member of the Investigator’s immediate family, specifically, any dependent children and spouse. Financial Interest means anything of monetary value received or held by an Investigator or an Investigator’s Family, whether or not the value is readily ascertainable, including, but not limited to: salary or other payments for services (e.g., consulting fees, honoraria, or paid authorships for other than scholarly works); any equity interests (e.g., stocks, stock options, or other ownership interests); and intellectual property rights and interests (e.g., patents, trademarks, service marks, and copyrights), upon receipt of royalties or other income related to such intellectual property rights and interests. Financial Interest does NOT include: salary, royalties, or other remuneration from the Institution; income from the authorship of academic or scholarly works; income from seminars, lectures, or teaching engagements sponsored by or from advisory committees or review panels for U.S. Federal, state or local governmental agencies; U.S. institutions of higher education; U.S. research institutes affiliated with institutions of higher education, academic teaching hospitals, and medical centers; or equity interests or income from investment vehicles, such as mutual funds and retirement accounts, so long as the Investigator does not directly control the investment decisions made in these vehicles. For Investigators, Financial Interest also includes any reimbursed or sponsored travel undertaken by the Investigator and related to his/her institutional responsibilities. This includes travel that is paid on behalf of the Investigator rather than reimbursed, even if the exact monetary value is not readily available. It excludes travel reimbursed or sponsored by U.S. Federal, state or local governmental agencies, U.S. institutions of higher education, research institutes affiliated with institutions of higher education, academic teaching hospitals, and medical centers. Significant Financial Interest means a Financial Interest that reasonably appears to be related to the Investigator’s Institutional Responsibilities, and: if with a publicly traded entity, the aggregate value of any salary or other payments for services received during the 12 month period preceding the disclosure, and the value of any equity interest during the 12 month period preceding or as of the date of disclosure, exceeds $5,000; or if with a non-publicly traded entity, the aggregate value of any salary or other payments for services received during the 12 month period preceding the disclosure exceeds $5,000; or if with a non-publicly-traded company, is an equity interest of any value during the 12 month period preceding or as of the date of disclosure; or is income related to intellectual property rights and interests not reimbursed through the Institution. Financial Conflict of Interest means a Significant Financial Interest (or, where the Institutional official requires disclosure of other Financial Interests, a Financial Interest) that the Institution reasonably determines could directly and significantly affect the design, conduct or reporting of Institutional research. Conflict of Interest Administrator means the individual within the Institution that is responsible for the solicitation and review of disclosures of significant financial interests including those of the Investigator’s Family related to the Investigator’s institutional responsibilities. Institutional responsibilities means the Investigator’s responsibilities associated with his or her Institutional appointment or position, such as research, teaching, clinical activities, administration, and institutional, internal and external professional committee service. Investigator means any individual who is responsible for the design, conduct, or reporting of PHS sponsored research, or proposals for such funding. This definition is not limited to those titled or budgeted as principal investigator or co-investigator on a particular proposal, and may include postdoctoral associates, senior scientists, or graduate students. The definition may also include collaborators or consultants as appropriate. Public Health Service or PHS means the Public Health Service of the U.S. Department of Health and Human Services, and any components of the PHS to which the authority of the PHS may be delegated. The components of the PHS include, but are not limited to, the Administration for Children and Families, Administration on Aging, Agency for Healthcare Research and Quality, Agency for Toxic Substances and Disease Registry, Centers for Disease Control and Prevention, Federal Occupational Health, Food and Drug Administration, Health Resources and Services Administration, Indian Health Service, National Institutes of Health, and Substance Abuse and Mental Health Services Administration. Research means a systematic investigation, study, or experiment designed to contribute to generalizable knowledge relating broadly to public health, including behavioral and social-sciences research. The term encompasses basic and applied research (e.g., a published article, book or book chapter) and product development (e.g., a diagnostic test or drug). CONFLICT OF INTEREST This policy is predicated on the expectation that Investigators should conduct their affairs so as to avoid or minimize conflicts of interest, and must respond appropriately when conflicts of interest arise. To that end, this policy informs faculty about situations that generate conflicts of interest related to research, provides mechanisms for Investigators and the Institution to manage those conflicts of interest that arise, and describes situations that are prohibited. Every Investigator has an obligation to become familiar with, and abide by, the provisions of this policy. If a situation raising questions of conflict of interest arises, an Investigator should discuss the situation with the Institutional official. DISCLOSURE OF FINANCIAL INTERESTS All Investigators are required to disclose their outside financial interests to the Institution on an annual and on an ad hoc basis, as described below. The Conflict of Interest Administrator is responsible for the distribution, receipt, processing, review and retention of disclosure forms Regardless of the disclosure requirements, the Investigator, in his or her own best interest, is encouraged to disclose any other financial or related interest that could present an actual conflict of interest or be perceived to present a conflict of interest. Annual Disclosures All Investigators must disclose their Significant Financial Interests to the Institution, through the Institutional Official, on an annual basis. All forms should be submitted to the Institutional official or designee by July 1 for the previous calendar year or as determined by the sub-recipient. Ad hoc Disclosures In addition to annual disclosure, certain situations require ad hoc disclosure. All Investigators must disclose their Significant Financial Interests to the Institution, through the Institutional Official, within 30 days of their initial appointment or employment. Prior to entering into sponsored projects or applications for sponsored projects, where the Investigator has a Significant Financial Interest, the Investigator must submit to the Conflict of Interest Administrator an ad hoc updated disclosure of his or her Significant Financial Interests with the outside entity. The Institution will not submit a research proposal unless the Investigator(s) have submitted such ad hoc disclosures. In addition, all Investigators must submit to the Institutional official an ad hoc disclosure of any Significant Financial Interest they acquire during the course of the year within thirty (30) days of discovering or acquiring the Significant Financial Interest. Travel Investigators must also disclose reimbursed or sponsored travel related to their institutional responsibilities, as defined above in the definition of Financial Interest. Such disclosures must include, at a minimum, the purpose of the trip, the identity of the sponsor/organizer, the destination, the duration, and, if known, the monetary value. The Institutional Official will determine if additional information is needed (e.g., the monetary value if not already disclosed) to determine whether the travel constitutes a Financial Conflict of Interest with the Investigator’s research. REVIEW AND DECISION OF THE INSTITUTIONAL OFFICIAL If the disclosure form reveals a Significant Financial Interest, it will be reviewed promptly by the Institutional Official or designee for a determination of whether it constitutes a Financial Conflict of Interest. If a Financial Conflict of Interest exists, the Conflict of Interest Administrator will take action to eliminate, reduce, or manage the conflict, as appropriate. A Financial Conflict of Interest will exist when the Conflict of Interest Administrator or designee determines that a Significant Financial Interest could directly and significantly affect the design, conduct, or reporting of PHS-supported research. If the Conflict of Interest Administrator determines that there is a Financial Conflict of Interest that can be managed, he or she must require and approve a written management plan before any related research goes forward. The affected Investigator or the COI Committee is responsible for developing and submitting a proposed management plan, in consultation with the Conflict of Interest Administrator. To address complex situations, oversight committees may be established by the Conflict of Interest Administrator to periodically review the ongoing activity, to monitor the conduct of the activity (including use of students and postdoctoral appointees), to ensure open and timely dissemination of the research results, and to otherwise oversee compliance with the management plan. REPORTING TO PHS Should any reported conflict or non-compliance require reporting to PHS, the Conflict of Interest Administrator will report in accordance with PHS regulations. If the funding for the Research is made available from a prime PHS-awardee, such reporting shall be made available to the prime awardee such that they may fulfill their reporting obligations to the PHS. INVESTIGATOR NON-COMPLIANCE Disciplinary Action In the event of an Investigator’s failure to comply with this Policy, the Conflict of Interest Administrator may suspend all relevant activities or take other disciplinary action until the matter is resolved or other action deemed appropriate by the Conflict of Interest Administrator is implemented. A Conflict of Interest Administrator’s decision to impose sanctions on an Investigator because of failure to comply with this Policy, or failure to comply with the decision of the Conflict of Interest Administrator, will be described in a written explanation of the decision to the investigator, COI Committee, and, where applicable, the IRB, and will notify the individual of the right to appeal the decision. Retrospective Review In addition, if the Conflict of Interest Administrator determines that a Financial Conflict of Interest was not identified or managed in a timely manner, including but not limited to an Investigator’s failure to disclose a Significant Financial Interest that is determined to be a Financial Conflict of Interest, or failure by an Investigator to materially comply with a management plan for a Financial Conflict of Interest. Documentation of the retrospective review shall include the project number, project title, PI, name of Investigator with the Financial Conflict of Interest, name of the entity with which the Investigator has the Financial Conflict of Interest, reason(s) for the retrospective review, detailed methodology used for the retrospective review, and findings and conclusions of the review. The Institutional official will update any previously submitted report to the PHS or the prime PHS-awardee relating to the research, specifying the actions that will be taken to manage the Financial Conflict of Interest going forward. If bias is found, the report will include a mitigation report in accordance with the PHS regulations, including a description of the impact of the bias on the research project and the plan of action to eliminate or mitigate the effect of the bias. TRAINING Each Investigator must complete training on this Policy prior to engaging in research funded by PHS, and at least every four years thereafter. They must also complete training within a reasonable period of time as determined by the Conflict of Interest Administrator in the event that this Policy is substantively amended in a manner that affects the requirements of Investigators, or if it is determined that the Investigator has not complied with this policy or with a management plan related to their activities. RECORD RETENTION The Conflict of Interest Administrator will retain all disclosure forms, conflict management plans, and related documents for a period of three years from the date the final expenditure report is submitted to the PHS or to the prime PHS awardee. CONFIDENTIALITY To the extent permitted by law, all disclosure forms, conflict management plans, and related information will be confidential. However, the Institution may make such information available to an agency funding research of the faculty member, to a requestor of information concerning financial conflict of interest related to PHS funding or to the primary entity who made the funding available to the Institution, if requested or required. If the Institution is requested to provide disclosure forms, conflict management plans, and related information to an outside entity, the Investigator will be informed of this disclosure. PUBLIC ACCESSIBILITY Prior to the expenditure of funds, the Institution will publish on a publicly-accessible website or respond to any requestor within five business days of the request, information concerning any Significant Financial Interest that meets the following criteria: The Significant Financial Interest was disclosed and is still held by the Investigator; A determination has been made that the Significant Financial Interest is related to the PHS-funded research; and A determination has been made that the Significant Financial Interest is a Financial Conflict of Interest. The information to be made available shall be consistent with the requirements of the PHS policy. REGULATORY AUTHORITY This policy implements the requirements of 42 CFR 50 and 45 CFR 94; where there are substantive differences between this policy and the requirements, the requirements shall take precedence.
RPP Project Database
The RPPforCS searchable database allows you to search through our existing community of projects on a range of characteristics. You can use this resource to find people who are geographically close to you, working on a similar problem of practice, working with a similar student or teacher population, and more! The database will automatically update itself with your chosen filters shortly after selecting them.
GigCity CS4All
Jennifer Ellis
This RPP will develop a PreK-14 CS pathway that integrates ongoing initiatives and best practices already in place in districts across the nation. The project team will implement a small pilot of the program, refine the program, and create a scalable implementation plan that broadens the participation of underrepresented rural CS students.
Increasing Urban Youth Participation in Computing
Michael Lee
The primary goal of this project is to create a sustainable ecosystem of young programmers, mentors, and teachers in the city of Newark, NJ by engaging underrepresented and underserved middle school students and their parents, developing mentor-mentee relationships, and through teacher professional development.
CLE TTP
Debbie Jackson
This RPP will build upon several NSF-supported efforts in Cleveland to develop pathways for students in CS and IT from high school to career, community college and/or four-year colleges and universities through a range of activities, including high school mathematics and CS courses, internships, and summer programs for students.
The Beauty and Joy of Computing
Kinnis Gosha
Morehouse College proposes to explore outcomes of a novel teacher professional development program that prepares in-service high school teachers to teach the Advance Placement Computer Science Principles course, the Beauty and Joy of Computing, with support from undergraduate computer science majors.
Universal Design for CS
Maya Israel
This RPP will develop and make available a range of professional development resources that will allow teachers to challenge their beliefs about students with disabilities and develop skills and knowledge about effective instructional approaches for accessible and engaging instruction for all their learners, including those with disabilities.
Jumpstarting Philadelphia CSforAll through an RPP
Jeffrey Popyack
The Jumpstarting Philly RPP aims to build upon the progress and efforts of CS4Philly and the Philadelphia STEM Ecosystem CS Workgroup. The project will bring equitable, high-quality, and standards-aligned CS instruction to all Philadelphia students, and address the lack of equitable access to certified CS educators in Philadelphia high schools.
Using the Project Maps
The first map, "Projects by Research Team" shows the dispersion of project PIs across the country. By toggling the filters on the right-hand side of the map you can filter the view by which Grade Band a project is targeting as well as the type of curriculum that the projects will be using.
The second tab, "Projects by Implementation Location" demonstrates the distribution of projects by the proposed state of implementation. As with the first map you can filter down by Grade Band and Curriculum Used. If you click on a given state a list of all the projects planning to implement within that state will appear in the column on the left-hand side of the map.
RPPforCS Project Maps
The first tab, "Projects by Research Team" shows the dispersion of NSF: CSforAll RPPs across the country. By toggling the filters on the right-hand side of the map you can filter the view by which Grade Band a project is targeting as well as the type of curriculum that the projects will be using. Note that points are staggered to allow overlapping projects to be visible.
​
The second tab, "Impact Area" demonstrates the distribution of NSF: CSforAll RPPs by the proposed state of implementation. As with the first map you can filter down by Grade Band and Curriculum Used. Mousing over or clicking on a state will display all grade bands being targeted by RPPs in that state, all curricula being used by RPPs in that state, and a list of all projects operating in that state.
RPPforCS District Maps
This set of maps details the districts that NSF: CSforAll RPPs are known to be partnered with and the overall demographics of students in those districts. These demographics do not necessarily represent the specific student subgroups (if any) being targeted by NSF: CSforAll RPPs, however. It should also be noted that projects will frequently only work directly with a subset of schools within a district, and a project's presence in a district on this map does not imply that they are working with every school in a given district.
​
All of these tabs can be filtered by searching for a project's name, by state, or by districts' urban/rural status as defined by the US Census.
​
The first tab "RPPforCS Continental District Map" displays all known public school districts partnered with one or more NSF: CSforAll RPPs.
​
The second and third tabs "District Race/Ethnicity Demographics vs. State Demographics" and "District Race/Ethnicity Demographics vs. National Demographics" provide details for each RPP-partnered school district's student demographics compared to their state or national student demographics, respectively. They also provide information on which projects are operating in each district. The "Examine by" drop-down menu in the top right of each tab can be used to select what demographic group to display data for.
​
The last tab "Other Demographic Information" shows district-level student data for the percentage of students eligible for free/reduced lunch as well as the percentage of those who are English as a second language/limited English proficiency students. Any blank rows indicate that there is currently no data for a given district.