Position Summary The focus areas of responsibility of the Data and Evaluation Manager are to: 1) lead the design of rigorous mixed methods program and agency evaluations (integrating qualitative and quantitative data); 2) design program evaluation tools that measure program compliance and quality; 3) monitor programs’ quality and compliance; 4) oversee reporting of administrative, compliance, and quality data; 4) design, stakeholder surveys; 5) develop and communicate recommendations to OCF leadership and other stakeholders regarding improving program quality and compliance; and 6) lead a team of Data Analyst and Evaluation Associates.Essential FunctionsLead the design and implementation of research and evaluation projects that advance program and system performance improvements. This includes using and developing compliance and quality tools to monitor provider progress and alignment to program scope.Work with service providers to develop corrective action plans and plans of improvement when necessary and monitor plans for improvement.Oversee data from key system sources to produce short and long-term outcome and process analyses. Key data sources include but are not limited to case file reviews, program narratives, program observations, surveys, and administrative data on enrollment, attendance, invoicing, and activities.Generate graphs, tables, and other data visuals.Lead the design and analysis of survey questions. Administer surveys to various population groups receiving OCF services.Lead development of qualitative data collection tools and processes for OCF programs, such as case file review tools, observation protocols, surveys, interviews, and focus groups.Organize and lead convenings of OCF and service provider leadership to gather feedback on evaluation initiatives.Work collaboratively with PMT team members to ensure quality implementation of performance management activities and processes.Work collaboratively with PMT team members to oversee the development and management of administrative data management systems, including consulting on system improvements and supporting reporting directly from databases.Write and present project reports, briefs, and/or presentations for system leaders and stakeholders using clear, concise language.Perform related research, evaluation, and supervision duties as assigned.Lead and supervise a team of Data Analysts and Evaluation Associates.Qualitative: Ability to lead evaluation and monitoring tool development, including conducting literature reviews for existing tools and using stakeholder input to update existing toolsPrior experience conducting interviews, focus groups, and observationsPrior experience analyzing qualitative data, including coding interviews, focus groups, and observations and conducting document reviewsQuantitative: Prior experience using statistical and survey software such as R, STATA, or PythonExperience using data collection tools such as Cognito, Qualtrics, or other survey systems.Knowledge of basic statistics including descriptive, exploratory, and inferential statistics.Prior experience creating basic data visualizations such as charts and tables.General:Strong project management abilities, including at least 2 years of project management experienceAdvanced communication skills, including relationship building, managing and leading meetings, and collaborating with non-technical audiencesExperience supervising staffDemonstrated ability to monitor and evaluate programsProven strong research, analysis, and writing skillsClear and concise communication of ideas, program scopes, and findings - orally and in writingAbility to problem solve and identify several courses of action to make informed decisions about project development and implementationAbility to maintain strong working relationships with coworkers, OCF leadership, and service providersAbility to work on multiple projects at once while still meeting project deadlinesAbility to quickly pivot to emergent tasks and project needsKnowledge of Microsoft Office Suite, including data analysis tools like Excel and/or Open Source tools
