Research and Evaluations Lead (1053) - Department of Technology

Department: Technology Job class: 1053 IS Business Analyst - Senior Salary range: $134,082 - $168,688 annually Role type: Permanent Exempt What does this mean? Hours: Full-time Specific information regarding this recruitment process is listed below:  IMPORTANT: A COVER LETTER MUST BE SUBMITTED AS PART OF THE APPLICATION IN ORDER TO BE CONSIDERED.  FAILURE TO SUBMIT ONE MAY RESULT IN DISQUALIFICATION FROM CONSIDERATION. Appointment Type : Permanent Exempt - This position is a full-time position excluded by the Charter from the competitive civil service examination process and shall serve at the discretion of the appointment officer. The anticipated duration of this project position is up to thirty-six (36) months . Application Opening: Thursday, September 17, 2026 Application Deadline: Apply immediately. This recruitment is considered open until filled, but will close no sooner than October 1, 2026 at 11:59pm. Work Location: Incumbent will conduct the majority of work at the Department of Technology, (1 S Van Ness, Ave San Francisco, CA 94103) .  However, there may be situations where the incumbent will be required to work at other sites throughout the City and County of San Francisco as necessary. Nature of Work: This is a full-time position. The department supports a hybrid work schedule in compliance with City & County of San Francisco policies on remote work which currently requires onsite work of a minimum of two (2) days per week. About the Department of Technology Why Work for the Department of Technology (DT)? DT is the centralized technology services provider in the City and County of San Francisco (CCSF). We deliver technology infrastructure and services to approximately 33,000 employees! With an annual operating budget of over $140M and approximately 260 employees, DT provides a host of services that range from Public Safety radio and wiring and Network services to Enterprise Support and the Cloud. Benefits of Working for CCSF: In addition to challenging and rewarding work, the City provides a generous suite of benefits to its employees. Job security, pension, and robust retirement options Competitive pay with consistent bi-yearly or yearly increases Hybrid Work with a minimum of 20% of time spent in our office in San Francisco, California for all IT related roles Generous paid time off, family leave, and more! Diverse work environment in a diverse city Union protections and representation Career development and growth — move between departments, learn on the job, or take subsidized/reimbursed classes! PEOPLE-CENTERED SOLUTIONS — have a powerful, meaningful effect on the community each day with people at the heart of every solution! CLOSING THE DIGITAL DIVIDE — bring the benefits of the internet to low-income and marginalized residents! SHINE A LIGHT ON WHAT MATTERS — join an award-winning production team at SFGovTV to help residents watch legislators or learn more about what makes this City great! DRIVE INNOVATION — deliver new, cutting-edge technology to residents and city partners to help San Francisco serve its residents! Are you passionate about shaping the future of technology while ensuring its responsible and ethical use? The City and County of San Francisco (CCSF) is seeking a forward-thinking and driven Research and Evaluation Lead to join our Emerging Technologies team at the Department of Technology. This is your chance to help shape how artificial intelligence (AI) and other emerging technologies are enabled across CCSF, applying user-centered, data-driven approaches to understand staff needs and support effective and responsible adoption. In this role, you’ll collaborate with City departments and other partners to identify needs, evaluate emerging technology tools, and turn research findings into practical recommendations. Your work will help guide decisions about what to build, procure, pilot, and scale, as well as how to support staff through training and other enablement efforts. The Research and Evaluation Lead serves as a key member of the Department of Technology's (DT) Emerging Technologies team. This role advances two primary objectives: staff enablement and program evaluation. 1. Staff Enablement The Lead is responsible for identifying the needs of City staff related to artificial intelligence and other emerging technology tools. These insights guide the prioritization of tools to build, procure, or pilot, and inform the development of training required for staff to use these tools effectively. 2. Program Evaluation The Lead evaluates whether emerging technology tools can be deployed effectively and responsibly at scale. This includes advising departments on appropriate evaluation methodologies and collaborating with academic and non-profit partners to design rigorous and practical evaluations. The position requires strong qualitative user research skills combined with quantitative and mixed‑methods evaluation expertise. The Lead works closely with the Director of Emerging Technologies, Lead AI Engineer, and Principal AI Policy Analyst, while partnering with City departments implementing emerging technology pilots. The essential functions of this position include: Conduct qualitative and quantitative research on how City staff use, adopt, or discontinue use of AI tools, to identify friction points, unmet needs, and adoption barriers. Translate research findings into prioritized input for the Emerging Technologies team, helping inform which tools, features, product builds, pilots, or procurements to invest in. Assess staff training needs and recommend training or upskilling approaches to help staff use AI tools effectively and responsibly. Present findings and recommendations to the Emerging Technologies team, department partners, and City leadership. Design and run evaluations of AI and other emerging technology tools the City procures, builds, pilots, and rolls out — including experiments and quasi-expe