Innovation Team Data Engineer - Mayor's Office of Innovation (1043)

Job Description

As the Innovation Team Data Engineer, you will be a part of the Mayor’s Innovation Team, and report to the Mayor’s Office. However, your position is based within Digital Services under DataSF, and will collaborate closely with the Chief Data Officer and the Chief Digital Services Officer.

You will work directly with the Mayor’s policy staff and Department leadership, as well as community providers to identify existing data, gaps in reporting, and develop outcomes-based reporting structures.

This position is funded, in part, through the Bloomberg Philanthropies Government Innovation Team, and will work in close partnership with the Bloomberg Center for Public Innovation at Johns Hopkins University.

The Innovation Team will also include a Data Program Manager, a Service Designer, and a Project Manager. As a small and agile team, you will work together to deliver prototypes and solutions that will help address the city’s most pressing challenges.

Your Responsibilities

As the Data Engineer, you will be the technical lead on the program, working with stakeholders in departments to understand data sources and pipelines and building these out in a pragmatic way. You will advise the Mayor’s Office on the most feasible deliverables that are both technically possible, and high impact. You will be supported throughout by the rest of the Innovation team, the Chief Data Officer, and the Chief Digital Services Officer.

• Work with departmental staff to develop extract, transform, load (ETL) requirements for individual datasets
• Consult with various departments on the best way to automate and publish datasets within their data ecosystems
• Apply an ethical lens to the appropriate use of data
• Create new analytics pipelines using ETL/ELT approaches according to standards and patterns you help develop and refine
• Serve as the technical lead for database exports, manipulation, and procedures used to create and update data incorporated into the data platform
• Implement analytics pipelines and/or data models to support analytics work
• Migrate existing ETLs to newer infrastructure to improve data quality and reliability as needed
• Standardize and improve existing pipelines to adhere to best practices
• As needed help iterate and refine best practices

Equity Focus

You will also identify ways in which data standardization, and data access, can contribute to the City’s commitment to equitable and ethical service delivery and analytics. In collaboration with departments, you will identify data gaps that hinder equity analysis.

Removing barriers and making it easier for all people to access services or knowledge is a core part of any role with DataSF and the Innovation Team. Beyond any technical skill set or prior work history, accomplishing this ambitious task requires an empathetic understanding of the diverse array of experiences embodied in San Francisco. Your own life experience is a critical contribution to this effort. The Innovation Team is committed to building a team whose diversity reflects the residents we serve.