We’re hiring! Data Engineer @ NYC Planning [Filled]
We’re hiring a Data Engineer to grow NYC Planning’s Data Engineering team. We’re looking for someone highly motivated and innovative to join us on our journey to transform the data landscape at NYC Planning.
You will be involved in designing data infrastructure, implementing data pipelines, and supporting data analyses to inform planning processes. You should understand data, and how to improve its quality and accessibility, and be excited about advancing the adoption of new technologies in New York City government. If you’re interested in shaping the future of city planning and building smarter government, you should definitely apply.
About NYC Planning’s Data Engineering team
The Enterprise Data Management (EDM) team maintains core city datasets, such as street centerlines and building addresses, which power the 911 system. The EDM team ensures that DCP Planners have access to quality data to inform decisions that ultimately shape NYC. Data Engineering, a unit within EDM, digitizes legacy data processes, manages cloud data infrastructure, and develops critical data products, such as PLUTO. Our data products and data infrastructure support a myriad of data systems and applications used by City Planning, other city agencies, and the public.
Our Mission:
- Product: We create and release high quality public datasets about NYC
- Operation: We build highly transparent and automated data pipelines using open source technologies
- Ecosystem: We offer more than just data, but also comprehensive documentation, metadata, and analytics resources
- Community: We bring people together, across teams and agencies, to share data and to learn from each other
Data Engineering is a small, growing team, and you’ll have the chance to make an immediate impact. We are currently looking to expand our scope by developing a data ecosystem to bridge the gap between data production, data discovery, and data analytics to support our mission to bring people together via data. We’re going to trust your opinion and expect you to help us make the right decisions. You’ll be empowered to dive into our processes, test new tools, and give your thoughts on how we can do better.
We are only a small part of NYC Planning, New York City’s planning agency, one of the largest city planning agencies in the world. You’ll have a chance to work with brilliant colleagues, many of them renowned experts in their fields.
➡️ Ready? Apply here.
What will you be working on?
- Design, deploy, and scale current data infrastructure to help Data Engineering expand data analytics service offerings
- Develop and maintain data ETL pipelines, with a focus on writing scalable, clean, and fault-tolerant code to handle disparate data sources
- Work with internal research divisions, city agencies, and the public to create data products and applications to help inform equitable development goals
- Contribute to our long term goal of digital transformation for legacy mission critical data processes and applications, facilitating cloud migrations
- Sharing your work and lessons learned via blog posts, conference talks, and lectures with colleagues and the world
What tools will you be working with?
The primary technologies we use but are certainly not limited to are:
- PostgreSQL/PostGIS
- BigQuery
- Python
- DBT
- Airflow
- Geosupport
- Git/Github/Github Actions
- Google Cloud Platform
- Terraform
➡️ Ready? Apply here.
You should apply if:
- You have 2 or more years of experience (or relevant education) scripting data processes with SQL and Python.
- You are very organized and thorough, with a proven ability to bring order and logic to heterogeneous data environments.
- You have worked on modern data engineering teams and understand the importance of collaboration, teamwork, and writing clear code for your colleagues.
- You are comfortable communicating about data with colleagues of varying levels of proficiency.
- You are familiar with spatial data formats and have experience working with spatial data in PostGIS, Carto, or GeoPandas.
What you get
- Salary: $66,597 — $76,587, commensurate with experience
- New York City health benefits, paid vacation, and eligibility for NYC retirement plans
- Agency-issued MacBook Pro and dual-monitor workstation
- Modern office in downtown Manhattan
- Strong work/life balance
➡️ Ready? Apply here.
