We’re hiring! Data Engineer @ NYC Planning
We’re hiring a Data Engineer to grow NYC Planning’s Data Engineering team. We’re looking for someone highly motivated and innovative to continue to improve the data landscape at NYC Planning.
You will have a role in designing data infrastructure, implementing data pipelines, and supporting data analyses to inform planning processes. You should understand data, how to improve its quality and accessibility, and be excited about advancing the adoption of new technologies in New York City government. If you’re interested in shaping the future of city planning, building smarter government, and helping to take a successful team to the next level you should definitely apply.
About NYC Planning’s Data Engineering team
The Enterprise Data Management (EDM) team maintains core city datasets, such as street centerlines and building addresses, which power the 911 system. The EDM team ensures that DCP Planners have access to quality data to inform decisions that ultimately shape NYC. Data Engineering, a unit within EDM, modernizes legacy data processes, manages cloud data infrastructure, and publishes critical data products, such as PLUTO. Our data products and data infrastructure support a myriad of data systems and applications used by City Planning (such as ZoLa), other city agencies, and the public.
Our Mission:
- Product: We create and release high quality public datasets about NYC
- Operation: We build highly transparent and automated data pipelines using open source technologies
- Ecosystem: We offer more than just data, but also comprehensive documentation, metadata, and analytics resources
- Community: We bring people together, across teams and agencies, to share data and to learn from each other
Data Engineering is a small and innovative team where you’ll have the opportunity to make an immediate impact. We are currently looking to improve our existing production and quality assurance processes and systems, as well as expand our scope by developing a data ecosystem to bridge the gap between data production, data discovery, and data analytics to support our mission of bringing people together via data. We’re going to trust your opinion and expect you to help the team make the right decisions. You’ll be empowered to dive into our processes, test new tools, and give your thoughts on how we can do better.
We are only a small part of NYC Planning, New York City’s planning agency, one of the largest city planning agencies in the world. You’ll have a chance to work with brilliant colleagues, many of them renowned experts in their fields.
➡️ Ready? Apply here.
What will you be working on?
- Designing, deploying, and scaling current data infrastructure to help Data Engineering expand its data offerings
- Developing and maintaining data ETL pipelines, with a focus on writing scalable, clean, and fault-tolerant code to handle disparate data sources
- Working with internal research divisions, city agencies, and the public to create data products and applications to help inform equitable development goals
- Contributing to our long term goal of digital transformation for legacy mission critical data processes and applications, facilitating cloud migrations
- Sharing your work and lessons learned via blog posts, conference talks, and lectures with colleagues and the world
What tools will you be working with?
The primary technologies we use but are certainly not limited to are:
- PostgreSQL/PostGIS
- Python
- Git/Github/Github Actions
- Docker
- DigitalOcean
- Geosupport
- Google Cloud Platform
➡️ Ready? Apply here.
You should apply if:
- You have 2 or more years of experience or relevant education in the field of data engineering.
- You are proficient in scripting processes with Python and SQL, automating processes using GitHub Actions, and utilizing containerization softwares like Docker.
- You are very organized and thorough, with a proven ability to bring order and logic to heterogeneous data environments.
- You have worked within modern data engineering teams and understand the importance of collaboration, teamwork, and writing clear code for your colleagues.
- You are comfortable communicating about data with colleagues of varying levels of proficiency.
- You are familiar with spatial data formats and have experience working with spatial data in PostGIS, Carto, or GeoPandas.
What you get
- Salary: $85,000 — $100,000 commensurate with experience
- New York City health benefits, paid vacation, and eligibility for NYC retirement plans
- Agency-issued MacBook Pro and dual-monitor workstation
- Modern office in downtown Manhattan
- Strong work/life balance
➡️ Ready? Apply here.
