Lead Cloud Engineer

Federal Reserve Bank of Minneapolis

Federal Reserve Bank of Minneapolis

Software Engineering
San Francisco, CA, USA
Posted on Wednesday, February 21, 2024


Federal Reserve Bank of San FranciscoWhen you join the SF Fed, you join a team of people working together to foster an inclusive economy that works for everyone. From data-driven insights to cloud transformation, the information technology team moves the SF Fed forward. We use innovative technologies and Agile methods to positively impact every American across the communities we serve.

We empower our people to balance their life and work responsibilities. That’s why we offer a flexible hybrid work model that allows you to collaborate with office colleagues on some days, and work from home on others.

The Federal Reserve Bank of San Francisco is looking for a Lead Cloud Data Engineer to join the Data and Analytics Service (DAS) Team. We are a team based out of San Francisco that partners with business lines across the Federal Reserve System to deliver the cloud + big data solutions and advanced analytics products.

The successful candidate will design, implement, and manage cloud-based data and AI solutions, ensuring scalable, secure, and repeatable data pipelines. The ideal candidate will have a strong background in data engineering, cloud infrastructure, scripting languages, and excellent analytical and communication skills.


  • Bachelor's or Master’s degree in Computer Science, Information Systems, or related field, or equivalent work experience
  • 10+ years of experience in data engineering, data science, and software engineering.
  • Advanced knowledge of Amazon Web Services (AWS) and cloud infrastructure
  • Strong programming skills in Java, Python, or Scala
  • Experience with data integration, ETL, and data visualization tools
  • Excellent analytical, collaboration, critical thinking, and time management skills
  • Experience in Continuous Integration, Delivery, and Deployment software tools to support, enhance, and grow our CI and CD capabilities.
  • Working experience in Ansible/Terraform/Cloud Formation scripts and Infrastructure as Code scripting is required.
  • Experience in developing an end-to-end AWS native platform for building Data lakes (S3, Glue (Crawlers, ETL, Catalog), IAM, CodePipeline, CodeCommit, CloudFormation (or Terraform), CloudTrail, CloudWatch, AWS Config, Guard Duty, Secrets Manager, KMS, EC2, Data Visualization Tool: Tableau run on an EC2 or AWS Quicksight), Athena
  • Professional experience optimizing machine learning workflows and maintaining data pipelines
  • Advanced knowledge of SQL and experience with relational databases
  • Experience with Generative AI solution implementation.
  • Experience with Data hubs, data lakes and warehouses.
  • Experience in data security, governance, and cybersecurity solutions
  • Experience with Databricks, Alteryx, Data integration, Data Masking tools, Access Management and Data Governance tools
  • Real time streaming solutions
  • Experience with Business Continuity, Disaster Recovery, Availability, Security for Data applications.
  • Must be a U.S Citizen or a Green Card holder with intent to become a U.S Citizen


  • Lead cross-functional teams in designing and implementing cloud-based data and AI solutions.
  • Ensure data pipelines are scalable, secure, and repeatable.
  • Collaborate with stakeholders to understand business requirements and turn data into insights.
  • Develop and maintain cloud infrastructure, including data lakes, warehouses, and analytics platforms.
  • Implement data governance and security best practices.
  • Stay up-to-date with industry trends and emerging technologies
  • Sets standards and best practices, while encouraging other data engineers for input on possible ways to improve the system.
  • Influences the design of innovative solutions using new technologies.
  • Acts as a role model, thought leader, and change management for new software and technology throughout the company.
  • Works on multiple projects as a technical lead
  • Drives continuous improvements with focus on quality, stability, usability, maintainability and ultimately customer satisfaction.
  • Takes end to end accountability of all data products and solutions.
  • Leads training bootcamps, & cross training workshops for internal & stakeholders.
  • Participates in pilots, Proof of Concepts and research on future data technologies and industry trends.

Desired Skills:

  • Domain experience in HR, Information Security, Finance, Business as IT
  • Experience with and/or working knowledge the Financial Industry, Government Agencies, Federal Reserve Bank Lines of Business (LoBs) Applications

Base Salary Range: Min: $155,700 - Mid: $202,200 - Max: $248,700 (Location: San Francisco)
Final salary and offer will be determined by the applicant’s background, experience, skills, internal equity, and alignment with market data.

We offer a wonderful benefits package including: Medical, Dental, Vision, Pre-tax Flexible Spending Account, Backup Child Care Program, Pretax Day Care Flexible Spending Account, Vacation Days, Sick Days, Paid Holidays, Pet Insurance, Matching 401(k), and a Retirement / Pension

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment.

At the Federal Reserve Bank of San Francisco, we believe in the diversity of our people, ideas, and experiences and are committed to building an inclusive culture that is representative of the communities we serve.


Full Time / Part Time

Full time

Regular / Temporary


Job Exempt (Yes / No)


Job Category


Work Shift

First (United States of America)

The Federal Reserve Banks believe that diversity and inclusion among our employees is critical to our success as an organization, and we seek to recruit, develop and retain the most talented people from a diverse candidate pool. The Federal Reserve Banks are committed to equal employment opportunity for employees and job applicants in compliance with applicable law and to an environment where employees are valued for their differences.

Privacy Notice