Databricks/Data Modeler
Federal Reserve Bank of Minneapolis
Company
Federal Reserve Bank of New YorkWorking at the Federal Reserve Bank of New York positions you at the center of the financial world with a unique perspective on national and international markets and economies. You will work in an environment with a diverse group of experienced professionals to foster and support the safety, soundness, and vitality of our economic and financial systems.The Bank’s flexible work model supports balancing the demands of work and life, while prioritizing the value of connecting and collaborating with our colleagues in person. Employees are expected to live within a commutable distance of their primary work location to support team collaboration.
What we do:
Provides leadership in data management and analytics (supported by data) to define and solve important business problems in collaboration with business leaders. Partners with management and delivers viable solutions and operations to support data initiatives. Defines business data requirements and works with Technology service providers to define and deliver the appropriate solutions. Supports creation of data standards, ongoing data quality support, and exception management as it relates to projects and support of ongoing production applications while working closely with the Data Management teams to aid in the procurement of data services. More specifically:
o Create data products in Databricks
o Leverage best design practices for modeling a data lakehouse architecture to convert current (RDBMS) data models to best represent data in Databricks
o Re-architect legacy data (from existing applications and/or databases) to migrate to Databricks while optimizing for query performance, compute and storage costs.
Your role as a Data Modeler:
Create data products in Databricks
Leverage best design practices for modeling a data lakehouse architecture to convert current (RDBMS) data models to best represent data in Databricks
Re-architect legacy data (from existing applications and/or databases) to migrate to Databricks while optimizing for query performance, compute and storage costs
Top Skills
Financial industry experience, strong knowledge of business domains including fixed income products, trades, positions, and reference data
Data modeling experience (conceptual, logical, and physical), relational and dimensional data model design
ETL experience with Databricks and Spark
Data processing and analytics in Databricks
Strong analytical skills
What we are looking for:
Core Responsibilities
Leverage financial industry expertise to define conceptual, logical and physical data models in Databricks to support new and existing business domains
Work with product owners, system architects, data engineers, and vendors to create data models optimized for query performance, compute and storage costs
Define best practices for the implementation of the Bronze/Silver/Gold data layers of the lakehouse
Provide data model documentation and artifacts generated from data, data dictionary, data definitions, etc.
Qualifications
Data Modeling: Expertise in designing and implementing data models optimized for storage, retrieval, and analytics within Databricks on AWS, including conceptual, logical, and physical data modeling
Databricks Proficiency: In-depth knowledge and hands-on experience with AWS Databricks platform, including Databricks SQL, Runtime, clusters, notebooks, and integrations.
ELT (Extract, Load, Transform) Processes: Proficiency in developing ETL pipelines to extract data from various sources, transform it as per business requirements, and load it into the central data lake using Databricks tools and Spark
Data Integration: Experience integrating data from heterogeneous sources (relational databases, APIs, files) into Databricks while ensuring data quality, consistency, and lineage
Performance Optimization: Ability to optimize data processing workflows and SQL queries in Databricks for performance, scalability, and cost-effectiveness, leveraging partitioning, clustering, caching, and Spark optimization techniques
Data Governance and Security: Understanding of data governance principles and implementing security measures to ensure data integrity, confidentiality, and compliance within the centralized data lake environment
Advanced SQL and Spark Skills: Proficiency in writing complex SQL queries and Spark code (Scala/Python) for data manipulation, transformation, aggregation, and analysis tasks within Databricks notebooks
Cloud Architecture: Understanding of cloud computing principles, AWS architecture, and services for designing scalable and resilient data solutions
Data Visualization: Basic knowledge of data visualization tools (e.g. Tableau) to create insightful visualizations and dashboards for data analysis and reporting purposes
Salary Range: $159,400 - $274,200 / year
We believe in transparency at the NY Fed. This salary range reflects a variety of skills and experiences candidates may bring to the job. We pay individuals along this range based on their unique backgrounds. Whether you’re stretching into the job or are a more seasoned candidate, we aim to pay competitively for your contributions.
Our Touchstone Behaviors—Communicate Authentically, Collaborate Inclusively, Drive Progress, Develop Others, and Take Ownership—help shape the culture of the Bank. They also provide a shared language for how we work together and achieve success, and they set clear expectations for leading with impact at every stage of your career with us. Learn more.
Benefits:
Our organization offers benefits that are the best fit for you at every stage of your career:
Fully paid Pension plan and 401k with Generous Match
Comprehensive Insurance Plans (Medical, Dental and Vision including Flexible Spending Accounts and HSA)
Subsidized Public Transportation Program
Tuition Assistance Program
Onsite Fitness & Wellness Center
And more
The New York Fed expects its employees to perform their duties with honesty, integrity, and impartiality, and without improper preferential treatment of any person. Learn more about our code of conduct and conflicts of interest rules.
The Federal Reserve Bank of New York is committed to a diverse workforce and to providing equal employment opportunity to all persons without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, age, genetic information, disability, pregnancy, or military service.
We value accessibility for all candidates and are happy to provide an accommodation or assistance. Please email us at ny.leaves@ny.frb.org and we’ll be glad to help. Please note, this is a dedicated e-mail box designed exclusively to assist applications with accommodation requests in relation to our recruiting process. All other inquires including the status of applications will not receive a response from this e-mail box.
This is not necessarily an exhaustive list of all responsibilities, duties, performance standards or requirements, efforts, skills or working conditions associated with the job. While this is intended to be an accurate reflection of the current job, management reserves the right to revise the job or to require that other or different tasks be performed when circumstances change.
This position requires access to confidential supervisory information (CSI) and/or Federal Open Market Committee (FOMC) information. Access to CSI and FOMC information is limited to U.S. citizens, lawful permanent residents, individuals who meet the definition of “protected individual” under 8 U.S.C. § 1324b(a)(3), and certain other nonimmigrants. All non-U.S. citizens authorized to access CSI and/or FOMC information must sign a declaration of intent to expeditiously become a lawful permanent resident and thereafter a U.S. citizen when eligible.
Full Time / Part Time
Full timeRegular / Temporary
RegularJob Exempt (Yes / No)
YesJob Category
Data Analytics Family GroupWork Shift
First (United States of America)The Federal Reserve Banks believe that diversity and inclusion among our employees is critical to our success as an organization, and we seek to recruit, develop and retain the most talented people from a diverse candidate pool. The Federal Reserve Banks are committed to equal employment opportunity for employees and job applicants in compliance with applicable law and to an environment where employees are valued for their differences.
Always verify and apply to jobs on Federal Reserve System Careers (https://rb.wd5.myworkdayjobs.com/FRS) or through verified Federal Reserve Bank social media channels.