Data Engineer

Job Objective:

The Data Engineer role is responsible for building, optimizing, and maintaining data pipelines, integrations, and database systems that support enterprise analytics and reporting. This position develops and implements data processing logic, designs and manages data models, and uses SQL, Python and other programming tools to ensure reliable movement and transformation of data across platforms. It supports the day‑to‑day activities of the team responsible for the design, implementation, maintenance, and performance of enterprise Data Lake, Data Warehouse, and reporting environments. The role also evaluates, implements, and documents emerging data technologies across both structured and unstructured systems, while configuring and troubleshooting data‑related applications. Additionally, the Data Engineer collaborates closely with engineering and business teams to ensure best practices are followed and provides development and operational support to other IT resources.

Supervisory responsibilities:

• This position reports directly to the Director, Cloud & Data for coaching, performance appraisal work, guidance, direction and feedback.
• This position will be a part of 2 Data Engineers and 1 Data Analyst.

NATURE & SCOPE:

As a Data Engineer:

• This position will provide overall development, programming, coding and troubleshooting effort for all the Data warehouse and Reporting technologies. Collaborates with Data Architecture and Core Development teams to assure adherence to best practices and process standardization.
• Actively participates in design, development and implementation of Data Analytics and Data Warehouse projects, Data Governance, Data Quality systems for standardization of member data and actively participates in the data related activities for the digital platform conversion project.
• Performs the implementation, maintenance, and documentation of existing and emerging database technologies on premises as well as cloud infrastructure. Provides advanced support for SQL database, NoSQL database and cloud database enabled applications.
• Configures and maintains the organization’s Operation Data Store (ODS). Ensuring near real-time data availability for transactional reporting needs.
• Maintain, configure and automate changes required for the organizations core Data Warehouse system which is a Relational Database, to perform effectively on the daily load and the nightly data extract transform and load (ETL) process.
• Develops datasets for analytics in Data Analytics platform and creates advanced reporting within Business Intelligence tools.
• Develops and maintains data fields utilized by the Fraud department to actively monitor fraud alerts on live systems.
• Assist in deploying various business applications from lower environments to production using automated build tools and scripting.
• Provides advanced support for database systems, including High Availability using Always on Availability Groups (AG’s) and Basic Availability Groups (BAG’s), Disaster Recovery, performance tuning, troubleshooting long running queries, index maintenance, and analyzing query plans.
• SME for various business applications used by departments such as accounting, finance, consumer lending, collections, fraud, card services, support services and ensures IT systems are kept up to date according to the organization’s policies.
• Follows agile software development methodologies - Scrum process for software development and Kanban for bugs and tickets.
• Participating in help desk functions periodically to ensure quality service is provided according to company standards in a timely and effective manner.
• Creates or updates and make improvements to related procedure/manuals identifying Standard Operation Procedures (SOP) for assigned tasks.
• Provides technical support to credit union staff to ensure effective utilization of SQL databases, including capacity and performance planning.
• Establishes and maintains regular written and in-person communications with the organization’s end users regarding pertinent IT activities.
• Exhibit excellent customer service skills towards internal and external customers.

Education, skills, & abilities:

The Eight Superpowers

1. Provides leadership through modeling of behaviors and bringing forward new ideas and new ways of doing things.
2. Demonstrates empathy, self-reflection, and adjustment of own behaviors, showing effective emotional intelligence.
3. Practices active listening in communications with others, giving someone full attention and listening to understand, not just respond.
4. Demonstrates grit, persisting in application of knowledge, skills, and behaviors to achieve goals and address obstacles.
5. Models’ intrinsic motivation; is self-driven to meet or exceed objectives, timelines, and quality measures while building and sustaining effective relationships.
6. Applies creative problem-solving to provide clarity, handle resources under one’s control, and address stressful situations; finds ways to meet individual, team, and member goals, by navigating through barriers.
7. Shares a diverse set of perspectives, work and life experiences, as well as religious and cultural differences. Actively seeks out differences in values, ideas, and priorities. Respects and value the differences of others, including but not limited to: national origin, language, race, color, disability, ethnicity, gender, age, religion, sexual orientation, gender identity, socioeconomic status, veteran status, and family structures. Believes a diverse workplace is essential to the company’s success.
8. Values and shows appreciating for the unique qualities and experiences of each person-inclusion; appreciates and effectively utilizes the talents and skills of others to achieve objectives; is open to the perspective of others; and encourages collaboration, flexibility and fairness. Makes each employee feel valued and supported for their unique qualities.

Other Education, Skills, and Abilities

• Requires an undergraduate degree in computer science, information systems, or related discipline, along with a minimum of five years of experience in database engineering and analytics.
• Hand-on experience with modern analytics platforms such as Snowflake or Azure Synapse Analytics or is a must.
• Excellent skills in Python, SnowSQL, Microsoft SQL Server, T‑SQL, SSRS, SSIS, MySQL on Amazon RDS, and Azure SQL Database/Managed Instance.
• Experience with ETL development using SSIS and hybrid data integration using Azure Data Factory (ADF) or Apache Airflow or Informatica IICS.
• Knowledge and experience configuring and maintaining an Operational Data Store (ODS) using unstructured databases such as MongoDB Atlas in Azure or Cosmos DB.
• Required hands‑on experience with Data Quality for data standardization, and for data integration, and data governance best practices.
• Skilled in data transformation using Business Intelligence Development Studio (BIDS) and experienced in developing and administering reports using Power BI or Tableau.
• Expertise in scripting and automation using PowerShell.
• Familiarity with source control and code promotion tools such as Visual Studio, Bitbucket, and Azure DevOps Server is a plus.
• Experience with enterprise applications such as Power Automate, Active Directory, SharePoint Online, Jira, and Confluence is a plus
• Experience with data encryption technologies including TDE, data masking, obfuscation, Always Encrypted, and column‑level encryption is a plus.
• Knowledge of programming languages such as .NET, HTML, XML, JavaScript, and Python is preferred.
• Experience configuring and maintaining web applications using Microsoft IIS and Java is preferred.

MAJOR ACCOUNTABILITIES:

• Strives to achieve the organization strategic initiatives that include 360-member view for the organization and support development work needed for the implementation of Single Source of Truth (SSOT), golden records in the ODS system.
• Provides development work required for projects related to the organization’s database technologies and other projects that may directly impact the member and development environments.
• Support Enterprise Data Warehouse systems, Big Data Analytics platforms and Business Intelligence.
• Help with the organization’s development operations function to ensure productivity, quality and customer service demands are met according to the organization’s standards.
• Ensuring member service and satisfaction are a priority in database related projects and implementations.
• Provides technical support to Business Users, troubleshoots and resolves database related issues.
• Certifications around Snowflake, Microsoft SQL Server, Microsoft Azure Fundamentals is a plus.
• Banking industry experience is a plus.
• Other duties as assigned.

ENVIRONMENTAL CONDITIONS:

• Work requires concentrated mental attention and focus.
• Work is primarily within a cubicle office subject to conversational noise and interruptions found in that environment.

PHYSICAL REQUIREMENTS:

• Ability to tolerate periods of continuous sitting; ability to operate and utilize a personal computer and peripherals.

Note: Staff are expected to perform various tasks, projects and administrative duties as assigned.

Management reserves the right to assign or change duties and tasks to this position at their discretion.

Salary Range (annually)

$122,573.13 - $141,587.1100