Data Engineer - Databricks
Indexed description
What You'll do:
Groundswell is hiring an experienced Data Engineer to join our team supporting the Department of Transportation (DOT). This customer-facing role combines data engineering and database administration across MariaDB, SQL Server, and Databricks environments.
Responsibilities:
- Design and implement scalable Databricks solutions and ETL/ELT pipelines.
- Apply Databricks development standards and data engineering best practices.
- Administer and monitor enterprise MariaDB and SQL Server environments.
- Design databases, schemas, tables, views, stored procedures, functions, and triggers.
- Perform database configuration, backup, restoration, performance tuning, and disaster recovery.
- Optimize SQL queries, indexes, database objects, pipelines, and server performance.
- Configure and support availability groups, mirroring, clusters, encryption, and reporting servers.
- Apply best practices for data modeling, relational database design, data warehousing, data quality, and lineage.
- Implement database security, auditing, user access, roles, permissions, and domain-level accounts.
- Troubleshoot complex database, application, and data pipeline issues.
- Collaborate with business stakeholders, infrastructure, network, application, development, and vendor teams.
- Translate business and technical requirements into secure, scalable data solutions.
- Deliver technical demonstrations and training and support proposal efforts.
- Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, Statistics, or a related technical field.
- 5+ years of experience in data engineering, database administration, or database development.
- Demonstrated hands-on Databricks experience.
- Experience administering SQL Server and/or MariaDB enterprise databases.
- Advanced SQL skills, including developing and optimizing queries, stored procedures, functions, triggers, tables, and views.
- Proficiency in Python, Java, or Scala.
- Experience developing ETL/ELT pipelines using tools such as Apache Airflow, AWS Glue, or similar technologies.
- Experience with database performance tuning, backup and restoration, disaster recovery, security, and access management.
- Strong stakeholder engagement, communication, collaboration, and problem-solving skills.
- Demonstrated experience leading or providing technical direction to engineering teams.
- U.S. citizenship and the ability to obtain and maintain a federal Public Trust per contract requirements.
- Experience with both SQL Server and MariaDB.
- Experience with AWS services and cloud architecture.
- Experience with medallion data architecture, including Bronze, Silver, Gold, and Platinum layers.
- Experience with MicroStrategy and/or Tableau.
- Experience with LLM data requirements, vector databases, or AI model deployment.
- Current or previously held federal Public Trust.
- Previous experience supporting DOT or related federal systems.
- Comprehensive medical, dental, and vision plans
- Flexible Spending Account
- 4% 401K Match (immediate vesting)
- Paid Time Off
- Tuition reimbursement, certification programs, and professional development
- Flexible work schedule
- On-site gym and childcare option
$89,886.00 - $175,444.00
NOTE: Groundswell does not accept unsolicited resumes through or from search firms or staffing agencies. All unsolicited resumes will be considered the property of Groundswell, and Groundswell will not be obligated to pay a placement fee.
Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, pregnancy, genetic information, disability, status as a protected veteran, or any other protected category under applicable federal, state, and local laws.
Read a copy of the Company’s Non-Discrimination Policy Statement.
Additional Resources:
- EO 13496 Notification of Employee Rights under NLRA
- Know your rights: Workplace Discrimination is Illegal
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search