Booz Allen Hamilton is seeking a Databricks Engineer to support mission-critical data initiatives for defense, intelligence, and civil clients. The role involves designing, building, and maintaining scalable data pipelines on the Databricks platform, enabling analytics and decision-making at scale.
Build and optimize ELT or ETL pipelines using Databricks Notebooks, Delta Live Tables (DLT), Workflows, and Unity Catalog
Implement data ingestion, transformation, and quality processes with PySpark, Spark SQL, and Delta Lake best practices such as incremental mergers, ACID transactions, or SCD patterns
Collaborate with data scientists, analysts, and mission stakeholders to understand requirements and deliver reliable, governed data assets
Support data platform operations, monitor pipeline performance, troubleshoot issues, and contribute to cost optimization, including leveraging Photon engine
Contribute to medallion architecture implementations, including bronze, silver, and gold layers, in cloud storage environments such as Azure ADLS, or AWS S3
Document pipelines, data models, and processes to ensure maintainability and knowledge transfer
Learn and apply emerging Databricks capabilities to advance client missions
Qualification
Required
2+ years of experience in data engineering, software development, or analytics engineering
Experience with writing SQL queries for data analysis and transformation
Experience with Python programming such as scripting and data manipulation
Knowledge of distributed data processing concepts such as Spark fundamentals, including partitioning, caching, and shuffle
Ability to work in a team environment and communicate technical concepts to non-technical stakeholders
Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
Bachelor's degree in Computer Science, Engineering, Information Systems, or Mathematics
Preferred
Experience with Databricks, including notebooks, Delta Lake, Workflows, or DLT in academic, internship, personal project, or professional environments
Experience with cloud platforms such as Azure, AWS, or GCP and object storage
Experience with orchestration tools such as Databricks Workflows, Airflow, or dbt
Experience with streaming data processing or real-time pipelines
Knowledge of Git for version control and collaborative development
Knowledge of data governance concepts, including Unity Catalog and access controls
Databricks Certified Data Engineer Associate Certification
Benefits
Health
Life
Disability
Financial
Retirement benefits
Paid leave
Professional development
Tuition assistance
Work-life programs
Dependent care
Booz Allen Hamilton is a consulting firm that specializes in analytics, technology, and engineering.
