← Back to all jobs
G

QA/Automation Tester

General Dynamics Information Technology

28d ago

0$128k - $173kOtherRemote, USjobspy_indeed
remoteindeed

Job Description

Clearance Level None Category Data Science and Data Engineering Location Remote, Working from the USA Key Skills For Success Analytics Big Data Data Lake ##### **REQ\#:****RQ228418** ##### **Public Trust:****MBI (T2\)** ##### **Requisition Type:****Pipeline** ##### **Your Impact** Own your opportunity to work alongside federal civilian agencies. Make an impact by delivering solutions that improve citizen services millions depends on. **Job Description** ------------------- The **Databricks Administrator** will be responsible for the administration, configuration, optimization, and support of our Databricks platform. This role will work closely with data engineers, data scientists, analytics teams, and IT security to ensure a secure, reliable, and high\-performing environment for data processing, machine learning, and analytics workloads. **MEANINGFUL WORK AND PERSONAL IMPACT**: **Platform Administration \& Operations** * Administer and maintain Databricks workspaces across development, test, and production environments. * Configure and manage clusters, pools, jobs, and workflows to support ETL, streaming, and ML workloads. * Monitor platform health, capacity, and performance; proactively identify and resolve issues. * Manage Databricks runtime versions, libraries, and integrations with cloud storage and data services. * Implement and maintain backup, recovery, and business continuity procedures for Databricks assets. **Security, Governance \& Compliance** * Configure and maintain identity and access management (IAM) roles, groups, and permissions in Databricks. * Implement and enforce security best practices, including encryption, network controls, and data access policies. * Collaborate with security and compliance teams to ensure adherence to organizational and regulatory requirements. * Support implementation of data governance standards (e.g., Unity Catalog, catalogs, schemas, tables, and permissions). **Performance \& Cost Optimization** * Optimize cluster configurations, autoscaling, and job scheduling to balance performance and cost. * Analyze usage metrics and costs; implement strategies for cost control and chargeback/showback where applicable. * Recommend and implement platform tuning and optimization strategies for large\-scale data workloads. **Collaboration \& Support** * Partner with data engineers, analysts, and data scientists to understand workload requirements and recommend best practices in Databricks usage. * Provide Tier 2/3 support for Databricks\-related incidents and service requests. * Develop and maintain platform documentation, runbooks, and standard operating procedures. * Conduct user onboarding, training, and knowledge\-sharing sessions on Databricks capabilities and best practices. **Automation \& DevOps** * Automate workspace and cluster provisioning, configuration, and policy enforcement using Infrastructure as Code (e.g., Terraform, ARM/Bicep, CloudFormation). * Integrate Dat