DataBricks Admin

Job Duties: Key Responsibilities:

• Security Administration:
• Design, implement, and manage security policies and controls within the Databricks environment.
• Monitor and audit user access and activities to ensure compliance with security policies.
• Develop and maintain data encryption strategies.
• Manage roles, permissions, and access controls to ensure data security and compliance.
• Automation and Optimization:
• Develop and implement automation scripts to streamline data workflows and administrative tasks.
• Optimize Databricks performance by tuning queries, managing storage, and implementing best practices.
• Utilize Databricks features such as tasks, streams, and stored procedures to automate data processes.
• Leverage CICD best practices to automate productionalization of data pipelines
• Collaboration and Support:
• Work closely with data engineers, analysts, and other stakeholders to understand their needs and provide solutions.
• Provide technical support and troubleshooting for Databricks-related issues.
• Conduct training sessions and create documentation for internal teams on Snowflake best practices and security protocols.
• Monitoring and Reporting:
• Set up and maintain monitoring tools to track the performance and security of the Databricks environment.
• Generate and analyze reports on system performance, security incidents, and usage metrics.
• Implement alerts and notifications for critical security and performance events.
• Continuous Improvement:
• Stay up-to-date with the latest Databricks features, security trends, and industry best practices.
• Proactively identify opportunities for improvement in security, performance, and automation.
• Participate in continuous learning and professional development activities.
  
  

Minimum Skills Required:

• Bachelors degree in Computer Science, Information Technology, or a related field; or equivalent work experience.
• Proven experience as a Databricks administrator, with a strong focus on security and automation.
• In-depth knowledge of Databricks architecture, security features, and best practices.
• Proficiency in SQL and scripting languages (e.g., Python, JavaScript) for automation tasks.
• Experience with Azure cloud platforms and their security practices.
• Familiarity with data governance, compliance standards, and regulatory requirements (e.g., GDPR).
  
  

Preferred Qualifications:

• Databricks certification(s) such as Associate or Professional Data Engineer
• Experience with data integration tools and ETL processes using Azure Data Factory.
• Knowledge of data privacy and protection laws.
• Strong problem-solving skills and the ability to work independently and as part of a team.
• Excellent communication skills, both written and verbal.
• Previous experience in a similar role within a fast-paced, dynamic environment