Databricks Administrator
New York, NY 
Share
Posted 13 days ago
Job Description
Databricks Administrator

Job Ref: 99154
Category: Information Technology
Department: INFORMATION TECHNOLOGY
Location: 50 Water Street, 7th Floor, New York, NY 10004
Job Type: Regular
Employment Type: Full-Time
Hire In Rate: $110,000.00
Salary Range: $110,000.00 - $120,000.00

Empower. Unite. Care.

MetroPlusHealth is committed to empowering New Yorkers by uniting communities through care. We believe that Health care is a right, not a privilege. If you have compassion and a collaborative spirit, work with us. You can come to work being proud of what you do every day.

About NYC Health + Hospitals

MetroPlusHealth provides the highest quality healthcare services to residents of Bronx, Brooklyn, Manhattan, Queens and Staten Island through a comprehensive list of products, including, but not limited to, New York State Medicaid Managed Care, Medicare, Child Health Plus, Exchange, Partnership in Care, MetroPlus Gold, Essential Plan, etc. As a wholly-owned subsidiary of NYC Health + Hospitals, the largest public health system in the United States, MetroPlusHealth's network includes over 27,000 primary care providers, specialists and participating clinics. For more than 30 years, MetroPlusHealth has been committed to building strong relationships with its members and providers to enable New Yorkers to live their healthiest life.

Position Overview

The Databricks Administrator will be responsible for providing technical expertise in deploying applications on Azure Databricks platform. As a Databricks Administrator, you will be responsible for the administration, configuration, and optimization of the Databricks platform to enable data analytics, machine learning, and data engineering activities within the organization. You will collaborate with data engineers, data scientists, and other stakeholders to ensure the platform meets their requirements while maintaining security and performance standards.

Job Description
  • Install, configure, and maintain Databricks clusters and workspaces.
  • Monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance.
  • Implement and manage access controls and security policies to protect sensitive data.
  • Perform regular software updates and patches.
  • Provide technical support to Databricks users, including troubleshooting and issue resolution.
  • Conduct training sessions to educate users on platform best practices and capabilities.
  • Optimize cluster configurations for performance and cost-effectiveness.
  • Monitor and manage auto-scaling to ensure resources are allocated efficiently.
  • Implement and enforce security policies, access controls, and encryption mechanisms.
  • Stay up-to-date with security best practices and compliance requirements.
  • Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability.
  • Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.
  • Monitor and manage platform costs, including optimizing resource utilization to control expenses.
  • Maintain detailed documentation of configurations, procedures, and best practices.
  • Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts,
  • to understand their requirements and provide technical solutions
Minimum Qualifications
  • Bachelor's degree in a relevant field (computer science, data engineering, etc.)
  • 7+ years of related professional experience.
  • 3 years' experience with Databricks Lakehouse Platform
  • Strong knowledge of Apache Spark and Databricks architecture.
  • Proficiency in cloud platforms like AWS, Azure, or Google Cloud.
  • Experience with Linux/Unix system administration.
  • Experience in a health care related business is a plus.

Professional Competencies

  • Integrity and Trust
  • Customer Focus
  • Functional/Technical skills
  • Written/Oral Communication
  • Excellent analytical and problem-solving skills.
  • Ability to adapt to different projects and assignments quickly.
  • Team player with strong communication skills

#LI-Hybrid #LI-Remote

 

Job Summary
Start Date
As soon as possible
Employment Term and Type
Regular, Full Time
Required Education
Bachelor's Degree
Required Experience
7+ years
Email this Job to Yourself or a Friend
Indicates required fields