Databricks Engineer

Job Description

Job Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live Tables, Snowflake, and Medallion Architecture.

Key Responsibilities

• Designing, building, and maintaining medallion architecture-based data pipelines in Databricks platforms.
• Handling raw data ingestion through Delta Live Tables while ensuring data quality and access latency.
• Manage enterprise-level complex data and metadata changes in Databricks environment using delta live tables.
• Utilizing knowledge of Snowflake to offer insight into data warehousing and management.
• Collaborate with data architects to provide Databricks solutions that align with company objectives.
• Work in conjunction with data science teams to implement complex statistical models.
• Ensuring data security and compliance in Databricks and Snowflake environments.
• Developing and deploying ETL job workflows with an emphasis on automation and scalability.
• Keeping up-to-date with industry best practices and emerging trends in Databricks technology.

Requirements

QUALIFICATIONS

• Bachelor’s degree in Computer Science, Information Technology, or a related field
• Solid experience in Databricks platform, data engineering, and using Delta Live Tables
• Experience with medallion architecture in a data lake environment
• Proficiency in Snowflake data warehousing platform
• Strong understanding of ETL workflows and data pipeline automation.
• Exceptional knowledge of data structures, data modeling, and database schemas
• Highly skilled in SQL, Python, or Scala.
• Experienced in performance tuning, troubleshooting, and debugging in Databricks environment
• Outstanding problem-solving abilities, with an innovative approach to tackling complex challenges.
• Exceptional communication skills with proven ability to bridge communication gaps between technical and non-technical stakeholders.
• Ideal candidates are proactive, collaborative, and passionate about data and Databricks technologies. If you have a desire to be at the forefront of data innovation, we would like to meet you.

About Us

Chubb is a world leader in insurance. With operations in 54 countries, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance, and life insurance to a diverse group of clients. The company is distinguished by its extensive product and service offerings, broad distribution capabilities, exceptional financial strength, underwriting excellence, superior claims handling expertise and local operations globally.

At Chubb, we are committed to equal employment opportunity and compliance with all laws and regulations pertaining to it. Our policy is to provide employment, training, compensation, promotion, and other conditions or opportunities of employment, without regard to race, color, religious creed, sex, gender, gender identity, gender expression, sexual orientation, marital status, national origin, ancestry, mental and physical disability, medical condition, genetic information, military and veteran status, age, and pregnancy or any other characteristic protected by law. Performance and qualifications are the only basis upon which we hire, assign, promote, compensate, develop and retain employees. Chubb prohibits all unlawful discrimination, harassment and retaliation against any individual who reports discrimination or harassment.