Job Description

About AbarVa

AbarVa is building Nexus , an AI-native enterprise execution platform that helps organizations turn strategic decisions into governed action, measurable outcomes, and sustained business value.

We are building Nexus alongside complex enterprise Data & AI transformations, particularly in regulated industries.

The opportunity

We are looking for an experienced Senior Data Engineer with deep, hands-on Databricks experience to join AbarVa’s U.S. Data & AI engineering team.

This is a builder role. You will work directly on modern enterprise data foundations: profiling complex source systems, building ingestion pipelines, developing Bronze and Silver data layers, solving difficult data-quality and reconciliation problems, and creating governed data products that support analytics and AI.

We are looking for someone who can personally design, build, debug and productionize—not someone whose experience is primarily coordination or oversight.

What you will do

• Build and operate enterprise-scale data pipelines on Databricks.
• Develop ingestion patterns for structured and semi-structured enterprise sources.
• Build Bronze, Silver and curated data products using modern lakehouse patterns.
• Develop with Python, PySpark, Spark SQL and SQL.
• Implement metadata-driven ingestion and reusable engineering patterns.
• Profile complex enterprise data and identify schema, quality and reconciliation issues.
• Build data-quality rules, reconciliation controls and exception-management processes.
• Implement lineage, metadata, access and governance patterns using Unity Catalog.
• Work with identity, reference-data and cross-system matching problems.
• Support reconstruction and modernization of legacy analytics and business logic.
• Build automated tests, monitoring, replay, observability and production controls.
• Participate actively in code reviews and architecture discussions.
• Work closely with analytics, AI/ML and visualization engineers.
• Work directly with enterprise client data and technology teams.

Required qualifications

• Current Databricks certification required.
• Databricks Certified Data Engineer Associate or Professional.
• Strong hands-on Databricks engineering experience.
• Strong Python / PySpark and SQL.
• Production experience with Spark and Delta Lake.
• Experience with ingestion, schema evolution, incremental processing and data pipelines.
• Experience with Bronze/Silver/Gold or comparable layered data architectures.
• Experience implementing data quality and reconciliation.
• Working knowledge of Unity Catalog.
• Strong AWS experience preferred; Azure experience also valuable.
• Ability to troubleshoot real production data-engineering problems independently.
• Strong written and spoken English.
• Comfortable working directly with enterprise clients and senior engineers.

Preferred experience

• Databricks Data Engineer Professional certification.
• Healthcare, financial services, insurance or another regulated industry.
• Claims, clinical, financial or other complex enterprise data.
• CDC and streaming architectures.
• Metadata-driven engineering frameworks.
• CI/CD and automated testing for data pipelines.
• Data governance and Collibra exposure.
• Supporting data foundations for AI/ML or agentic applications.

U.S. work authorization

Candidates must:

• Be currently authorized to work in the United States.
• Be able to work in the United States without current or future employment sponsorship.
• Be based in the United States and able to work directly with U.S.-based client teams.

What we offer

AbarVa offers a competitive compensation package aligned to experience, including:

• Competitive cash compensation
• Performance-based incentive opportunity
• Opportunity to grow with an early-stage Data & AI company
• Exposure to significant enterprise Data & AI transformation programs

How we hire

Our process is designed to validate real engineering ability:

• Work authorization and Databricks certification verification
• AI-led technical screen
• Live Databricks/data-engineering discussion
• Hands-on technical/problem-solving assessment
• Leadership discussion
• Professional references

Job Tags

Full time, Visa sponsorship

Similar Jobs