DataBricks Data Engineer

DataBricks Data Engineer requires: • Must have functional and technical experience with Sales Incentive Compensation (SIC) including incentive plan design, quota allocation, attainment tracking, commission calculations, and payout processing. • At least 7 years of experience in data engineering, with a minimum of 3 years hands-on experience building and managing Databricks solutions. • Extensive experience with Databricks platform components: Delta Lake, Delta Live Tables, Unity Catalog and Databricks Workflows. • Strong proficiency in Python and/or Scala for data engineering; SQL expertise required. • Strong experience with core data engineering practices including data ingestion, transformation (ETL/ELT), data modeling, and pipeline orchestration. • Experience integrating Databricks with cloud platforms (Azure, AWS, or GCP) and data sources such as Azure Data Factory, Event Hubs, Kafka, or equivalent. • Passion and ability to create holistic, end-to-end, integrated data solutions. • Familiarity with SIC platforms (e.g., Anaplan, Oracle ICM, Varicent) and experience integrating them with data engineering platforms is a strong plus. • Ability to understand complex incentive compensation rules and model them accurately in data pipelines and transformation logic •