We are seeking a talented and passionate Databricks Data Engineer to join our expanding Data & AI team Databricks Partner (50 FTE). You will have the opportunity to work with a variety of clients across different industries, collaborating with both internal teams and client stakeholders to deliver high-quality data pipelines and enable data-decision-. * Data Pipeline Engineering: Design, develop, and deploy robust and scalable data pipelines using Databricks, incorporating data extraction from diverse sources (databases, APIs, streaming platforms), transformation and cleansing using Spark, and loading into target systems (data lakes, data warehouses, etc.). Optimize pipeline performance for efficiency and cost-effectiveness. * Databricks Ecosystem Expertise: Utilize the full capabilities of the Databricks platform, including Databricks SQL, Delta Lake, Databricks Runtime, and Databricks Workflows, ...
meer