Data Pipeline Engineering: Design, develop, and deploy robust and scalable data pipelines using Databricks, incorporating data extraction from diverse sources (databases, APIs, streaming platforms), transformation and cleansing using Spark, and loading into target systems (data lakes, data warehouses, etc.). * Collaboration and Communication: Work closely with , , , and business stakeholders to understand their data requirements and provide technical expertise on Databricks and data engineering best practices. * Data Fundamentals: Solid understanding of data warehousing principles, ETL processes, data modeling techniques, and database systems. * Communication Skills: Excellent communication and interpersonal skills, with the ability to effectively collaborate with technical and non-technical stakeholders.
more