In this role, you will be a crucial player in designing, building, and maintaining cutting-edge data solutions on the Databricks platform. * Data Pipeline Engineering: Design, develop, and deploy robust and scalable data pipelines using Databricks, incorporating data extraction from diverse sources (databases, APIs, streaming platforms), transformation and cleansing using Spark, and loading into target systems (data lakes, data warehouses, etc.). * Data Architecture and Modeling: Contribute to the design and implementation of robust data models and architectures for data lakes and data warehouses, ensuring data consistency, integrity, and accessibility for various use cases.
more