We are seeking a skilled Databricks Consultant to design, implement, and optimize scalable data solutions on the Databricks platform. The ideal candidate should have strong expertise in big data technologies, cloud platforms, and data engineering, with hands-on experience in building robust data pipelines and analytics solutions using Apache Spark and Databricks.
Design and develop end-to-end data pipelines using Databricks (batch and streaming).
Build and maintain ETL/ELT workflows using Spark (PySpark/Scala).
Optimize performance of Databricks clusters, jobs, and queries.
Implement Delta Lake architecture (Medallion architecture: Bronze, Silver, Gold layers).
Work with business teams to convert requirements into data models and analytical solutions.
Ensure data quality, governance, and security compliance.
Collaborate with DevOps to implement CI/CD pipelines for data workflows.
Responsibilities
We are seeking a skilled Databricks Consultant to design, implement, and optimize scalable data solutions on the Databricks platform. The ideal candidate should have strong expertise in big data technologies, cloud platforms, and data engineering, with hands-on experience in building robust data pipelines and analytics solutions using Apache Spark and Databricks.
Design and develop end-to-end data pipelines using Databricks (batch and streaming).
Build and maintain ETL/ELT workflows using Spark (PySpark/Scala).
Optimize performance of Databricks clusters, jobs, and queries.
Implement Delta Lake architecture (Medallion architecture: Bronze, Silver, Gold layers).
Work with business teams to convert requirements into data models and analytical solutions.
Ensure data quality, governance, and security compliance.
Collaborate with DevOps to implement CI/CD pipelines for data workflows.
Salary : As per industry standard.
Industry :IT-Software / Software Services
Functional Area : IT Software - Application Programming , Maintenance