Databricks + SQL + Python/PySpark + Data EngineeringRole Overview We are seeking an 6 Y of experienced Databricks Data Engineer with strong expertise in building scalable data pipelines, managing large datasets, and delivering business-driven solutions. The ideal candidate will have advanced skills in Python and SQL, hands-on experience with Databricks, and the ability to translate business requirements into efficient technical implementations.Key ResponsibilitiesDesign, develop, and optimize ETL pipelines and workflows using Databricks, Python, and SQL.Handle large-scale datasets, ensuring performance, scalability, and data integrity.Translate business requirements into robust data models, queries, and scripts.Implement data transformations, orchestration, and automation within Databricks.Collaborate with analysts, data scientists, and business stakeholders to deliver actionable insights.Build dashboards and reports using Power BI or similar BI tools.Ensure compliance with data governance, security, and best practices.Document processes, pipelines, and solutions for knowledge sharing.Required SkillsStrong proficiency in Python and SQL with 6+ years of experience.Hands-on expertise with Databricks (data engineering, Spark, orchestration).Experience handling large datasets and optimizing performance.Knowledge of data warehousing concepts and ETL workflows.Familiarity with BI tools (Power BI, Tableau) for reporting and visualization.Exposure to cloud platforms (Azure, AWS, or GCP) and version control (Git).Strong problem-solving, communication, and collaboration skills.Exposure to machine learning workflows within Databricks is a plus.
Comments for Suppliers: Databricks Unified Data Analytics Platform
Responsibilities
Databricks + SQL + Python/PySpark + Data EngineeringRole Overview We are seeking an 6 Y of experienced Databricks Data Engineer with strong expertise in building scalable data pipelines, managing large datasets, and delivering business-driven solutions. The ideal candidate will have advanced skills in Python and SQL, hands-on experience with Databricks, and the ability to translate business requirements into efficient technical implementations.Key ResponsibilitiesDesign, develop, and optimize ETL pipelines and workflows using Databricks, Python, and SQL.Handle large-scale datasets, ensuring performance, scalability, and data integrity.Translate business requirements into robust data models, queries, and scripts.Implement data transformations, orchestration, and automation within Databricks.Collaborate with analysts, data scientists, and business stakeholders to deliver actionable insights.Build dashboards and reports using Power BI or similar BI tools.Ensure compliance with data governance, security, and best practices.Document processes, pipelines, and solutions for knowledge sharing.Required SkillsStrong proficiency in Python and SQL with 6+ years of experience.Hands-on expertise with Databricks (data engineering, Spark, orchestration).Experience handling large datasets and optimizing performance.Knowledge of data warehousing concepts and ETL workflows.Familiarity with BI tools (Power BI, Tableau) for reporting and visualization.Exposure to cloud platforms (Azure, AWS, or GCP) and version control (Git).Strong problem-solving, communication, and collaboration skills.Exposure to machine learning workflows within Databricks is a plus.
Comments for Suppliers: Databricks Unified Data Analytics Platform
Salary : Rs. 0.0 - Rs. 2,17,000.0
Industry :IT-Software / Software Services
Functional Area : IT Software - Application Programming , Maintenance
Digital : Databricks~AI and Automation~Manual Testing Processes and Management
Job Description:
1. 1. Good experience in developing SQL queries for testing complex ETL transformations
2. Proficiency in ETL Testing, Data Validation, Data Warehouse Testing
3. Experienced in data value chain in P&C, Reinsurance and Lloyds of London.
4. Good knowledge of Data warehousing QA concepts
5. Hands on Experience on Azure Databricks
6. Thorough Understanding of Databricks-based ETL workflows, including data ingestion, transformation, and validation.
7. Knowledge in Test Strategy, Test Plan, Test Case creation, STLC, Bug Life Cycle
8. Handson experience with Agile & QA tools
1. Knowledge in Pyspark
2. Basic understanding of Dax code in Power BI
3. Proficient knowledge in Azure DevOps, SDLC, STLC, DevOps and CI/CD processes.
Responsibilities
Job Description:
1. 1. Good experience in developing SQL queries for testing complex ETL transformations
2. Proficiency in ETL Testing, Data Validation, Data Warehouse Testing
3. Experienced in data value chain in P&C, Reinsurance and Lloyds of London.
4. Good knowledge of Data warehousing QA concepts
5. Hands on Experience on Azure Databricks
6. Thorough Understanding of Databricks-based ETL workflows, including data ingestion, transformation, and validation.
7. Knowledge in Test Strategy, Test Plan, Test Case creation, STLC, Bug Life Cycle
8. Handson experience with Agile & QA tools
1. Knowledge in Pyspark
2. Basic understanding of Dax code in Power BI
3. Proficient knowledge in Azure DevOps, SDLC, STLC, DevOps and CI/CD processes.
Salary : As per industry standard.
Industry :IT-Software / Software Services
Functional Area : IT Software - Application Programming , Maintenance
Role Category :Programming & Design
Role :Digital : Databricks~AI and Automation~Manual Testing Processes and Management
