Databricks – Engineer

IRIS Software is a prominent Indian IT services firm that delivers end‑to‑end technology solutions across sectors such as financial services, healthcare, logistics and professional services. With a strong focus on application and product engineering, data & analytics, cloud, DevOps and AI‑driven operations, the company has built a reputation for handling complex enterprise challenges at scale. Its culture encourages continuous learning, collaborative problem‑solving and a quality‑first mindset, making it an attractive destination for fresh engineering talent.

The Databricks Engineer role is positioned within IRIS Software’s Data Engineering practice. The position is aimed at fresh graduates who are eager to design, develop and maintain robust data pipelines on modern lakehouse platforms. Candidates will work on both batch and near‑real‑time data processing, leveraging PySpark, Apache Kafka, Databricks Workflows, Delta Lake and Snowflake to deliver reliable, business‑ready data products.

The role also expects engineers to adopt AI‑assisted coding tools, ensure thorough testing, and provide production support for critical data workflows.

Key Responsibilities

• Design, develop and maintain scalable PySpark pipelines for batch and streaming workloads.
• Build ingestion and transformation workflows using Apache Kafka or Amazon Kinesis for event‑driven data movement.
• Configure and manage Databricks Workflows and/or Apache Airflow for job orchestration and scheduling.
• Implement data storage solutions on Delta Lake (Databricks) and Snowflake, ensuring data quality and consistency.
• Perform data validation, reconciliation and quality checks to guarantee reliable outputs.
• Troubleshoot pipeline failures, conduct root‑cause analysis and optimise performance bottlenecks.
• Write unit and integration tests, support CI/CD deployments and provide production support.
• Document technical designs, workflow definitions and operational procedures.
• Collaborate with cross‑functional teams and business stakeholders to translate requirements into data solutions.
• Leverage approved AI‑assisted engineering tools to improve productivity while adhering to coding standards.

Tech Stack: PySpark, Apache Kafka, Databricks Workflows, Delta Lake, Snowflake, Apache Airflow, Amazon Kinesis, Python, SQL, Git.

Growth Path: Freshers start as Data Engineers, progress to Senior Data Engineer, then to Data Platform Lead or Solution Architect, with opportunities to specialise in lakehouse architectures, real‑time analytics or cloud data platforms.

Why Join IRIS Software? The company offers exposure to cutting‑edge data technologies, mentorship from seasoned engineers, and a clear career ladder. Employees benefit from a supportive work culture that balances challenging projects with work‑life harmony, competitive compensation and a suite of health and wellness benefits.

Joining IRIS Software provides a solid foundation for a long‑term career in data engineering and analytics.