About the job

Job Description

Role: Data Engineer

Job Summary

Data Engineer / Data Analyst with data analytics experience using Databricks on AWS, Pyspark, Python, and SQL

This position requires migration experience and GenAI background for automation

Experience And Education Required

5+ years of experience as Data Analyst / Data Engineer with Databricks, Pyspark, Python experience

Job Profile

 Hands-on data analytics experience using Databricks, Pyspark and Python

 Must have prior experience with migrating a data asset to the cloud using a GenAI automation option

 Experience in migrating data from on-premises to AWS

 Expertise in developing data models, delivering data-driven insights for business solutions

 Data Collection & Integration: Identify, gather, and consolidate data from diverse sources, including internal databases and spreadsheets ensuring data integrity and relevance.

 Data Cleaning & Transformation: Apply thorough data quality checks, cleaning processes, and transformations using Python (Pandas) and SQL to prepare datasets.

 Automation & Scalability: Develop and maintain scripts that automate repetitive data preparation tasks.

Technical Skills

 Minimum of 5 years of experience as a Data Analyst, Data Engineer, or related role, ideally with a bachelor’s degree or higher in a relevant field.

 Strong proficiency in Python and SQL, with experience working across various data formats and sources.

 Proven ability to automate data workflows, implement code-based best practices, and maintain documentation to ensure reproducibility and scalability.

Behavioral Skills

 Documentation & Best Practices: Maintain clear, concise documentation of data workflows, coding standards, and analytical methodologies to support knowledge transfer and scalability.

 Excellent communication skills for engaging with colleagues, clarifying requirements, and conveying analytical results in a meaningful, non-technical manner.

 A self-directed, resourceful problem-solver who collaborates well with others while confidently managing tasks and priorities independently.

Desired Skills and Experience

PRIMARY COMPETENCY : Data Engineering PRIMARY SKILL : Databricks Developer PRIMARY SKILL PERCENTAGE : 80 SECONDARY COMPETENCY : Cloud Apps SECONDARY SKILL : Amazon Web Services-Cloud platform SECONDARY SKILL PERCENTAGE : 20