Job Title:  Consulting-ET&P-Oracle-Data Engineer-Manager

Job Title: Data Engineer

Location: Hyderabad Preferred

Job Type: Full-time

• Data Engineer with 6+ years plus of experience for developer role and 10+ for lead developer role
• Professionally impacted solution development and implementation over the last three or more years with
  • Designing and Implementing Data Pipelining, Data engineering solutions
  • Using Amazon Web Services (AWS) and Databricks
  • Supported data warehouse & big data solutions and data streaming processes
• Implement data orchestration pipelines, data sourcing, cleansing, augmentation and quality control processes within supported data systems
• Experience building data solutions using AWS services such as Redshift, RDS, Glue, S3, SQS, SNS, Lambda, Step functions, EC2, Amazon Aurora and others
• Proficiency in Python and Apache Spark
• Proficiency in SQL and experience with NO-SQL databases
• Familiarity with Kafka streaming
• Familiarity with agile development methodologies
• Experience building data-driven unit test suites and monitoring around data pipelines
• Experience modelling highly dimensional data
• Experience with version control system like GitHub
• Experience using Data Warehouse platforms e.g., Redshift, Snowflake

Qualifications:

      • Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred

      • Proven experience in designing and building data pipelines and ETL processes on AWS and Databricks

      • Strong proficiency in AWS services such as S3, Glue, Redshift, and Lambda

      • Expertise in Apache Spark and Databricks for data processing and transformation

      • Proficiency in programming languages such as Python, Scala, or Java

      • Knowledge of data modeling, data warehousing, and database technologies

      • Experience with version control systems (e.g., Git) and CI/CD pipelines