Job Title:  Consulting-Business Operations-DM-Data Engineer 1 1

Job requisition ID ::  25661
Date:  May 16, 2022
Location:  Bengaluru
Designation:  Consultant


What impact will you make?


Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance. As one of the leading professional services organizations, Deloitte is where you will find numerous opportunities to succeed and realize your full potential.


The team

Our Cloud Engineering team focuses on enabling our client’s end-to-end journey from On-Premise to Cloud, with opportunities in the areas of: Cloud Strategy, Op Model Transformation, Cloud Development, Cloud Integration & APIs, Cloud Migration, Cloud Infrastructure & Engineering, and Cloud Managed Services. We help our clients see the transformational capabilities of Cloud as an opportunity for business enablement and competitive advantage.


Cloud Engineering supports our clients as they improve agility and resilience and identifies opportunities to reduce IT operations spend through automation by enabling Cloud. We accelerate our clients towards a technology-driven future, leveraging vendor solutions and Deloitte-developed software products, tools, and accelerators.


An ideal candidate should possess


The Data Engineer - Spark developer/Programmer requires someone with a broad technical knowledge, it also requires someone with a good set of communication skills and an analytical mind. Since the Data Engineer/developer must be able to communicate goals and instructions in a clear and efficient manner. In addition, developers frequently work with the business side of the company to determine the best course of action when designing the system. This means the developer needs to be able to listen to and interpret what the business side wants to see accomplished, discuss details in an easy-to-understand way, and then translate it all into nuts-and-bolts technical output.

The Programmer is also responsible for developing, configuring, or modifying complex integrated business and/or enterprise application solutions within various computing environments. This individual facilitates the implementation and maintenance of complex business and enterprise software solutions to ensure successful deployment of released applications.

The developer supports systems integration testing (SIT) and user acceptance testing (UAT) and participates in all software development life cycle phases


Required Minimum Qualifications


  • Bachelor's Degree or comparable job-related experience
  • 3-7 years of full life-cycle experience
  • Spark development and implementation
  • Experience is building ETL pipelines
  • Designing, building, installing, configuring, and supporting Spark application in cloud
  • Working experience in SPARK with any of the programming language i.e., Python, Scala
  • Proficient in project life cycle comprising of Requirement gathering, Development, Design, Test and Deploy
  • Hands-on experience working on Azure cloud
  • Strong communication skills
  • 3+ years of experience working on project(s) involving the implementation of spark-based solutions applying development life cycles (SDLC)


Required Skills


  • Understanding of Microsoft Azure Cloud services.
  • Familiarity with data loading and data transformation using Azure Data Factory
  • Developing business logic on Spark platform – Azure Databricks
  • Ability to write Spark code from scratch using python / pyspark / Spark SQL    
  • Familiar with Azure Synapse analytics
  • Good knowledge of database structures, theories, principles, and practices.
  • Writing high-performance, reliable, and maintainable code.
  • Analytical and problem-solving skills, applied to Big Data domain
  • Good Knowledge in Big Data


Core Responsibilities


The Programmer is responsible for designing and creating the data lake and all related extraction, transformation and load of data functions in the company. After the groundwork has been laid, developers also must test their designs to ensure the system runs smoothly. Furthermore, developers must be experts at taking a big-picture view of a company's data situation. Data Engineer designs take on many forms and tools, including on-premises/cloud integration, Data movement within different systems.


Required Competencies


  • Analytical Skills
  • Business Requirement Analysis
  • Business Understanding
  • Product Development Best Practices
  • Application Design
  • Programming
  • Application Testing


Tools and Technologies:


Hands-on experience in following Azure services is must

  • Azure Data Factory
  • Azure Data lake Gen2
  • Azure Databricks
  • Azure Synapse Analytics
  • Azure Analysis Service
  • Azure Key Vault


Exposure to Devops methodologies and CI/CD frameworks will be an added advantage.



Your role as a leader


At Deloitte India, we believe in the importance of leadership at all levels. We expect our people to embrace and live our purpose by challenging themselves to identify issues that are most important for our clients, our people, and for society, and make an impact that matters.


In addition to living our purpose, managers across our organization:


  • Develop self by actively seeking opportunities for growth, share knowledge and experiences with others, and act as a strong brand ambassador
  • Understand objectives for clients and Deloitte, align own work to objectives and set personal priorities
  • Seek opportunities to challenge self
  • Collaborate with others across businesses and borders to deliver and take accountability for own and team results
  • Identify and embrace our purpose and values and put these into practice in their professional life
  • Build relationships and communicate effectively in order to positively influence peers and other stakeholders



Professional growth

At Deloitte, our professional development plan focuses on helping people at every level of their career to identify and use their strengths to do their best work every day. From entry-level employees to senior leaders, we believe there’s always room to learn. From on-the-job learning experiences to formal development programs at Deloitte University, our professionals have a variety of opportunities to continue to grow throughout their career. Explore Deloitte University, The Leadership Center.




At Deloitte, we know that great people make a great organisation. We value our people and offer employees a broad range of benefits. Learn more about what working at Deloitte can mean for you.



Our purpose                                                                                                            


Deloitte is led by a purpose: To make an impact that matters.


Every day, people at Deloitte are making a real impact in the places they live and work. We pride ourselves on doing not only what is good for clients, but also what is good for our people and the communities in which we live and work—always striving to be an organization that is held up as a role model of quality, integrity, and positive change. Learn more about Deloitte's impact on the world



Recruiter tips


We want job seekers exploring opportunities at Deloitte to feel prepared and confident. To help you with your interview, we suggest that you do your research: know some background about the organization and the business area you’re applying to. Check out recruiting tips from Deloitte professionals.