Job Title: Consulting-BO-Cloud Engineering-GCP Data Engineer-Chennai
Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance. As one of the leading professional services organizations, Deloitte is where you will find numerous opportunities to succeed and realize your full potential.
The team
Deloitte is working with global customers on cloud technologies to help unlock growth, stability, and sustainability by enabling them to spot unseen business trends through curation, transformation, and blending of data. In our endeavors for continued expansion, we’re searching for like-minded individuals to help us ‘take it to the next level’.
In this exciting opportunity for an experienced developer, you will join a team delivering a transformative cloud hosted data platform for some of the world’s biggest organizations. The candidate we seek, needs to have a proven track record in databases & GCP data migration. Deep technical skills and experience with working on GCP.
You will also be required to participate in stakeholder management, highlight risks, propose deliver plans and estimate for time and team size based on requirements. Hence, adequate levels of communication skills and relevant experience in handling such situations is desired.
Role: Data Engineer
Experience Level: 2 to 4 Years
Work location: Chennai
Role & Responsibilities:
- Build/implement solutions to ingest, store and process data using standard tools such as python and SQL,and other scripting languages.
- Work with large datasets and develop data pipelines that move data from source systems to data warehouses (e.g. Big Query), databases (e.g. MySQL, Postgres, SQL Server), data lakes and other data storage and processing systems. Develop and maintain ETL processes, data integration systems.
Required Skills:
-
Language (Must have) – Python
-
Data Processing (Anyone is must) - Apache Spark or PySpark or Apache Beam
-
Experience on following GCP Services (Must have) - Bigquery
-
Experience on following GCP Services (Good to have)- Dataflow/Dataproc, Cloud SQL, Workflow/Cloud Composer, GCS, pub-sub, data catalogue
-
Any 1 database is must have from below 3 databases
-
Mysql
-
Postgres
-
SQL Server
-
- BS, MS or PhD degree in Computer Science or Engineering, and 2+ years of relevant work experience in Big Data and cloud systems.
- Experience building and supporting large-scale systems in a production environment
Technology Stack:
- Cloud Platforms –GCP
- Any of Apache Spart/CDH/HDP/EMR/Google DataProc/HD-Insights Distributed processing
- Frameworks.
- One or more of MapReduce, Apache Spark, Apache Storm, Apache Flink. Database/warehouse
- Hive, HBase,Bigtable and at least one cloud native services Orchestration Frameworks
- Any of Airflow, Oozie, Apache NiFi, Google DataFlow Message/Event Solutions
- Any of Kafka, Kinesis, Cloud pub-sub Container Orchestration (Good to have)
Your role as a leader
At Deloitte India, we believe in the importance of leadership at all levels. We expect our people to embrace and live our purpose by challenging themselves to identify issues that are most important for our clients, our people, and for society, and make an impact that matters.
In addition to living our purpose, managers across our organization:
- Develop self by actively seeking opportunities for growth, share knowledge and experiences with others, and act as a strong brand ambassador
- Understand objectives for clients and Deloitte, align own work to objectives and set personal priorities
- Seek opportunities to challenge self
- Collaborate with others across businesses and borders to deliver and take accountability for own and team results
- Identify and embrace our purpose and values and put these into practice in their professional life
- Build relationships and communicate effectively in order to positively influence peers and other stakeholders
Professional growth
At Deloitte, our professional development plan focuses on helping people at every level of their career to identify and use their strengths to do their best work every day. From entry-level employees to senior leaders, we believe there’s always room to learn. From on-the-job learning experiences to formal development programs at Deloitte University, our professionals have a variety of opportunities to continue to grow throughout their career. Explore Deloitte University, The Leadership Center.
Benefits
At Deloitte, we know that great people make a great organisation. We value our people and offer employees a broad range of benefits. Learn more about what working at Deloitte can mean for you.
Our purpose
Deloitte is led by a purpose: To make an impact that matters.
Every day, Deloitte people are making a real impact in the places they live and work. We pride ourselves on doing not only what is good for clients, but also what is good for our people and the communities in which we live and work—always striving to be an organization that is held up as a role model of quality, integrity, and positive change.
Learn more about Deloitte's impact on the world