Technical Architect Jobs Opening in Deloitte Consulting India Private Limited at Hyderabad, Bengaluru
SR Data Engineer
organization.
Job Description
Must-Have Skills:
AWS Core Services:
Amazon S3: Proficiency in using S3 for data storage, organization, and retrieval.
AWS Lambda: Experience with serverless computing for data processing and automation.
Amazon RDS/Aurora: Understanding of relational databases and their use in AWS environments.
Amazon Glue: Familiarity with AWS Glue for ETL (Extract, Transform, Load) operations, data cataloging, and schema management.
Data Modeling: Solid understanding of dimensional and relational data modeling, star and snowflake schemas, and normalization/denormalization techniques.
ETL Development: Proficiency in designing and building ETL pipelines, both with AWS Glue and using custom tools like Pyspark, Python(Pandas), Spark, or Apache Airflow.
SQL and Database Management: Expertise in SQL for querying databases and optimizing performance. Experience with relational databases (e.g., PostgreSQL, MySQL).
Data Quality and Monitoring: Proficiency in monitoring and ensuring data quality throughout the pipeline using CloudWatch, CloudTrail, and other AWS monitoring tools.
Scripting and Automation: Strong knowledge of scripting languages like Python, Bash, or Shell for automation of data workflows, job scheduling, and monitoring.