Data Engineer - Hadoop/MapReduce Jobs in Mumbai - Talent Tigers
Job Description
Responsibilities
- Work on collecting, storing, processing, and analyzing huge sets of data.
- The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.
- Responsible for integrating them with the architecture used across the company.
- Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
- Implementing ETL process
- Monitoring performance and advising any necessary infrastructure changes
- Defining data retention policies
- Proficient understanding of distributed computing principles
- Management of Hadoop cluster, with all included services
- Ability to solve any ongoing issues with operating the cluster
- Proficiency with Hadoop v2, MapReduce, HDFS
- Experience with building stream-processing systems, using solutions such as Storm/Flink/Spark-Streaming
- Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
- Experience with Spark
- Experience with integration of data from multiple data sources
- Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
- Knowledge of various ETL techniques and frameworks, such as Flume
- Experience with various messaging systems, such as Kafka or RabbitMQ
- Good understanding of Lambda Architecture, along with its advantages and drawbacks
- Experience with ELK (Elasticsearch, Logstash, Kibana) Stack
- BTech/BE equivalent
- 1-3years experience for SDEII
- 3-7years experience for SDEII
Job Particulars
Role engineer core non it
Education Diploma, B.Com, M.Com, BCA, BE/B.Tech, BSc, MCA, ME/M.Tech, MSc, PG Diploma, 12th Pass (HSE)
Who can apply Freshers and Experienced (0 to 3 Years )
Hiring Process Face to Face Interview
Employment TypeFull Time
Job Id968761
Job Category Core Technical , Diploma
Locality Address
State Maharashtra
Country India
About Company
Talent Tigers
Jobs By Location
Mumbai
Hyderabad
Kolkata
Bangalore
Ahmedabad
Delhi
Gurgaon
Chennai
Pune
Noida
Others also searched for
Job & career videos Subscribe