ad

Data Integration Engineer Jobs in Gurgaon - ClimaCell

CW
Data Integration Engineer
ClimaCell
Other Course, BE/B.Tech
0 to 3 yrs
ClimaCell
Last Date 01 May 2021
Apply Now

ClimaCell - Job Details

Date of posting: 01 Mar 21
Climacell's R&D Team is a mixture of scientists and engineers committed to generating the best and most novel data and models across all times: historical, real-time and forecast.

We also focus on making everything become a weather station (from cars to microwave links to IoT devices).

The story just begins when the data hits our ingest and post-processing services.

Every product that the user sees is the result of a pipeline of algorithms that needs to be run quickly and continuously. We are the team that builds the architecture behind the data and the models, to prepare the weather analyses, for the Product and Engineering team to serve to the masses.

As Data Integration Engineers, you'll ensure we are getting high quality and current data from the source systems, and that this data is reliably uploaded to the cloud storage in a uniform format that can be consumed by the ClimaCell models.

The ideal candidate would possess several skill sets including proficiency with python, data technologies and SQL, passion for data analytics, and excellent communication skills.

You will be working closely with Meteorological Data Engineer, understand requirements and build seamless data pipes that include but are not limited to extraction of data directly from sources, normalize or transform into unified schemas and structure, load it into databases with highest possible data quality and lowest possible latency. And when required working with Sr. Data scientists to refine and align technical and scientific requirements.

This is a fantastic role for a data geek with awesome skills for someone that wants to jump into an extremely fast-cycle deployment world. Your energy and enthusiasm to work and grow alongside our high-trajectory team are essential!

What You'll Be Doing
  • Develops and maintains scalable data pipelines using third party platform or custom development using web scraping, python based data retrieval applications
  • Builds and maintain new API integrations to support continuing increases in data volume and complexity
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Collaborates with Meteorological Data Engineer and data scientists to improve observation collection methodologies, data pipelines, observation quality to increase data accessibility
  • Writes unit/integration tests, contributes to engineering wiki, and documents work.
  • Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
  • Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.

What You Bring
  • 5+ years of experience in a Data Integration Engineer role, who has attained a Graduate and Post-Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field
  • 5+ years experience in Python with working knowledge of building ETL pipelines/processes supporting data transformation, data structures, metadata, dependency and workload management.
  • 3+ years Data Integration technologies and principles. Experience as a data engineer (working with databases,data pipelines, architectures and data sets)
  • Strong experience integrating data from structured and unstructured formats e.g. XML, EDI, JSON, CSVs
  • Experience working with files, databases and streamed data
  • Experience integrating data from various sources in multiple protocol environments such as REST, HTTP, FTP / SFTP, RSS meetds etc
  • Experience scraping and parsing HTML pages to extract embedded data
  • Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores
  • Experience with relational SQL and NoSQL databases, including Postgres.
  • Winning + Can-Do attitude, fire & forget personality, can take responsibilities, friendly and approachable, ready to take challenges individually, last but not the least excellent team player.
Bonus points
  • Experience on various cloud based data integration platforms such as Azure's data factory, Xplenty, Talent, Informatica power center etc.
  • Familiarity with meteorological file formats such as GRIB2, BUFR, and NetCDF
  • Data science background with automation experience.
  • Experience with AWS and Google cloud services: EC2, EMR, RDS, Redshift, Bigquery, Cloud SQL, Compute engine etc
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
So if Data is your middle name, you're a creative thinker and your friends call you when there's a big problem to solve and if you love rain - this is the team for you.

If you have reached this point and you are super excited but not sure you check all the boxes - we still want to speak with you! Your passion is priceless. Other things can be learned.

___________________________________________________________________________________________

About ClimaCell:

ClimaCell is the world's leading weather intelligence engine, powering the most compelling insights for teams to drive actions and collaboration around the world.

Building the most robust weather platform in the world, ClimaCell's technology enables partners like JetBlue, Ford, AWS, The New England Patriots, National Grid and more to understand how the weather impacts their business operations and implement predictive action plans to improve efficiency, safety, and revenue.

ClimaCell's stands apart through its AI powered Weather-of-Things technology, which offers hyper local weather insights for businesses via aggregation and data modeling from wireless networks, street cameras, drones, connected cars and more all around the globe.

Founded in 2015 by Harvard Business School and MIT Sloan former jet pilots and weather enthusiasts, ClimaCell is in hyper growth mode with 7x revenue growth in 2019 and offices in Boston, Boulder, Tel Aviv, and Singapore. ClimaCell also operates ClimaCell.org, a non-profit focused on improving access to weather data globally, helping save and transform billions of lives in developing countries.

How we roll: We work in an 'one office' environment. We believe that magic happens when people work together. Together also includes Zoom meetings, flexible hours and unlimited vacation days. Your success is achieved by your impact and deliveries and not by the hours you put in. We believe in transparency and directness, putting work before ego and empathy. We grow fast and move faster but we always see people first. Each person has their own career growth path for we believe that the only

Job Summary

Job Type : 0
Job Category : Core Technical
Hiring Process : Face to Face Interview
Who can apply : Freshers and Experienced (0 to 3 yrs )

About ClimaCell

ClimaCell
Apply Now
This posting is done directly & exclusively on Freshersworld.com. We do not entertain any unsolicited calls or enquiries from any consultants, other portals or TPOs. Notice: This recruitment is FREE. if the recruiter charges any fees, please write us info@freshersworld.com
AWS Migration Engineer
Diploma, B.Com, M.Com, BCA, BE/B.Tech...
Quality Engineer
BE/B.Tech, Other Course
Mainframe Network Engineer
BE/B.Tech, Any Graduate
Platform/Backend Engineer
BE/B.Tech, Other Course

People who view this job also look for jobs with following keywords

Fully solved online mock placement papers with latest test pattern,count down timer,detail test analysis with answer and explanation is available at Power Placement Preparation:P3.
Start your preparation now with P3 and increase your success probabiltiy.

Need a Institute/Coaching Class?

IT Courses / Govt Exam Preparation

Higher Studies / Studies Abroad

Post an enquiry and get instant responses from institutes and best Coaching Classes in your city

ClimaCell recruiting Data Integration Engineer Experienced(0 to 3 yrs) candidates candidates nearby Gurgaon.ClimaCell vacancies for Data Integration Engineer is recruited through Written-test, Face to Face Interview etc.
ClimaCell Company recruits a lot of Experienced(0 to 3 yrs) candidates candidates every year based on the skills . The candidates with Other Course, BE/B.Tech are selected to full fill the vacancies in Engineer (Core, Non-IT) job field. The candidates nearby Gurgaon can apply for Data Integration Engineer position in ClimaCell. All candidates should have a degree or post-graduation in the required field based on the requirement mentioned. The jobs are available in Full Time basis. When it comes to the ClimaCell recruitment, candidates are mostly chosen for the department of Engineer (Core, Non-IT) . To learn more about the current jobs and other details, it is better to go through official site of ClimaCell and Freshersworld. Find the latest jobs near you and near your home. So, that you don’t need to relocate. The Freshersworld is a leading employment portal that researches the official site of ClimaCell and provides all the details about the current vacancies, the application process, selection process, interview test details, important dates and other information. Search and apply for the top job positions in ClimaCell and near your city and get a secured career.