Codersbrain is hiring for Data Engineer
Location=Pune,Bangalore,Gurgaon,Noida,Mumbai
Exp=1year to 1.5 years(for junior associate)
2.5 years to 7 years(for Associate)
8 years to 12 years(for team Lead)
Notice Period=Immediate to 30 days
Job Description: Data Acquisition Engineer
As a core member of our data acquisition operations team, a data engineer is responsible for maintaining crawlers and parsers and performing required fixes on demand to ensure product data within the assigned geographical region is successfully and consistently acquired daily.
The ideal candidate has 1-2 years of hands-on programming experience in Ruby or Python, HTML, and JavaScript. The candidate has basic knowledge in web development or web scraping and is comfortable working with JSON/XML files to extract data.
Selected candidates will undergo a 4-6 week intensive hands-on training to help build operational skills to work with our crawling system and practice techniques and strategies to solve day-to-day challenges.
What will you do after training?
1.Work with large data sets using various DBMS (MySQL, Cassandra)
2.Write high-load scripts for collecting and processing large amounts of data
3.Collection of data from publicly available sources on the Internet (websites, mobile applications), as well as from private channels of our clients
4.Remote into Linux servers and execute jobs using console utilities and scripts
5.Perform validation and customization of collected data according to customer requirements
6.Participate in the design and development of internal tools and processes to automate and accelerate the work
Our expectations from the right candidate:
1.SQL: Writing Simple Queries Using Subqueries or Joining Tables (JOIN)
2.Ruby - knowledge of the language syntax and basic data structures (arrays, hashes), working with classes and modules, working with files (CSV, XML, Excel, JSON).
3.Basic knowledge of any OOP programming language
4.Basic knowledge: Xpath, regular expressions, HTML, JavaScript
5.Knowledge of the HTTP protocol (cookies, headers, status codes)
6.Ability to use developer tools (Firebug, Google Chrome dev tools)
7.Willingness and ability to learn independently
8.Excellent proficiency in English (spoken and written)
9.Flexibility to work in shifts either earlier in the day or later to maximize overlap with Easter European teams
