Logo for INV Technologies

Automation Engineer - Worlwide Remote

INV Technologies

Role overview

Qualifications

  • Strong hands-on experience in Python programming
  • Good experience with scraping libraries such as Requests, BeautifulSoup, Selenium and Scrapy
  • Proven 3+ experience working on web development frameworks such as Flask/Django/FastAPI/Tornado/Pandas
  • Knowledge of building APIs and services using REST

Responsibilities

  • Create crawlers for each source URL by using Python modules [scrapy, selenium, requests, BeautifulSoup and splash]
  • Create and maintain scrapy pipelines and middlewares to manage the output from the crawlers
  • Manage the crawlers to overcome technical challenges like IP ban, geolocation ban, captcha and bot blocking services
  • Write SQL queries to manage database operations using Python modules like sqlalchemy

Key facts

Hard skills

Other skills

  • Troubleshooting (Problem Solving)
  • Social Skills
  • Teamwork

About the company

INV Technologies logo

INV Technologies

IT Services & IT Consulting

INV is a leading organization in the field of Embedded Systems, Electronics, Mechanical, Electrical & Educational Robotics currently focuses on college level education. We at INV emphasize on technical education through practical learning. INV has its own R&D lab at its incubation center were we encourage research and development through internal funding. INV was founded on August 2014 and is currently incubated at Dwarakanagar, Visakhapatnam. By developing an active interest of youth INV aims to lay a strong foundation for the technical development of our country. INV is a constant facilitator in the scientific and technical education of students by providing them requisite resources through wide variety of kits, software based programming tools, basic & advanced level workshops and web based learning resources. INV has a young and dynamic team with a passion for technical education and entrepreneurship. The founders and other team members of INV themselves have a wonderful record, vast experience, and achievements in the field of robotics. They have many years of varied experience and have participated and won accolades in the field of robotics, Aero modeling, embedded system. Since its incorporation, INV has been actively backed by academia and industry alike The INV group is an implementer of leading-edge technology enabled solutions operating in the core technical segments of the Industry. The Group’s business is concentrated in the areas of Electronics, Electrical, Communication, Manufacturing and IT solutions. INV uses state-of-the-art technology that adds value to customers through a combination of multiple high-end technologies for complete solutions. The Group has the competence and capability to integrate all products, systems and services. It caters to Industry needs across market segments by undertaking complete projects in wwwheavy industries.

Company details

IndustryIT Services & IT Consulting
Company size11 - 50

Links

Website LinkedIn See all jobs

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Company Description

Invisible Technologies offers unusual services (a combination of outsourcing and automation) to fast-scaling, innovative companies. Each company understands and uses our services in a variety of ways. It’s critical we can communicate to segments of users with visually appealing, and highly communicative assets. You’re helping us explain the benefits of our product in a way that words alone never could. 

Job Description

Job Responsibilities:

Create crawlers for each source URL by using Python modules [scrapy, selenium, requests, BeautifulSoup and splash]

Create and maintain scrapy pipelines and middlewares to manage the output from the crawlers.

Create crawlers for all types of websites irrespective of the technical roadblocks.

Manage the crawlers to overcome technical challenges like IP ban, geolocation ban, captcha and bot blocking services.

Write SQL queries to manage database operations using Python modules like sqlalchemyDeploy the python scripts / crawlers to Linux based AWS servers

SkillsMust Haves:

Strong hands-on experience in Python programming

Good experience with scraping libraries such as Requests, BeautifulSoup, Selenium and Scrapy.

Proven 3+ experience working on web development frameworks such as Flask/Django/FastAPI/Tornado/PandasKnowledge of building APIs and services using REST.

Experience with any RDBMS and strong SQL knowledge.

Clear with Object-oriented concepts.

Excellent troubleshooting skills.

Proficient understanding of code versioning tools like git.

Basic understanding of front-end technologies, such as JavaScript, HTML5 and CSS3Understanding of fundamental design principles behind a scalable application.

Nice to have:

Familiar with UI frameworks like Angular/ReactJS

Strong unit test and debugging skills.

Strong knowledge of data engineering platforms such as Airflow.

Experience with the Google CloudDockerAgile and Scrum. Even better if have worked in Jira and confluence.

Experience with ETLCeleryExcellent interpersonal skills and ability to to work with a diverse team

Qualifications

Required: Technical Skills

  • Python
  • JavaScript
  • PostgresSQL
  • Web Scraping using Requests, BeautifulSoup, Selenium and Scrapy
  • Frameworks such as Flask/Django/FastAPI/Tornado/Pandas
  • Building APIs and services using REST

Additional Information

https://jobs.lever.co/invisible/e3f21175-7605-4b30-8790-5ddbd97ab3b5

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

Test Automation Engineer Related jobs

California (USA)Test Automation Engineer

Other jobs at INV Technologies

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.