Match score not available

Grupo QuintoAndar - Senior Data Platform Engineer at QuintoAndar

Remote: 
Full Remote
Experience: 
Mid-level (2-5 years)
Work from: 

Offer summary

Qualifications:

Proficiency in Big Data technologies like Spark, Hive, MapReduce and Python, Understanding of data lifecycle concepts.

Key responsabilities:

  • Build and maintain high-performance data platform
  • Align with stakeholders to propose scalable solutions
  • Contribute to strategic vision definition
  • Conduct PoCs and evaluate tools
  • Centralize access to analytical data
QuintoAndar logo
QuintoAndar Information Technology & Services Large https://quintoandar.com.br/
1001 - 5000 Employees
See more QuintoAndar offers

Job description

About QuintoAndar

QuintoAndar was born to do something very rewarding: open doors. We opened doors for technology to be part of living. And, through it, we simplify and reduce the bureaucracy of the experience of those looking for a new home. Thus, we became the most valuable proptech in Latin America, leading the real estate market in around six countries and more than 75 cities around the globe.

The first steps in the international market have been taken since we acquired Grupo Navent, which is ranked number 1 in Mexico (Inmuebles24), Argentina (Zonaprop), Peru (Adondevivir & Urbania) and Ecuador (Plusvalia) - among others. And most recently, we launched Benvi, our international brand in Mexico, which comes with our residential rental product and service.

We offer an end-to-end ecosystem to make life easier for those looking to rent or buy a home, sell a property and unlock a transaction. Think of zero paper or bureaucracy: everything happens on a single platform, with transparency and speed alongside incredible human support.

We are currently valued at over $5.1 billion (August 2021) and continue to grow 4x year over year, breaking records.

To make all this happen, we have more than 4,000 talented people, working with cutting-edge technology and best design practices to ensure a seamless experience throughout the sales and rental process, combined with smart financial products. Here you will work with the best professionals in the market, in an environment that breathes innovation, collaboration and high performance.

To learn more about our history, visit https://quintoandar.group/en/.

About working at QuintoAndar

  • Possibility of learning;
  • Opportunity to work in a team that seeks to use the best practices and tools in the market;
  • Work in an informal environment with a horizontal structure;
  • Being part of a team working on a high-impact project that affects the lives of thousands of people.

Location & Remote Work

Our technology team works on the "remote-first" model, which means we are working from home with the possibility of living anywhere in Brazil. We also have the option of using QuintoAndar's offices in São Paulo and Campinas or using partner coworking spaces, both up to twice a week.

Stages of the Selection Process

Our selection process currently lasts an average of 30-40 days, from application to completion of the assessment. Going through:

  • Application
  • Tech Screening
  • Technicals Interviews with DPE Team
  • Phone interview with Recruiters
  • Offer

About the Position

The main goal of the data engineering team is to build and maintain data pipelines and processes to create a high-performance, self-service platform for Analytics Engineers, Data Analysts, and Data Scientists. This platform will enable them to build excellent pipelines easily, with abstractions ready for reliability, scalability, performance, security, quality, profiling, documentation, lineage, and more.

Responsibilities of a Data Platform Engineer at QuintoAndar:

  • Build and maintain a high-performance data platform that meets the company's needs, connects with product solutions, and leads analytical innovation, enabling incredible architectures and efficient platforms;
  • Responsible for the entire code development lifecycle (monitoring deployment, adding metrics and alarms, ensuring SLO budget compliance, and more);
  • Align with stakeholders to understand their primary needs, while also having a holistic view of the problem and proposing extensible, scalable, and incremental solutions;
  • Conduct PoCs and benchmarks to determine the best tool for a given problem, and decide whether to use an off-the-shelf solution or develop one in-house;
  • Contribute to defining the strategic vision, crossing team and service boundaries to solve problems.

Here are some amazing projects we've worked on:

  • We moved our entire legacy structure with transactional strategies to distributed processing environments, gaining more scale and flexibility;
  • We designed an architecture capable of storing metadata and exposing a data catalog to the entire company, thereby increasing reliability and understanding;
  • We also worked on LGPD compliance by connecting anonymization strategies, access control, and metadata management to ensure secure access and sharing;
  • We centralized access to analytical data to separate data storage from its processing, retention, and discovery.

Requirements

What we are looking for:

  • Knowledge in Big Data technologies, solutions, and concepts (Spark, Hive, MapReduce) and multiple languages (YAML, Python);
  • Proficiency in Python, or one of the main programming languages, and a passion for writing clean and maintainable code. You may even be a Software Engineer with a focus or passion for data-oriented solutions;
  • Understanding of the data lifecycle and concepts such as lineage, governance, privacy, retention, anonymization, etc.;
  • Excellent communication skills, proactively sharing and seeking context to collaborate with different teams.

You will stand out if:

  • You have participated in building large-scale data platforms for big data sets and teams using Big Data technologies such as Spark, Trino, Hive, Atlas, Ranger, etc.;
  • You have knowledge of AWS and GCP cloud resources;
  • You have experience with Apache Airflow or other tools for data workflows;
  • You have experience with columnar storage solutions and/or data lakehouse concepts;
  • You have experience with Databricks Platform resources;
  • You have knowledge in infrastructure areas such as containers and orchestration (Kubernetes, ECS), CI/CD strategies, infrastructure as code (Terraform), observability (Prometheus, Grafana), among others;
  • You understand how optimization works in various scenarios and can be improved, such as query performance, service scalability, and cluster management;
  • You are curious about rapidly evolving technologies in the data engineering domain and eager to learn and master them, bringing a significant impact to our team.

Important:

  • Our selection process starts with the application! If you are truly interested in joining our team, make sure to put in extra effort at this stage. We review all candidates individually and provide feedback even to those who do not proceed in the process;
  • All communication is done via email, so be attentive to our messages and whitelist the @quintoandar.com.br domain to prevent our emails from going to spam.

Benefits

  • Competitive salary package;
  • Bonus
  • Meal allowance ("Flash benefícios");
  • Health plan;
  • Dental plan (optional);
  • Life insurance;
  • Daycare subsidy;
  • Subsidy to sports practicing (Gympass).
  • Extended maternity and paternity leave;
  • Reserved room for breast-feeding*;
  • Discount on our parking lot;*
  • Language learning support;
  • Free transfer from Vila Madalena and Fradique Coutinho stations to the office*;
  • Free bike rack in our parking lot.*

Diversity & Inclusion at QuintoAndar

At QuintoAndar, we believe diversity of perspectives and experiences guarantee a differentiated work environment, based on respect and valuing differences. Feel free to declare the information on the registration form. If you are not comfortable answering them, just choose the option "I prefer not to respond". This information helps us create an increasingly inclusive environment and it is used only for this purpose, it is confidential, and it will not impact your performance throughout the hiring process.

Privacy and Data Protection

In order to apply for one of our jobs roles, we will need to collect some of your personal data necessary for us to review your application and to contact you. We believe that the diversity of perspectives and experiences guarantees a differentiated work environment, based on respect and appreciation of differences. For this reason, we have several affirmative jobs, and information regarding your gender, ethnicity/race, and disability may be collected in the process.

All data processed is confidential and will be stored in a secure place for the time necessary to fulfill its purposes, with appropriate technical and administrative measures being adopted to protect your information.

If you have any questions, please contact us via the following page.

#LI-MD1

Required profile

Experience

Level of experience: Mid-level (2-5 years)
Industry :
Information Technology & Services
Spoken language(s):
Check out the description to know which languages are mandatory.

Other Skills

  • Open Mindset
  • Verbal Communication Skills
  • Collaboration
  • Analytical Thinking

Data Engineer Related jobs