Analytics Engineer

LightFeather is seeking an Analytics Engineer with expertise in Airflow to join our team and play a key role in transforming raw data into actionable insights. In this role, you will design, implement, and maintain robust data pipelines that enable data-driven decision-making across the organization. You will collaborate closely with data scientists, analysts, and engineers to ensure the availability, reliability, and scalability of our data infrastructure.

This is a Full Time, Remote Position.

Responsibilities:

• Architect, build, and maintain scalable and efficient data pipelines using Apache Airflow to orchestrate workflows and automate complex processes.
• Partner with cross-functional teams to gather and analyze business requirements, translating them into technical specifications and scalable solutions.
• Develop and implement rigorous testing, validation, and monitoring strategies to ensure data quality, accuracy, and integrity throughout the pipeline.
• Optimize data workflows for enhanced performance, scalability, and cost-effectiveness, leveraging Airflow and related technologies.
• Proactively monitor and troubleshoot Airflow DAGs, identifying and resolving issues to minimize downtime and ensure seamless data operations.
• Establish and enforce best practices for ETL/ELT development, workflow orchestration, and data pipeline architecture.
• Continuously research and integrate the latest advancements in Airflow, workflow management, and data engineering technologies to improve existing systems.
• Create and maintain comprehensive documentation for all data pipelines, workflows, and configurations to facilitate knowledge sharing and system maintenance.

Required Qualifications and Skills:

• US Citizenship.
• Active clearance at the Public Trust level or above. IRS is preferred.
• Bachelor’s degree in Computer Science, Data Engineering, or a related field.
• Minimum of 5 years experience as an Analytics Engineer, Data Engineer, or a similar role.
• Expertise in Apache Airflow, including creating and managing complex DAGs.
• Strong proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL, Snowflake).
• Experience with data warehousing concepts and technologies.
• Proficiency in at least one programming language (e.g., Python, Java, Scala).
• Familiarity with cloud platforms (AWS, GCP, Azure) and related data services.
• Excellent problem-solving skills and attention to detail.
• Strong communication skills and ability to work collaboratively in a team environment.

Preferred:

• Experience with big data tools and frameworks (e.g., Spark, Kafka).
• Knowledge of data visualization tools (e.g., Tableau, Power BI, Looker).
• Familiarity with version control systems like Git.
• Experience with CI/CD pipelines for data workflows.

Why Join LightFeather?
You'll be part of a team dedicated to meaningful impact, working on solutions that address mission-critical needs. Experience variety, fulfillment, and the opportunity to work with some of the best in the industry. We are committed to fostering a diverse and inclusive environment where everyone is valued and respected.

Commitment to Diversity
LightFeather is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees, regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, veteran, or disability status.