Match score not available

Databricks Engineer

extra holidays - extra parental leave

Remote:

Full Remote

Contract:

Full time

Work from:

Texas (USA), Virginia (USA), United States

Offer summary

Qualifications:

Experience in developing ETL pipelines with Apache Spark, Proficiency in SQL and/or Spark SQL, Familiarity with Agile methodologies.

Key responsabilities:

Design, build, and maintain automated data pipelines
Support critical data pipelines with scalable architecture
Deploy, automate, and manage cloud-based production system
Conduct full technical discovery and design scalable big data ecosystems
Perform data querying and analysis tasks

Acuity, Inc. Information Technology & Services SME https://myacuity.com/

201 - 500 Employees

See more Acuity, Inc. offers

Job description

Overview:

Acuity is looking for a Data Engineer to join our Engineering Team. In this position, you will apply your skills in data science, data analytics, and data warehousing to pioneer cloud and data services with our clients. You will use cloud and data technologies to deliver exciting IT & data driven capabilities.

Why Acuity?: Are you ready to use your expertise in the areas of IT Modernization, Data Enablement, and Hyperautomation to make a real difference? Join Acuity, Inc., a technology consulting firm that supports federal agencies. We combine industry partnerships and long-term federal experience with innovative technical leadership to support our customers’ critical missions. Responsibilities:

Engineer, build and maintain scalable automated data pipelines. Support critical data pipelines with a highly scalable distributed architecture - including data ingestion (streaming, events and batch), data integration, data curation.
Build cloud data solutions and provide domain perspective on storage, big data platform services, serverless architecture, RDBMS, DW/DM, NoSQL databases and security.
Deploy, automate, maintain and manage cloud-based production system, to ensure the availability, performance, scalability and security of productions systems.
Conduct full technical discovery, identifying pain points, business and technical requirements, “as is” and “to be” scenarios.
Design and arrangement of scalable, highly attainable, and fault tolerant big data eco systems on cloud platform.
Ownership and responsibility for end-to-end design and development, testing, release of key components data lake solution using DataBricks.
Understand and implement best practices in management of data, including master data, reference data, metadata, data quality and lineage.
Support regular ad-hoc data querying and analysis to understand customer behaviors.

Qualifications:

Experience with developing and deploying ETL pipelines using Apache Spark
Experience with distributed computing, such as Apache Spark and/or Databricks
Experience in SQL and/or Spark SQL
Experience with code versioning tools and a command of configuration management concepts and tools, CI/CD including DevOps.
Experience working with Software Development Life Cycle (SDLC), Agile methodologies (Scrum)
BA or BS degree in CS, Information Systems, Information Systems

Clearance Requirement:

Must be US Citizen with an ability to obtain and maintain US Suitability

About Acuity:

Acuity, Inc. is a leading management and technology consulting firm that specializes in serving the federal government. Our innovative, collaborative and rewarding work environment has earned repeat honors from the Washington Business Journal’s Best Places to Work and SmartCEO Corporate Culture awards.

Why Choose Acuity?

Innovative Excellence: Recognized by The Washington Post's "Top Workplaces" and a nine-time recipient of the Washington Business Journal's "Best Places to Work," Acuity fosters an environment where innovation thrives and employees flourish.
Competitive Compensation: We value our employees and show it through highly competitive compensation and benefits packages.
Personal Growth: Your potential isn't just recognized at Acuity, it's actively cultivated. With tailored training, mentorship, and cutting-edge resources, we empower you to thrive personally and professionally.
Recognition and Visibility: Stand out in a competitive industry with Acuity's exceptional customer feedback and robust opportunity channels.
Collaborative Culture: At Acuity, teamwork isn't just a buzzword – it's the cornerstone of our success. Encouragement and support fuel our collaborative culture, where every voice matters.
Diversity and Inclusion: Diversity isn't just a checkbox – it's who we are. At Acuity, we pride ourselves on recruiting and maintaining a workforce that celebrates diversity and treats every employee with dignity and respect.

Join Acuity, where your talents are valued, your growth is nurtured, and your impact is amplified. Together, let's shape the future of digital strategy and technology consulting.

We are an equal employment opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, national origin, disability status, protected veteran status or any other characteristic protected by law.

#LI-PA1

#LI-Remote