Lead Software Engineer - Event Streaming

Overview:

DDN Storage is a leading global provider of data storage and data management solutions at scale. We accelerate AI and High Performance Computing workflows and applications in data centers, private and public clouds, and at the edge. Thanks to our technology, over 11,000 customers realize significant efficiencies in their GPU and CPU compute farms, substantially reducing their data center power consumption and footprint. Utilizing highly optimized flash technology and AI-enabled software, our products power some of the largest and most demanding customers in the world in fields such as autonomous driving, AI chatbots, healthcare, financial services, manufacturing, energy, government, public sector, and research institutions, as well as generative AI and data analytics applications.

We are looking for a Lead Software Engineer for our RED Storage engineering team who will design, build, and deliver components of RED software storage solution:

• Design and implement lightweight publisher/subscriber event streaming broker architecture, integrating with complex highly resilient underlying distributed storage.
• Drive design discussions, build prototypes and contribute to deliver high quality products.
• Conduct code reviews and improve scalability, reliability and performance of RED solutions.
• Collaborate with your teammates and integrate a group of passionate developers in an outcome-oriented environment.

 Qualifications:

• Prior experience with architecture and implementation of AI-based rules engines to facilitate data movement and transformation.
• Experience with architecture and implementation of lightweight pub/sub event streaming technologies (ex. Apache Kafka, Mosquitto)
• Knowledge of distributed file system solutions, parallel file system solutions or network file system is important.
• Knowledge of various traditional data movement technologies including asynchronous replication, synchronous replication, and tiering
• Experience in developing and debugging at system level C/C++, particularly for Linux/UNIX computing environments.
• Excellent hands-on software development experience of 10+ years on scale-out and high availability storage solutions
• NVM storage technology and/or distributed key-value storage systems are highly desired.
• BS/MS/Ph.D in Computer Science, Computer Engineering, Statistics, Mathematics or equivalent degree/experience.
• Attention to detail and commitment to high quality deliverables.
• Strong team player with good communication skills and should be self-starter.
• Excellent time management skills, with the ability to independently prioritize, multitask, and work under deadlines in a fast-paced environment.

The ideal candidate has knowledge of and experience in several of the following subjects:

• Common Hierarchical Storage Management techniques including tiering as well as efficient data movement techniques from edge to core to cloud.
• Parallel file system solutions (ex. Lustre, GPFS) or distributed file systems (ex. NFS)
• Low-latency, high-bandwidth High-Performance Computing (HPC) networks
• NVME and NVMEoF storage technology
• Linux kernel internals
• Memory mapped IO (mmap), event-driven and lock-free programming concepts
• Distributed key-value storage systems (memcached)

DDN has a very strong orientation towards these 4 characteristics and any successful employee will demonstrate these capabilities: 

Self-Starter - Takes independent action to identify and solve problems. Seeks out relevant information needed to make decisions. Gets involved with new initiatives. 

Success/Achievement Orientation - Delivers quality results consistently. Targets, achieves (or exceeds) measurable results. Sets challenging goals, focuses on critical priorities, and is accountable. 

Problem Solving - Recognizes problems and responds with a systematic assessment that identifies and addresses cause of issue. Practical, realistic, and resourceful. 

Innovative - Builds and improves key business processes that enhance the effectiveness of DDN. Generates new ideas, challenges the status quo, and solves problems creatively.

DataDirect Networks, Inc. is an Equal Opportunity/Affirmative Action employer.  All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity, gender expression, transgender, sex stereotyping, sexual orientation, national origin, disability, protected Veteran Status, or any other characteristic protected by applicable federal, state, or local law.