Senior Splunk Administrator

Valiant Solutions is seeking a Senior Splunk Engineer  to join our rapidly growing and innovative cybersecurity team!

The Splunk Engineer will design, implement, and maintain secure, reliable data ingestion pipelines and integrations across Splunk environments, supporting logs, metrics, events, and other cybersecurity data sources. This role is responsible for Splunk administration, infrastructure performance, data integrity, system upgrades, custom Technical Add-Ons, alerting, and troubleshooting across on-premises and cloud-based environments. The Engineer will collaborate closely with SOC and cross-functional teams to optimize cybersecurity tools, support access controls, resolve technical issues, and improve operational processes and documentation. The ideal candidate brings strong Splunk engineering and SPL expertise, Linux experience, and the ability to manage high-volume data pipelines while ensuring performance, security, and compliance.

Named one of the Best Places to Work in the Washington DC area for 12 consecutive years, Valiant is proud of our employee-centric culture and commitment to excellence. If you are interested in learning more about Valiant and this opportunity, we invite you to apply now!

This position allows for 100% remote work. Remote work requires a high level of trust in our employees, and we strictly adhere to the details outlined in our Remote Work Policy below. 

Required Experience

• 4 years of Information Technology Experience 
• Bachelor of Science in Computer Science, Information Systems, Mathematics, Engineering, related degree or an additional two (2) years of experience.
• 3+ years of Splunk administration or engineering experience.
• Proficiency in configuring and managing Splunk inputs, setting up data ingestion pipelines, and establishing system connections.
• Knowledge of Splunk's Search Processing Language (SPL), data parsing techniques, and the use of regular expressions for data extraction and transformation.
• Skilled in optimizing data pipelines for performance and efficiency, handling large data volumes, and implementing best practices for data integrity and consistency.

Preferred Qualifications: 

• Splunk Core Certified Consultant or Splunk Enterprise Certified Architect certification preferred.
• Splunk Enterprise or Splunk Cloud Certified Admin acceptable.
• Experience as an engineering team lead (representing the team's work to clients).
• Experience working with Splunk, syslog, syslog-ng or systems designed to collect and centralize logs.
• Experience leveraging Cribl to optimize Splunk ingest
• Experience assisting teams with Fraud Analytics
• Strong analytical and problem-solving skills, with the ability to effectively prioritize and execute tasks

Responsibilities

• Design, develop and implement processes for ingesting data from various sources into Splunk, ensuring seamless integration and minimal data loss. Processes may include HTTP Event Collector (HEC), Splunk Stream, Splunk Technical Add-Ons (TAs), Universal Forwarder (UF) Collections, custom APIs and other ingest mechanisms. 
• Configure and manage data inputs to accommodate different types of data sources, including logs, metrics, and events to determine compliance with M-26-14 requirements at the FISMA system boundary level.
• Establish and maintain secure and reliable connections between Splunk and external systems or data sources.
• Create, monitor, and maintain alerts for failed data inputs.
• Create and maintain custom Technical Add-Ons for non-standard ingest paths leveraging API connections.
• Ensure proper authentication and authorization mechanisms are in place for data transfer and system communication.
• Oversee the configuration and maintenance of Splunk infrastructure, ensuring optimal performance and security of the Splunk environment.
• Collaborate with cross-functional teams to troubleshoot and resolve issues related to Splunk functionality.
• Conduct root cause analysis for incidents and implement preventive measures.
• Utilize Linux skills to manage and maintain the underlying operating system or Cloud based containers of Splunk servers and other security applications.
• Monitor tool health and performance to identify issues, bugs, or potential improvements. 
• Develop, review, and update existing operational documentation (SOPs, Job Aids, application checklists, playbooks, etc).
• Support system access controls, including Account Management, Access Enforcement, Information Flow Enforcement, Least Privilege, and workflow for all user account requests and account recertifications.
• Collaborate with the Security Operations Center (SOC) teams for process optimization, tool tuning, tool integration, information sharing, playbook development, and incident response.
• Perform implementation, administration, operations and maintenance, optimization, & integration of cybersecurity tools, technologies, and services
• Conduct regular Splunk Enterprise upgrades for deployment servers, heavy forwarders, and syslog servers.

About Valiant Solutions

Valiant Solutions is a security-focused IT solutions provider with public clients nationwide. Named one of the fastest growing privately held companies by Inc. 5000, Washington Technology’s Fast 50, and Washington Business Journal’s Best Places to Work in the D.C. area, Valiant Solutions prides itself on providing its employees with great benefits and career development opportunities. As a company, we are just as committed to growing careers as we are to building world-class IT solutions, all while enjoying an unparalleled work-life balance. We are in a phase of tremendous growth and building the team that will take us to the next level. We seek people whose talents and accomplishments will contribute to a thriving company, who have the character to support their capacity, and can make a positive impact on our culture. Alongside our talented team, you’ll learn to think quickly on your feet and expand your own personal and professional skill set. Our management team will inspire you to consider new perspectives and challenge you to become a better practitioner in the fast-paced industry of IT security. We hire people we respect – and we trust them to deliver results leveraging their expertise. If you would enjoy working in a dynamic environment as part of a stellar team of professionals, then we invite you to apply online today.

Benefits Snapshot (includes, but not limited to)
Valiant pays 99% of the Medical, Dental, and Vision Coverage for Full-time Employees
Valiant contributes 25% towards Health Coverage for Family and Dependents
100% Paid Short Term Disability and Life Insurance Policy for Full-time Employees
100% Paid Certifications
401K Matching up to 4%
Paid Time Off
Paid Federal Holidays
Wellness & Fitness Program
Valiant University – Online Education and Training Portal
FSA programs for: Medical Costs, Dependent Care, Transit, and Parking
Referral Bonuses

The salary range for this position is a general guideline and not a guarantee of compensation or salary. It has been benchmarked in relation to the scope of the role, market rate, and internal equity. The salary for this role is expected to be in the $140,000 - $170,000 range. Where a candidate falls within the band can be determined based on one or more of the following: skillset, experience level, achievements, education, geographic location, security clearance, involvement in corporate tasks, and other non-discriminatory factors. In addition to the base salary, this role will include benefits as described above.  Valiant reserves the right to adjust the salary range, experience requirements, and position responsibilities at any time without prior notice.

Remote Work Policy 

Remote work necessitates a high level of trust in our employees. To ensure that employee performance does not suffer in a remote work environment, all employees who telecommute are expected to have a quiet and distraction-free workspace with adequate internet, dedicate their full attention and availability to their job duties during working hours, and maintain a schedule during core business hours that align with those of their coworkers and Valiant's clients. In alignment with Valiant's inclusive and engaging environment, cameras are encouraged and can be required to be on during virtual video conferences. Additionally, in alignment with the Office of the Inspector General’s effort to eliminate conflicting employment, all Valiant employees are required to disclose any current or future outside employment engagements. During onboarding and throughout employment, employees must disclose any current activities or intent to engage in outside employment or other professional activities and obtain written approval.  Employees may not solicit or conduct any outside business during core business hours for Valiant Solutions and our clients.

Equal Employment Opportunity

Valiant Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, disability, genetic information, marital status, or veteran status, in accordance with applicable law.

Physical Demands

Sitting or standing at a desk for prolonged periods of time and consistent operation of a computer. Frequent communication and exchanging of accurate information via electronic communication, phones, and in person. Occasionally lift and/or move moderate amounts of weight, typically less than 20 pounds. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions of the job.

Authorization to Share Resume and Personal Information

By submitting your resume for this position, you authorize Valiant Solutions to share your resume, as well as, personal information included on the resume, with its subsidiaries, affiliates and teaming partners for the purpose of considering you for this position and other available positions requiring comparable skills, education and experience. Should Valiant Solutions or its affiliates and teaming partners wish to initiate pre-employment discussions, you will be asked to complete an employment application and related employment documents.