Experienced Lead Data Engineer – Cybersecurity Data Science & Enterprise Pipeline Development (Remote/Hybrid Position)

About Arenaflex

At Arenaflex, we believe that great data has the power to transform industries and protect what matters most. As a forward-thinking organization in the financial services sector, we're redefining how enterprises approach data engineering, security, and innovation. Our mission is to build robust data infrastructure that not only powers business insights but also safeguards sensitive information against evolving cyber threats. We're looking for a talented Lead Data Engineer to join our Cybersecurity Data Science team and help architect the next generation of intelligent data pipelines that keep our organization and our clients secure.

Our culture at Arenaflex is built on a foundation of diversity, equity, and inclusion. We know that the best solutions emerge when diverse perspectives come together. Every team member is valued, heard, and empowered to contribute their unique ideas and expertise. We foster an environment where innovation thrives, professional growth is supported, and employees can truly make an impact. If you're ready to be part of a dynamic team that's shaping the future of data security and engineering, we invite you to explore this opportunity.

Position Overview

We are currently seeking an experienced Lead Data Engineer to join our Cybersecurity Data Science organization. This is a pivotal role where you will lead the design, development, and optimization of sophisticated data pipelines that support multiple cybersecurity use cases across the enterprise. You will serve as a technical authority and subject matter expert, guiding teams through complex data engineering challenges while ensuring compliance, scalability, and performance.

This position offers a hybrid work schedule, providing flexibility while maintaining collaborative connections with your team. You'll work alongside talented engineers, data scientists, and security professionals to deliver solutions that make a measurable difference in our organization's security posture. The ideal candidate thrives in complex environments, possesses deep expertise in data pipeline architecture, and is passionate about leveraging technology to solve real-world security challenges.

Key Responsibilities

As a Lead Data Engineer at Arenaflex, you will be responsible for the following:

• Pipeline Architecture and Development: Design, develop, and maintain scalable data pipelines using industry-leading technologies such as Airflow, Python, and Spark. Create robust and efficient data processing workflows that handle large-scale datasets while maintaining high quality and reliability standards.
• Technical Leadership: Lead complex projects with significant business impact and serve as a key player in large-scale program planning for the Technology division. Mentor junior engineers, provide technical guidance, and ensure best practices are followed throughout the development lifecycle.
• Problem Solving and Tooling: Design, develop, and run tooling to identify troubles in data and systems. Document findings and communicate technical issues to engineering and product leadership, recommending effective solutions that align with business objectives.
• Code and Architecture Review: Review and analyze complicated software development projects for business, operational, or technical enhancements. Assess multiple factors including intangibles and extraordinary elements to ensure solutions meet quality, security, and compliance standards.
• Decision Making in Complex Environments: Make strategic decisions in multifaceted data engineering contexts requiring expertise in software package alternatives, programming languages, and compliance requirements. Drive Technology to meet deliverables and organizational goals.
• Cross-Functional Collaboration: Strategically collaborate and communicate with internal partners to resolve highly volatile data engineering challenges. Work closely with security teams, data scientists, and business stakeholders to deliver integrated solutions.
• Compliance and Governance: Ensure all data pipelines adhere to regulatory requirements and organizational governance frameworks. Implement data quality controls, monitoring, and audit trails as required.
• Innovation and Optimization: Continuously evaluate emerging technologies and methodologies to improve pipeline performance, reduce costs, and enhance capabilities. Lead innovation initiatives that advance the team's technical capabilities.

Required Qualifications

To be considered for this position, candidates must meet the following minimum qualifications:

• Database Engineering Experience: A minimum of 3+ years of Database Engineering experience, or equivalent demonstrated through a combination of work experience, training, military experience, or education. Practical experience with database design, optimization, and management is essential.
• Programming Expertise: At least 2+ years of experience with programming languages including Spark, Python, or PySpark. Strong coding skills and the ability to write efficient, maintainable code are required.
• Technical Problem-Solving: Demonstrated ability to analyze complex technical problems and develop effective solutions. Experience with troubleshooting data pipeline issues and optimizing performance.
• Communication Skills: Excellent written and verbal communication skills. Ability to articulate technical concepts to both technical and non-technical stakeholders.
• Collaboration: Proven ability to work effectively in team environments and collaborate across functional boundaries.

Desired Qualifications

While not required, the following qualifications are highly preferred and will strengthen your application:

• Information Security Domain Knowledge: Strong understanding of Information Security domains including Data Loss Prevention (DLP), Identity and Access Management (IAM), and vulnerability management. Experience applying security principles to data engineering is highly valued.
• Advanced Airflow Experience: Experience implementing and supporting complicated Airflow Directed Acyclic Graphs (DAGs). Knowledge of workflow orchestration best practices and optimization techniques.
• Data Format Expertise: Experience working with various data codecs including YAML, JSON, Parquet, and XML. Understanding of data serialization and storage optimization strategies.
• Security Dataset Experience: Experience working directly with cybersecurity datasets, metrics, and reporting. Familiarity with security information and event management (SIEM) data is a plus.
• Distributed Computing Platforms: Hands-on experience with on-premise Hadoop distributions such as Cloudera, Hortonworks, or MapR, as well as public cloud offerings including GCP, AWS, or Azure. Knowledge of cloud-native data services and architectures.
• Cluster Technology Expertise: Strong understanding of cluster technology and clustered services. Experience with distributed computing environments and cluster management.

Essential Skills and Competencies

Success in this role requires a combination of technical expertise and professional competencies:

• Data Pipeline Development: Proficiency in building and maintaining data pipelines using modern data engineering tools and frameworks. Experience with batch and streaming data processing.
• Programming Languages: Strong skills in Python, Spark, and related data engineering languages. Ability to write efficient, scalable, and maintainable code.
• Cloud and Distributed Systems: Knowledge of cloud platforms and distributed computing architectures. Understanding of scalability, fault tolerance, and high availability principles.
• Data Governance: Familiarity with data governance practices, regulatory compliance requirements, and data quality management. Commitment to maintaining data integrity and security.
• Analytical Thinking: Strong analytical and problem-solving abilities. Capacity to approach complex challenges systematically and develop innovative solutions.
• Project Management: Experience leading technical projects from conception to completion. Ability to manage priorities, meet deadlines, and deliver results.
• Adaptability: Ability to thrive in dynamic environments and adapt to evolving requirements. Comfortable working with ambiguous requirements and changing priorities.

Career Growth and Development Opportunities

At Arenaflex, we are committed to the professional development and career growth of our team members. As a Lead Data Engineer, you will have access to numerous opportunities to advance your career:

• Technical Leadership Paths: Progress into senior technical leadership roles or specialize as a principal engineer or architect within the data engineering domain.
• Cross-Functional Exposure: Work with teams across security, data science, product, and business domains, broadening your expertise and understanding of enterprise operations.
• Professional Development Programs: Access comprehensive training programs, certifications, and professional development initiatives. We support continuous learning and skill advancement.
• Mentorship Opportunities: Participate in mentorship programs, both as a mentor and mentee, sharing knowledge and learning from experienced professionals across the organization.
• Industry Recognition: Opportunity to contribute to industry conferences, publications, and thought leadership, establishing yourself as a recognized expert in your field.
• Advanced Technology Access: Work with cutting-edge technologies and platforms, staying at the forefront of data engineering innovation.

Work Environment and Culture

Arenaflex offers a dynamic and supportive work environment that values both professional excellence and personal well-being:

• Hybrid Work Flexibility: Our hybrid work schedule provides the best of both worlds – the ability to collaborate in-person with team members while enjoying the flexibility of remote work. We trust our employees to manage their schedules effectively.
• Inclusive Culture: We are dedicated to fostering an inclusive workplace where diversity is celebrated, and all employees feel valued and respected. Our diversity, equity, and inclusion initiatives ensure everyone has an equal opportunity to succeed.
• Work-Life Balance: We recognize the importance of balancing professional commitments with personal life. Our policies support flexible scheduling, generous time off, and wellness programs.
• Collaborative Teams: Work alongside passionate, talented professionals who are committed to excellence and innovation. Our team-oriented culture encourages knowledge sharing and mutual support.
• Modern Tools and Technologies: Gain access to state-of-the-art tools, technologies, and resources needed to excel in your role. We invest in our employees' success by providing the best available resources.
• Community Engagement: Participate in community engagement initiatives and corporate social responsibility programs that make a positive impact beyond the workplace.

Compensation and Benefits

We offer a competitive compensation package designed to recognize and reward exceptional talent:

• Competitive Salary: The annual compensation for this position reflects the value of your experience and expertise. We regularly review and adjust salaries to ensure competitiveness in the market.
• Performance Bonuses: Eligible for performance-based bonuses that recognize individual and organizational achievements.
• Comprehensive Benefits: Enjoy a comprehensive benefits package including health, dental, and vision insurance, retirement plans, and life insurance.
• Paid Time Off: Generous paid time off policies including vacation days, sick leave, and holidays.
• Retirement Plans: Access to retirement savings plans with employer contributions to support your long-term financial goals.
• Professional Development: Support for professional development activities including training programs, certifications, and conference attendance.
• Wellness Programs: Access to wellness resources and programs that support physical, mental, and emotional well-being.
• Employee Assistance Program: Confidential support services for personal and professional challenges.

Application and Next Steps

We invite you to apply for this exciting opportunity to join Arenaflex as a Lead Data Engineer. If you have the required expertise and are passionate about data engineering and cybersecurity, we want to hear from you.

To apply, please submit your resume and cover letter through our online career portal. Our recruiting team will review applications and contact qualified candidates for next steps. We encourage you to showcase your technical expertise, project experience, and passion for data engineering in your application.

Join Arenaflex and become part of a team that's making a meaningful impact in data security and engineering. Your skills and contributions will help protect our organization and our clients while advancing your career in a supportive and innovative environment. We look forward to receiving your application!

Note: This position offers a hybrid work schedule. This role is not eligible for Visa sponsorship. Relocation assistance is not available for this position.