Lead Data Engineer – arenaflex Big Data & Cloud Solutions – $24/hr – Full‑Time – San Francisco

About arenaflex – Pioneering Data‑Driven Experiences

arenaflex is a global leader in entertainment‑focused digital platforms, delivering immersive experiences to millions of users every day. Our mission is to turn data into actionable insight, powering everything from content recommendation engines to real‑time analytics dashboards. As part of our rapidly expanding Information and Investigation group, we are building the next generation of data infrastructure that supports innovative products across web, mobile, and emerging media channels. If you thrive in a fast‑paced environment where big data meets creative storytelling, arenaflex is the place to amplify your impact.

Role Overview – Lead Data Engineer (Full‑Time)

We are seeking a highly motivated Lead Data Engineer to join arenaflex’s Commitment and Maintenance Information Designing team. In this role you will architect, develop, and maintain large‑scale data solutions that enable our analytics, product, and research teams to extract maximum value from massive data sets. You will work closely with data product owners, data modelers, and cloud architects to design robust data pipelines, data warehouses, and analytical platforms that meet stringent performance, reliability, and security standards.

Key Responsibilities

• Design and implement end‑to‑end data pipelines in large‑scale environments (cloud, on‑premise, hybrid) to ingest, transform, and store petabytes of structured and unstructured data.
• Collaborate with Data Product Managers and Data Architects to translate business requirements into scalable data models and warehouse schemas.
• Develop and maintain ETL/ELT processes using technologies such as Hadoop, Spark, AWS Glue, Snowflake, and Redshift.
• Write clean, production‑ready code in Python, Scala, and Java, adhering to best practices for version control, testing, and documentation.
• Optimize SQL queries and data warehouse performance to ensure sub‑second response times for critical analytics workloads.
• Implement data quality frameworks, monitoring, and alerting to guarantee data integrity and compliance with SLAs.
• Lead technical design reviews, mentor junior engineers, and champion agile (Scrum) development practices within the team.
• Document architecture decisions, data lineage, and operational procedures to support knowledge sharing across arenaflex.
• Stay current with emerging big‑data technologies and recommend strategic enhancements to our data platform roadmap.

Essential Qualifications

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related technical field.
• Minimum 5 years of hands‑on experience designing and building data pipelines in large‑scale environments.
• Proven expertise with SQL and the ability to craft performant queries against massive data sets.
• Deep familiarity with Hadoop ecosystem components (HDFS, Hive, Impala, PySpark) and modern data processing frameworks.
• Strong programming skills in Python and either Java or Scala.
• Experience with at least one major MPP or cloud data warehouse technology (e.g., Snowflake, Amazon Redshift, Google BigQuery).
• Hands‑on experience building and maintaining data pipelines using tools such as Apache Airflow, AWS Data Pipeline, or similar orchestration platforms.
• Solid understanding of data modeling principles, dimensional modeling, and data lake architecture.
• Demonstrated ability to work in an agile Scrum environment, delivering incremental value in two‑week sprints.

Preferred Qualifications & Additional Skills

• Master’s degree or advanced certifications in data engineering, cloud architecture, or big data technologies.
• Practical experience with streaming platforms such as Apache Kafka, AWS Kinesis, or Flink for real‑time data ingestion.
• Knowledge of data governance, security, and compliance frameworks (e.g., GDPR, CCPA).
• Familiarity with containerization (Docker, Kubernetes) and infrastructure‑as‑code tools (Terraform, CloudFormation).
• Experience mentoring cross‑functional teams and leading technical initiatives in a matrixed organization.
• Strong problem‑solving mindset, excellent communication skills, and the ability to translate complex technical concepts into business‑friendly language.

Core Skills & Competencies

• Analytical Thinking: Ability to dissect complex data challenges and devise elegant, scalable solutions.
• Collaboration: Comfortable partnering with product, analytics, and engineering stakeholders to drive shared outcomes.
• Leadership: Proven track record of guiding teams through technical decisions, code reviews, and best‑practice adoption.
• Adaptability: Thrive in a fast‑changing environment, quickly learning new tools and technologies as the data landscape evolves.
• Attention to Detail: Meticulous documentation and rigorous testing to ensure data reliability and compliance.

Compensation, Benefits & Perks

arenaflex offers a competitive hourly rate of $24 per hour, complemented by a comprehensive benefits package that includes:

• Health, dental, and vision insurance with generous employer contributions.
• 401(k) retirement plan with company match.
• Paid time off, holidays, and flexible work‑hours to support work‑life balance.
• Professional development stipend for certifications, conferences, and online courses.
• Access to cutting‑edge cloud resources and a collaborative engineering environment.
• Employee assistance programs, wellness initiatives, and on‑site amenities (snacks, fitness spaces, etc.).

Career Growth & Learning Opportunities

At arenaflex, your career trajectory is shaped by your ambition. As a Lead Data Engineer you will:

• Gain exposure to industry‑leading big‑data platforms and cloud services used by millions of users worldwide.
• Lead cross‑functional projects that directly influence product strategy and revenue growth.
• Mentor junior engineers, fostering a culture of continuous learning and technical excellence.
• Participate in internal hackathons, data‑science challenges, and innovation labs.
• Potentially advance to senior architecture or data‑platform leadership roles as the organization scales.

Work Environment & Culture at arenaflex

Our San Francisco office is a vibrant hub where creativity meets technology. The culture at arenaflex is built on:

• Innovation: We encourage experimentation and reward ideas that push the boundaries of data‑driven entertainment.
• Inclusivity: A diverse workforce where every voice is heard and respected.
• Collaboration: Open‑plan spaces, regular knowledge‑sharing sessions, and cross‑team initiatives foster a strong sense of community.
• Agility: Scrum ceremonies, rapid prototyping, and iterative delivery keep us responsive to market demands.
• Impact: Your work directly powers experiences enjoyed by millions, giving you a clear line of sight to the results of your efforts.

Why Join arenaflex?

If you are passionate about turning massive data sets into strategic assets, love solving complex engineering puzzles, and want to be part of a forward‑thinking organization that values both technical mastery and creative storytelling, arenaflex is the perfect place for you. We empower our engineers to own end‑to‑end solutions, provide the resources needed for continuous growth, and celebrate successes together.

Ready to Make an Impact?

Take the next step in your data engineering career and help shape the future of digital entertainment at arenaflex. Apply now and become a key contributor to our data‑driven vision.