Director, Data Engineering

Role Summary

The Director, Data Engineering leads the design, development, and deployment of scalable and secure data pipelines, platforms, and ML/AI infrastructure, leveraging cloud-native technologies and big data frameworks.

This role oversees the integration of structured and unstructured data sources to support advanced analytics, machine learning, and AI initiatives, and champions new tools and technologies to improve productivity, scalability, and effectiveness of data engineering efforts.

The Director establishes and enforces data engineering best practices, technical standards, governance, and quality standards, ensuring continuous improvement and technical excellence, while ensuring data security, privacy, compliance, system performance, scalability, and availability across all data engineering projects and platforms.

All roles require digital fluency, including the ability to work with emerging technologies such as Generative AI tools (e.g. ChatGPT, Microsoft Copilot) to support everyday work.

Key Responsibilities

• Lead the design, development, and deployment of scalable and secure data pipelines, platforms, and ML/AI infrastructure.
• Oversee integration of structured and unstructured data sources to support advanced analytics, machine learning, and AI initiatives.
• Evaluate, implement, and champion new tools and technologies to improve productivity, scalability, and effectiveness of data engineering efforts.
• Establish and enforce data engineering best practices, technical standards, governance, and quality standards.
• Ensure data security, privacy, compliance, system performance, scalability, and availability across all data engineering projects and platforms.
• Define, monitor, and report on key performance indicators (KPIs) to measure the success and impact of data engineering activities.
• Lead incident response, root cause analysis, and resolution for data platform issues, ensuring high availability and reliability.
• Collaborate with cross-functional teams to deliver robust data-driven business solutions and define technical roadmaps.
• Mentor, coach, and grow a high-performing team of data engineers, fostering a culture of innovation, excellence, and continuous learning.
• Partner with senior leadership to define, execute, and communicate the enterprise data strategy.

Visa requires at least 3 days in office, expectations of these days will be confirmed by your Hiring Manager.

Basic Qualifications

• 10+ years of relevant work experience with a bachelor’s degree, or 13+ years of relevant work experience.

Preferred Qualifications

• 12 or more years of work experience with a Bachelor’s Degree or 8-10 years of experience with an Advanced Degree(e.g. Masters, MBA, JD, MD) or 6+ years of work experience with a PhD.
• Experience in leading large-scale data engineering teams and projects in a complex enterprise environment.
• Experience in data architecture, ETL/ELT pipelines, data warehousing, and real-time data processing.
• Experience with big data technologies (e.g., Spark, Kafka, Hadoop).
• Experience in data modeling, data governance, and data quality frameworks.
• Experience delivering high-impact data solutions that drive business outcomes.
• Experience working with Data and AI, designing, and building ML infrastructure to train or serve models.
• Experience with open-source data engineering tools or communities.
• Hands – on development experience in building real time & streaming infrastructure and DevOps excellence.
• Distributed Streaming Platforms: Advanced architectural experience with large-scale event-driven systems using Apache Kafka, Apache Pulsar, AWS Kinesis, or Google Cloud Pub/Sub.
• Stream Processing Engine Architecture: Hands-on mastery or architectural oversight of real-time processing frameworks like Apache Flink, Apache Spark Streaming, Kafka Streams, and Ray.
• Data Storage & Query Engines: Deep knowledge of low-latency storage systems, column-oriented databases, and OLAP query engines (e.g., Apache Pinot, Apache Iceberg, ClickHouse, Cassandra, Redis).
• Multi-Tenant System Design: Experience building multi-tenant streaming platforms with strong isolation, rate limiting, dynamic resource allocation, and zero-downtime schema evolution (Protobuf, Avro).
• Observability & Reliability: Demonstrated success implementing SLOs, SLAs, error budgets, and high-cardinality distributed tracing and monitoring systems (e.g., Prometheus, Grafana, Datadog, OpenTelemetry).
• Excellent problem solving and analytics skills. Capable of forming and advocating an independent viewpoint
• Foster a GenAI-first culture by empowering engineers to seamlessly integrate generative AI into daily workflows, turning technological potential into scalable, transformative business.
• Experience in financial services, payments, or a highly regulated industry.
• Experience in mentoring and developing talent within engineering teams.
• Masters, PhD in Computer Science or related technical discipline.
• Experience in working on large open-source projects, preferably with ClickHouse, Redis, Flink, Kafka, and Ray.
• Experience in contributions to open-source data engineering tools or communities.
• Experience in driving operational excellence and standard methodologies in an engineering environment.
• Experience in working with Data and AI, designing, and building ML infrastructure to train or serve models.

Pay and benefits

For roles located in the US, the estimated salary range for this position is $197,200.00 to $ 315,700.00 USD per year, which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge, skills, experience, and location. In addition, this position may be eligible for bonus and equity.Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401(k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program.

Work Hours

Varies upon the needs of the department.

Travel Requirements

This position requires travel 5-10% of the time.

Mental/Physical Requirements

This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers.