Data Engineer - Data Infrastructure & eDiscovery-6387

About the role

Data Engineer - Data Infrastructure & eDiscovery itD is seeking an experienced Data Engineer to build, enhance, and maintain high-complexity data pipelines, data warehousing infrastructure, and monitoring and alerting systems supporting its Legal and eDiscovery team.

The ideal candidate will bring deep expertise in SQL, Python, ETL pipeline development, and workflow orchestration, with a proven track record of leading end-to-end data engineering initiatives across cross-functional teams. This individual will help deliver scalable, reliable, and secure data infrastructure while partnering with technical and non-technical stakeholders, including attorneys and Data Scientists.

Location: Remote - California. Candidates located in or near the San Francisco Bay Area are preferred. Candidates must indicate their willingness to occasionally work onsite in San Francisco.

Duration: 6 months

We provide comprehensive medical benefits, a 401(k) plan, paid holidays, and more.

Please note that we are only considering direct W2 candidates at this time, as we are unable to offer sponsorship.

Responsibilities

• Design, develop, and maintain complex ETL pipelines to support large-scale data extraction, transformation, and processing across enterprise data environments.
• Build and enhance scalable data warehousing solutions, ensuring efficient querying and management of massive datasets.
• Lead end-to-end development of high-complexity monitoring, alerting, and data pipeline systems to proactively identify and prevent infrastructure issues.
• Develop and optimize advanced SQL queries using technologies such as Presto, PostgreSQL, and MySQL.
• Collaborate with attorneys, Data Scientists, and cross-functional technical teams to understand data requirements, identify relevant data sources, and deliver reliable data solutions.
• Lead cross-functional engineering initiatives by defining project plans, coordinating stakeholders, preparing technical documentation, and driving successful implementation.
• Identify opportunities to leverage AI and automation to streamline workflows, improve operational efficiency, and support non-technical stakeholders while maintaining strong privacy and security standards.

Internal Responsibilities

• Attend regular internal practice community meetings.
• Collaborate with your itD practice team on industry thought leadership.
• Complete client case studies and learning material (blogs, media material).
• Build out material to contribute to the Digital Transformation practice.
• Attend internal itD networking events (in person and virtual).
• Work with leadership on career fast-track opportunities.

Required Qualifications and Skills

• 3+ years of professional experience in Data Engineering.
• Expert-level proficiency in SQL, including experience with relational databases such as Presto, PostgreSQL, or MySQL.
• Expert-level proficiency in Python.
• Expert-level experience building, managing, and optimizing ETL/data pipelines.
• Expert-level proficiency with workflow orchestration and data pipeline tools such as Apache Airflow or similar technologies.
• Demonstrated experience leading end-to-end data engineering initiatives involving large, cross-functional teams and diverse technical and non-technical stakeholders.
• Strong written and verbal communication skills, with the ability to communicate complex technical concepts clearly and concisely.
• Experience navigating ambiguous requirements and independently driving technical projects to completion.

Preferred Qualifications and Skills

• Demonstrated experience leveraging AI to accelerate project delivery or developing AI-powered solutions to automate workflows for non-technical stakeholders.
• Experience working in highly regulated industries, including legal, compliance, finance, security, or privacy.
• Previous experience supporting legal technology, eDiscovery, data privacy, or compliance-related initiatives.
• Experience with data loss prevention and remediation.
• Experience mentoring and supporting junior engineering team members.
• Previous experience working in startups, small-to-mid-sized organizations, or environments requiring adaptability and broad ownership.
• Experience working with attorneys, legal teams, or law firms through professional, internship, or volunteer experience.

Education

Bachelor's degree in a relevant field or equivalent work experience required.

Additional Info

Dynamic environment in a culture of respect, empowerment and recognition for a job well done, apply today!