Principal Data Engineer
- Location
- Milpitas, CA · On-site
- Job type
- Full-time
- Level
- Director
- Experience
- 5+ years
- Listed
- 30 days ago
Skills & highlights for this role
- Azure Databricks
- PySpark
- Delta Lake
- dimensional modeling
- Data Vault 2.0
- CI/CD for data pipelines
Also useful
- Delta Live Tables
- Unity Catalog
- Terraform
- Teradata migration
About the role
We are looking for a highly skilled Senior Data Engineer / Data Architect with deep hands‑on expertise in Azure, Databricks, PySpark, Python, SQL, and modern data warehousing. This role is ideal for someone who has built large‑scale data platforms, designed enterprise‑grade architectures, and delivered high‑quality data products in cloud environments.
Core Technical Expertise
Azure Cloud Platform
Adls
- Gen2, ADF, Synapse, Azure SQL, Key Vault, App Services
- Cloud‑native architecture design, scalability, and cost optimization
- Security & governance: RBAC, Managed Identity, Private Endpoints
- Databricks Engineering
- End‑to‑end development on Azure Databricks
- Lakehouse architecture implementation
- Delta Live Tables (DLT), Unity Catalog
- Performance tuning, cluster optimization
- CI/CD for Databricks workloads
- Big Data & Processing Frameworks
- Apache Spark with advanced PySpark transformations
- Structured Streaming & batch data pipelines
- Delta Lake architecture & optimization
- Programming & Querying
- Python for automation, data engineering, and orchestration
- PySpark for distributed data processing
- SQL for complex query optimization and analytics engineering
- Data Architecture & Engineering
- Enterprise Data Warehouse (EDW) architecture
- Dimensional modeling (Star/Snowflake)
- Data Vault 2.0 modeling
- Metadata‑driven ingestion frameworks
- Change Data Capture (CDC) implementation
- Medallion architecture (Bronze/Silver/Gold)
- Data lineage, governance, cataloging
- Master Data Management (MDM)
- Data Products & Analytics Enablement
- Design and delivery of scalable data products
- Business‑aligned semantic layer design
- KPI frameworks & enterprise reporting enablement
- Integration of ERP, SaaS, and operational systems
- Hybrid Lakehouse + EDW architectures
- DevOps & Engineering Practices
- CI/CD pipelines (Azure DevOps, GitHub Actions, Bitbucket)
- Infrastructure as Code (Terraform, ARM templates)
- Automated testing (unit, integration, data quality)
- Monitoring, logging, and observability
- Agile/Scrum delivery
- Strategic & Leadership Impact
- Principal‑level solution architecture design
- Cross‑functional stakeholder collaboration
- Technical roadmap planning and execution
- Guidance on data governance frameworks (GDPR, SOX)
- Cloud cost optimization strategies
- Migration from legacy EDWs (Teradata, Oracle, SQL Server) to Lakehouse
Ideal Candidate Profile
- 5–10+ years of hands‑on experience in data engineering or data architecture
- Strong expertise in Azure + Databricks ecosystem
- Proven experience building scalable, secure, high‑performance data platforms
- Ability to lead design discussions, influence architecture decisions, and mentor teams
Strong problem‑solving mindset and passion for modern data engineering
- About Company ---
About BayRock Labs
At BayRock Labs, we pioneer innovative tech solutions that drive business transformation. As a leading product engineering firm based in Silicon Valley, we provide full-cycle product development, leveraging cutting-edge technologies in AI, ML, and data analytics. Our collaborative, inclusive culture fosters professional growth and work-life balance. Join us to work on ground-breaking projects and be part of a team that values excellence, integrity, and innovation. Together, let's redefine what's possible in technology.
From BayRock Labs's careers page, first listed on Rolev.ai on October 10, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Principal Data Engineer role at BayRock Labs, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
All Data Engineer jobs- Data Architect (Microsoft Fabric)NBCUniversal · New York, NY · $120k – $140k/yr
- Data Architect (DataOps) - SMEAccenture Federal Services · Chantilly, VA
- Data Solutions ArchitectCampbell Soup · Remote (US)
- Databricks Solutions Architect Senior ManagerRobert Half · Minneapolis, MN
- Data Architect IIIGenerac · Waukesha, WI
- Senior Airtable Data Operations ArchitectAdvanced Systems Group · Culver City, CA
Common questions
Where is the Principal Data Engineer job at BayRock Labs located?
This Principal Data Engineer position at BayRock Labs is located in Milpitas, CA (On-site). Always check BayRock Labs's application page for specific state eligibility or relocation policies.
What qualifications are required for Principal Data Engineer at BayRock Labs?
For the Principal Data Engineer role, BayRock Labs highlights 5+ years of relevant experience; experience with Azure Databricks, PySpark, Delta Lake, dimensional modeling, Data Vault 2.0, CI/CD for data pipelines. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the Principal Data Engineer position at BayRock Labs?
This listing links directly to BayRock Labs's Rippling application page. You can apply directly on BayRock Labs's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Rippling application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.