Sr. Hadoop Data Engineer
- Location
- St. Louis, MO
- Job type
- Full-time
- Level
- Senior
- Experience
- 4+ years
- Education
- Bachelor's degree
- Listed
- Today
Skills & highlights for this role
- Hadoop
- Spark
- Kafka
- HDFS
Also useful
- Hive
- NoSQL databases
- Scala
How well does your resume fit this job?
Upload your resume to see your score for this Sonoma Consulting Inc. role, what matches, what's missing, and your best other matches.
Scored on our server and not saved there. The file stays in this browser so you don't have to upload it again after you sign up.
Preferred
- Selecting and integrating Big Data tools and frameworks required to provide requested capabilities
- Implementing Data ingestion and ETL processes on Hadoop
- Monitoring performance and advising any necessary infrastructure changes
- Defining data retention policies
- Design and build data processing pipelines for structured and unstructured data using tools and frameworks in the Hadoop ecosystem
- Develop applications that are scalable to handle millions of events/records
- Design and launch scalable, reliable and efficient processes to move, transform and report on large amounts of data
- Participate in meetings with business (account/product management, data scientists) to obtain new requirements
- Follow our Agile software development process with daily scrums and monthly Sprints
- Ability to work collaboratively on a cross-functional team with a wide range of experience levels
Qualifications
- Bachelor's degree and 8+ years relevant experience or Master's degree and 6+ years of relevant experience
- 4+ years in industry implementing big data solutions on Hadoop
- Proficient understanding of distributed computing principles
- Proficiency with Hadoop v2, MapReduce, HDFS
- Experience with building stream-processing systems, using solutions such as Storm or Kafka and Spark-Streaming
- Good knowledge of Big Data querying tools, such as Pig, Hive, Phoenix
- Experience with Spark
- Experience with integration of data from multiple data sources
- Experience with 1 or 2 NoSQL/Graph databases, such as HBase, Cassandra, MongoDB, Neo4j
- Proficiency in a programming languages like SCALA, Java,Python
- Experience with Linux OS, shell scripting
- Experience with relational databases (SQL)
- Experience in working with real-time data feeds
- Experience in working with unstructured data
- Experience in implementing Scoop Jobs to Import/Export data from Hadoop
- Knowledge of various ETL techniques and frameworks, such as Pig, Hive, or Flume
- Experience with various messaging systems, such as Kafka or RabbitMQ
- Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O
- Good understanding of Lambda Architecture, along with its advantages and drawbacks
- Experience with Hortonworks Hadoop Data Platform (HDP)
- Experience with all or some of the following supporting Hadoop administration and security frameworks: HCatalog, Drill, NiFi, Oozie, Falcon, Ranger, Ambari, Zeplin.
Qualifications & Requirements
- *Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education
- *At least 2 years of experience with Information Technology
Additional Information
- U.S. Citizens and those who are authorized to work independently in the United States are encouraged to apply. We are unable to sponsor at this time.
This is a Full-Time / Permanent job opportunity.
Only for US Citizen and Green Card Holder
- All your information will be kept confidential according to EEO guidelines.
About the Company
Halo Group is a premier provider of IT talent. We place technology experts within the teams of the world's leading companies to help them build innovative businesses that keep them one step closer to their customers and one step ahead of the competition. We offer a meaningful work environment for employees, attractive and interesting engagements for consultants, and cutting-edge digital innovation for our customers.
We delight in helping our customers execute their digital vision. Big projects or small, Halo Group knows that by combining the highest quality talent with our unwavering support, we will become an invaluable extension of the team. Halo
Group's experienced consultants in Detroit, Atlanta and Dallas specialize in all areas of product/project governance, UX/UI, multi-platform applications, quality assurance/testing, cloud computing, and data analytics.
Since its inception, Halo Group has been recognized for numerous awards, including:
- INC 5000
- Future 50
- 101 Best and Brightest
- Michigan 50 Companies to Watch
- Goldline Research - "Most Dependable Companies"
- Ernst & Young - "Entrepreneur of the Year" Finalist
From Sonoma Consulting Inc.'s careers page, first listed on Rolev.ai on November 19, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Sr. Hadoop Data Engineer role at Sonoma Consulting Inc., it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
All Software Developer jobs- Software Development Engineer - Document IntelligenceWorkday · Pleasanton, CA
- Senior Software EngineerKcura · Illinois
- Expert Analyst Health Plan ApplicationsJefferson Health · Philadelphia, PA
- R&D Software EngineerAbb · Bartlesville, OK
- Senior DeveloperThermofisher · Remote, Pennsylvania
- Senior AI EngineerPillsbury Law · Nashville, TN
Common questions
Where is the Sr. Hadoop Data Engineer job at Sonoma Consulting Inc. located?
This Sr. Hadoop Data Engineer position at Sonoma Consulting Inc. is located in St. Louis, MO. Always check Sonoma Consulting Inc.'s application page for specific state eligibility or relocation policies.
What qualifications are required for Sr. Hadoop Data Engineer at Sonoma Consulting Inc.?
For the Sr. Hadoop Data Engineer role, Sonoma Consulting Inc. highlights 4+ years of relevant experience; a bachelor's degree; experience with Hadoop, Spark, Kafka, HDFS. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the Sr. Hadoop Data Engineer position at Sonoma Consulting Inc.?
This listing links directly to Sonoma Consulting Inc.'s SmartRecruiters application page. You can apply directly on Sonoma Consulting Inc.'s site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the SmartRecruiters application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.