Data Engineer - III
Posted: 01/30/2026
Job Number: 41836
Job Description
As a Contract Data Engineer, you will be responsible for collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into actionable insights. You will work across multiple platforms to ensure that data pipelines are scalable, repeatable, and secure, capable of serving multiple users.
Requirements:
• Bachelor’s degree in Computer Science, Information Systems, or a related field, or equivalent experience.
• Our ideal candidate would have all of these skills but as many as possible will suffice: Databricks – PySpark, SQL (Starburst is a bonus), Gitlab, -CI/CD Pipelines, Python, and Tableau.
• Two or more years of experience with tools such as Databricks, Collibra, and Starburst.
• Three or more years of experience with Python and PySpark.
• Experience using Jupyter notebooks, including coding and unit testing.
• Recent accomplishments working with relational and NoSQL data stores, methods, and approaches (STAR, Dimensional Modeling).
• Two or more years of experience with a modern data stack (Object stores like S3, Spark, Airflow, Lakehouse architectures, real-time databases) and cloud data warehouses such as RedShift, Snowflake.
• Overall data engineering experience across traditional ETL & Big Data, either on-prem or Cloud.
• Data engineering experience in AWS (any CFS2/EDS) highlighting the services/tools used.
• Experience building end-to-end data pipelines to ingest and process unstructured and semi-structured data using Spark architecture.
Responsibilities:
Essential Responsibilities:
• Design, develop, and maintain robust and efficient data pipelines to ingest, transform, catalog, and deliver curated, trusted, and quality data from disparate sources into our Common Data Platform.
• Actively participate in Agile rituals and follow Scaled Agile processes as set forth by the CDP Program team.
• Deliver high-quality data products and services following Safe Agile Practices.
• Proactively identify and resolve issues with data pipelines and analytical data stores.
• Deploy monitoring and alerting for data pipelines and data stores, implementing auto-remediation where possible to ensure system availability and reliability.
• Employ a security-first, testing, and automation strategy, adhering to data engineering best practices.
• Collaborate with cross-functional teams, including product management, data scientists, analysts, and business stakeholders, to understand their data requirements and provide them with the necessary infrastructure and tools.
• Keep up with the latest trends and technologies, evaluating and recommending new tools, frameworks, and technologies to improve data engineering processes and efficiencies.
Â
Pay range is $108.33Â - $113.33Â per hour with full benefits available, including paid time off, medical/dental/vision/life insurance, 401K, parental leave, and more. Our compensation reflects the cost of labor across several US geographic markets. Pay is based on several factors including market location and may vary depending on job-related knowledge, skills, and experience.
THE PROMISES WE MAKE:
At Crystal Equation, we empower people and advance technology initiatives by building trust. Â Your recruiter will prep you for the interview, obtain feedback, guide you through any necessary paperwork and provide everything you need for a successful start. Â We will serve to empower you along the way and provide the path for your professional journey.
For more information regarding our Privacy Policy, please visit crystalequation.com/privacy.
Meet Your Recruiter
Share This Job:
Related Jobs:
Login to save this search and get notified of similar positions.About San Francisco, CA
Ready to take your career to new heights? Explore job opportunities around the bustling city of San Francisco, California. Known for its vibrant tech scene, picturesque views of the Golden Gate Bridge, diverse culinary offerings like the famous clam chowder in sourdough bread bowls at Fisherman's Wharf, and the artistic vibe of the iconic street art at Clarion Alley. Work-life balance flourishes with easy access to outdoor adventures like hiking in Muir Woods, catching a Giants game at Oracle Park, or browsing through the exhibits at the San Francisco Museum of Modern Art. Join us in San Francisco and discover the endless possibilities this innovative and charming city has to offer.