Data Engineer IV
Posted: 05/05/2026
Job Number: 42218
Job Description
Data Engineer IV
Remote
Summary:
The Data Engineer will support a strategic data platform migration initiative, building the data pipelines and warehouse infrastructure required to transition business-critical operations from a third-party SaaS CRM (Salesforce) onto an internal entity-modeled data platform. The engineer will design and maintain bidirectional ETL flows between Salesforce, distributed data warehouses, and operational entity stores, ensuring data consistency, freshness, and auditability throughout the migration. Work spans pipeline development, schema design, data quality engineering, and orchestration of scheduled batch and streaming jobs.
Responsibilities:
Pay range is $83 - $88 per hour with full benefits available, including paid time off, medical/dental/vision/life insurance, 401K, parental leave, and more. Our compensation reflects the cost of labor across several US geographic markets. Pay is based on several factors including market location and may vary depending on job-related knowledge, skills, and experience.
THE PROMISES WE MAKE:
At Crystal Equation, we empower people and advance technology initiatives by building trust. Your recruiter will prep you for the interview, obtain feedback, guide you through any necessary paperwork and provide everything you need for a successful start. We will serve to empower you along the way and provide the path for your professional journey.
For more information regarding our Privacy Policy, please visit crystalequation.com/privacy.
Remote
Summary:
The Data Engineer will support a strategic data platform migration initiative, building the data pipelines and warehouse infrastructure required to transition business-critical operations from a third-party SaaS CRM (Salesforce) onto an internal entity-modeled data platform. The engineer will design and maintain bidirectional ETL flows between Salesforce, distributed data warehouses, and operational entity stores, ensuring data consistency, freshness, and auditability throughout the migration. Work spans pipeline development, schema design, data quality engineering, and orchestration of scheduled batch and streaming jobs.
Responsibilities:
- Design and build bidirectional data pipelines between Salesforce, distributed data warehouses (Hadoop/Spark/Hive ecosystems), and operational entity-modeled data stores.
- Develop and maintain scheduled batch ETL jobs using workflow orchestration frameworks (Airflow, Dagster, or equivalent) for daily/hourly data sync tasks.
- Build streaming data pipelines using distributed event-streaming systems (Kafka or equivalent pub/sub log architectures) for near-real-time data propagation.
- Implement data extraction patterns from Salesforce -- including Bulk API, REST API, change data capture (CDC), and platform events -- into downstream warehouses.
- Design and maintain dimensional and entity schemas in the internal data platform, including upstream/downstream lineage and column-level mappings.
- Build data validation, reconciliation, and quality monitoring frameworks to ensure parity between legacy and replacement systems during transition.
- Develop and maintain data documentation including schema definitions, transformation logic, source-to-target mappings, and data dictionaries.
- Use AI-assisted development tools (e.g., Claude Code, Cursor, Copilot) as a core part of the development workflow to accelerate pipeline development, SQL authoring, and schema migrations.
- Partner with software engineers, Salesforce administrators, and business stakeholders to define data contracts, SLAs, and migration cutover criteria.
- Investigate and resolve data quality incidents, pipeline failures, and reconciliation discrepancies.
- Strong proficiency in SQL and at least one general-purpose language (Python preferred; Java, Scala, or TypeScript also acceptable).
- Hands-on experience building and operating large-scale ETL/ELT pipelines in distributed data warehouse environments (Hive, Spark, Presto/Trino, BigQuery, Snowflake, or Databricks).
- Experience with workflow orchestration tools (Airflow, Dagster, Prefect, or equivalent).
- Familiarity with distributed event-streaming systems (Kafka, Pulsar, Kinesis, or equivalent) for real-time data ingestion.
- Salesforce data extraction experience strongly preferred -- familiarity with Bulk API, REST API, SOQL, change data capture, platform events, and Salesforce data model.
- Comfort with entity-modeling frameworks, dimensional modeling, and data lineage tooling.
- Hands-on experience using AI coding assistants (Claude Code, Cursor, GitHub Copilot, etc.) as part of a daily development workflow.
- Strong understanding of data quality engineering -- testing, validation, monitoring, and reconciliation patterns.
- Experience with data migrations between heterogeneous systems is highly desirable.
- Verbal and written communication skills, problem solving skills, customer service and interpersonal skills.
- Strong ability to work independently and manage one's time.
- Strong knowledge of the full data engineering lifecycle: from requirements gathering and source system analysis, through pipeline development, testing, and production operations.
- Strong ability to troubleshoot data issues and make system changes as needed to resolve them.
- Bachelor's degree in computer science, data engineering, information systems, or relevant field required.
- 3+ years of professional data engineering experience preferred.
Pay range is $83 - $88 per hour with full benefits available, including paid time off, medical/dental/vision/life insurance, 401K, parental leave, and more. Our compensation reflects the cost of labor across several US geographic markets. Pay is based on several factors including market location and may vary depending on job-related knowledge, skills, and experience.
THE PROMISES WE MAKE:
At Crystal Equation, we empower people and advance technology initiatives by building trust. Your recruiter will prep you for the interview, obtain feedback, guide you through any necessary paperwork and provide everything you need for a successful start. We will serve to empower you along the way and provide the path for your professional journey.
For more information regarding our Privacy Policy, please visit crystalequation.com/privacy.