Crystal Equation
http://cdn.haleymarketing.com/templates/61283/logos/crystalequation-socialmedia.png
https://www.crystalequation.com
https://www.crystalequation.com
true
Data Engineer - II
101 Market St San Francisco, CA 94105 US
Posted: 05/21/2024
2024-05-21
2024-08-25
Job Number: 39199
Job Description
Pay Range: $69.05 - 76.46/hr
Qualifications:
***Cloud Data Engineer***
Location: San Francisco
Position type: Hybrid (2+ days in office)
Qualifications
• 5 to 9+ years of experience in data engineering, data science, and software engineering.
• Bachelor’s degree in computer science, Information Systems, or another related field
• Must be a US Citizen or a Green Card holder.
Responsibilities:
Position Description:
• Designs, develops, modifies, tests, and automates the data warehouse and business intelligence applications solutions. This includes design, development, architecture recommendations, quality management, metadata and repository creation, trouble-shooting problems, and tuning warehouse applications.
• Develops transition and implementation plans. Recommends changes in development, maintenance, and standards.
• Advanced analytical ability and technical skill as well as the ability to provide innovative solutions to technical needs and business requirements.
• Ability to exercise independent judgment in making complex business decisions.
• Acute attention to detail with a high level of data integrity and accuracy
• Excellent oral and written communication, with interpersonal skills to work with people at all levels of the organization.
• Ability to translate highly technical information into non-technical terms.
• Excellent computer skills including Microsoft Office along with various other software applications as needed for the role.
• Broad knowledge of the programming tools, concepts, practices, and principles including design, implementation, and testing
• Position requires continuous visual concentration and manual dexterity to operate PC
• Requires prolonged sitting and minimal standing/walking.
• May require on-call status.
• Rare domestic travel including overnight stays may be necessary.
Technical Skills:
• Expert in developing and analyzing complex SQL on a variety of RDBMS (Microsoft SQL Server, Oracle)
• Expert knowledge of data modeling and understanding of different data structures and their benefits and limitations under particular use cases
• Experience with ETL tools (Informatica)
• Ability to create quality ERD’s (entity-relationship diagrams)
• Excellent writing skills for writing user and system documentation
• AWS Cloud Data Warehousing Technologies
o Experience using core AWS services to build and support data warehouse solutions leveraging AWS architecture best practices (S3, DMS, Glue, Lambda)
o Development/modeling experience with Amazon Redshift, Amazon Aurora Postgres SQL
o Experience using the AWS service APIs, AWS CLI, and SDKs to build applications.
o Proficiency in developing, deploying, and debugging cloud-based applications using AWS.
o Ability to use a CI/CD pipeline to deploy applications on AWS (GitLab, Terraform, DBMaestro)
o Ability to apply a basic understanding of cloud-native applications to write code.
o Proficiency writing code for serverless applications.
o Ability to write code using AWS security best practices (e.g., not using secret and access keys in the code, instead using IAM roles)
o Ability to author, maintain, and debug code modules on AWS.
• Experience with visualization tools (Tableau)
• Experience with SAP Business Objects (BO)
• Experience creating scripts with Python.
• Experience working on an Agile team.
• Understanding of application lifecycle management
• Understanding of the use of containers in the development process
Responsibilities
• Contributes to the design, development, testing, implementation, and review of complex data warehouse and business intelligence solutions.
• Develops all or part of complex data warehouse applications, develops software from established requirements, builds reports and dashboards, plans and coordinates work with fellow programmers to meet delivery commitments, creates prototypes; offers insight on the feasibility of system designs.
• Contributes to the design of technology infrastructure and configurations, recommends process improvements.
• Reviews complex patches and new versions of data warehouse applications. Implements complex software packages and deploys code.
• Key participant in cross-functional team initiatives and process improvement projects
Qualifications:
***Cloud Data Engineer***
Location: San Francisco
Position type: Hybrid (2+ days in office)
Qualifications
• 5 to 9+ years of experience in data engineering, data science, and software engineering.
• Bachelor’s degree in computer science, Information Systems, or another related field
• Must be a US Citizen or a Green Card holder.
Responsibilities:
Position Description:
• Designs, develops, modifies, tests, and automates the data warehouse and business intelligence applications solutions. This includes design, development, architecture recommendations, quality management, metadata and repository creation, trouble-shooting problems, and tuning warehouse applications.
• Develops transition and implementation plans. Recommends changes in development, maintenance, and standards.
• Advanced analytical ability and technical skill as well as the ability to provide innovative solutions to technical needs and business requirements.
• Ability to exercise independent judgment in making complex business decisions.
• Acute attention to detail with a high level of data integrity and accuracy
• Excellent oral and written communication, with interpersonal skills to work with people at all levels of the organization.
• Ability to translate highly technical information into non-technical terms.
• Excellent computer skills including Microsoft Office along with various other software applications as needed for the role.
• Broad knowledge of the programming tools, concepts, practices, and principles including design, implementation, and testing
• Position requires continuous visual concentration and manual dexterity to operate PC
• Requires prolonged sitting and minimal standing/walking.
• May require on-call status.
• Rare domestic travel including overnight stays may be necessary.
Technical Skills:
• Expert in developing and analyzing complex SQL on a variety of RDBMS (Microsoft SQL Server, Oracle)
• Expert knowledge of data modeling and understanding of different data structures and their benefits and limitations under particular use cases
• Experience with ETL tools (Informatica)
• Ability to create quality ERD’s (entity-relationship diagrams)
• Excellent writing skills for writing user and system documentation
• AWS Cloud Data Warehousing Technologies
o Experience using core AWS services to build and support data warehouse solutions leveraging AWS architecture best practices (S3, DMS, Glue, Lambda)
o Development/modeling experience with Amazon Redshift, Amazon Aurora Postgres SQL
o Experience using the AWS service APIs, AWS CLI, and SDKs to build applications.
o Proficiency in developing, deploying, and debugging cloud-based applications using AWS.
o Ability to use a CI/CD pipeline to deploy applications on AWS (GitLab, Terraform, DBMaestro)
o Ability to apply a basic understanding of cloud-native applications to write code.
o Proficiency writing code for serverless applications.
o Ability to write code using AWS security best practices (e.g., not using secret and access keys in the code, instead using IAM roles)
o Ability to author, maintain, and debug code modules on AWS.
• Experience with visualization tools (Tableau)
• Experience with SAP Business Objects (BO)
• Experience creating scripts with Python.
• Experience working on an Agile team.
• Understanding of application lifecycle management
• Understanding of the use of containers in the development process
Responsibilities
• Contributes to the design, development, testing, implementation, and review of complex data warehouse and business intelligence solutions.
• Develops all or part of complex data warehouse applications, develops software from established requirements, builds reports and dashboards, plans and coordinates work with fellow programmers to meet delivery commitments, creates prototypes; offers insight on the feasibility of system designs.
• Contributes to the design of technology infrastructure and configurations, recommends process improvements.
• Reviews complex patches and new versions of data warehouse applications. Implements complex software packages and deploys code.
• Key participant in cross-functional team initiatives and process improvement projects
Meet Your Recruiter
Share This Job:
Related Jobs:
Login to save this search and get notified of similar positions.About San Francisco, CA
Ready to take your career to new heights? Explore job opportunities around the bustling city of San Francisco, California. Known for its vibrant tech scene, picturesque views of the Golden Gate Bridge, diverse culinary offerings like the famous clam chowder in sourdough bread bowls at Fisherman's Wharf, and the artistic vibe of the iconic street art at Clarion Alley. Work-life balance flourishes with easy access to outdoor adventures like hiking in Muir Woods, catching a Giants game at Oracle Park, or browsing through the exhibits at the San Francisco Museum of Modern Art. Join us in San Francisco and discover the endless possibilities this innovative and charming city has to offer.