Job Description

Job Title: Data Engineer with Databricks and AWS
Job Location: Canada Remote
Job Type: Contract

"Skills and Responsibilities:
Python, Snowflake, AWS, Data Bricks
Description: This role will be part of a team focused on cloud transformation, modernizing analytics platforms and improving agility.
The role requires hands-on experience in building and managing analytics solutions in Snowflake, Provide direction on adoption of Cloud technologies (Snowflake) and industry best practices in the field of Data Engineering architecture and Development.

Primary duties and responsibilities:
Good understanding in Snowflake

Nice to have skills:
Python, AWS, AWS Services

Responsibilities platform:

• External tables, materialized views, stored procedures, tasks, row-based access policy and role-based access policy, time-travel, fail-safe, connectors, Micro-partitions & Data Clustering in snowflake, query pruning - Establish Data Engineering architecture strategy, best practices, standards, and roadmap - Experience developing ETL Pipeline using Python, Snowflake and IDMC.
• Experience with loading batch data and streaming data via Kafka - Build Data Flows mapping Source systems and Process flows.
• Assemble large, complex data sets that meet non-functional and functional business requirements
• Perform code reviews and assist developers in optimization and troubleshooting.
• Expertise in Snowflake advanced concepts like setting up resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, zero copy clone, time travel and understand how to use these features
• Knowledge in AWS and management technologies such as S3.
• Strong written communication skills - Is effective and persuasive in both written and oral communication

Must Haves:

• 5+ years of experience within data engineering - Python experience - Snowflake experience (developing ETL pipelines) - Data Bricks experience
• Writing Workflows and Notebooks in python/scala/SQL
• Knowledge of AWS

Plusses: - Kafka experience (loading batch and streaming data)

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

Diverse Lynx