Senior Principal Data Engineer Secureworks 100% Remote Prince Edward Island, Canada

Charlottetown, PE, Canada

Apply Now

Title: Senior Principal Data Engineer- SecureWorks- 100% Remote

Your responsibilities include:

Designing and building highly available and scalable data pipeline systems
Optimizing performance from point of ingest to analytics
Implementing Infrastructure as code, including dashboarding metrics and monitoring performance
Scaling of data flow infrastructure to meet load while optimizing cost

Essential requirements:

10+ years of software development experience
Degree in Computer Science or equivalent. A graduate school degree, MSc, or PhD is a plus.
Excellent system design, coding, and algorithm skills
Knowledge of data ingest techniques (e.g., historical vs. stream processing) and related technologies (e.g., Hudi, Apache Flink, Spark, Spark Streaming, Kafka-Connect)
Performance tuning Spark or Flinkjobs
Performance turning large scale Kafka Clusters
Proficiency in one or more of these languages: Java, Scala, Golang
Excellent analytical skills, specifically, being able to come up and reason about the design of analytics applications
AWS (Amazon Web Services) S3 / AWS Glue / EMR
Docker or similar containerization technology

Desirable Requirements:

Experience with messaging middleware like Kafka, ActiveMQ, JMS
Experience with Hudi, Flink, Kubernetes, Cassandra
Experience with Apache Airflow, Apache Livy
Experience with CI/CD pipelines
Experience in managing Infrastructure as code using Terraform
Experience setting up monitoring using tools such as Cloud Watch, Datadog, and Statsd

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.