Job Description

Company Description

As one of the largest independent technology companies in Atlantic Canada, Mariner has a team of over 200 IT and software professionals working with clients both regionally and across the globe. With extensive capabilities in the areas of analytics, automation software, information security and IT consulting, Mariner has been delivering innovative solutions with a strong emphasis on productivity and customer experience since 2003.



Mariner Innovations is seeking a highly motivated Big Data Engineer focused on Spark applications to support and implement code to build up our ML Development and Production Process. In this role, you will be responsible for client-based projects. This allows you to work with a team of data scientists and data engineers to assess the current Big Data technology in use and to test new ones to evolve the system, especially in Public Cloud Infrastructure.

Your responsibilities will be to support the architecture team in realizing this ambitious new work -program. You will need to be comfortable building both new systems, implementing and integrating them with existing open-source and commercial products. We are looking for a Team player, engaged and involved, ready to challenge certain concepts and ideas and has experience working with data scientists. Furthermore, you would support your peers' knowledge to evolve and to open their minds to new approaches.

This is a great opportunity to have an immediate, visible impact on the business, and to learn the skills required by the industry and technological world!

Your responsibilities:

• Integrating machine learning models onto a Hadoop based big data environment using Apache Spark.
• Work with data scientists to develop part of their code to interface with other components and to improve its efficiency.
• Liaise with the DevOps team maintaining the underlying hardware and supporting technologies.
• Implement automation and monitoring tools with a DevSecOps mindset
• Work with the Architecture Team to test new technology and plan the evolution of the Big Data System
• Developing a log enrichment pipeline capable of functioning at a massive scale.
• Configure Kafka and other components for handling data pipeline
• Maintain up-to-date documentation on the systems and procedures

Qualifications

• University degree in Computer Science or five years' equivalent experience in Information Technology
• Proven Experience with Apache Spark and Kafka.
• Previous experience writing code for use at scale i.e. 'big data'
• Have deployed code in Apache Hadoop ecosystems.
• Strong ability to develop in Python.
• Ability to code in Java and/or Scala is highly desirable
• Experience with CI/CD
• Experience with Data Science Platform highly desirable
• Experience with AWS
• Information security-related applications e.g. SIEM a benefit.
• Proven track record of developing effective and efficient real-time big data processing pipelines
• Skilled thinker, proactive, team-player, highly resourceful and detail-oriented.
• Able to track the work by following agile methodologies

Additional Information

We believe in making a positive impact in the communities where we live and work - our team is located in major cities all across Canada, throughout the US and internationally. We are proud to be headquartered here and are passionate about growing a strong technology sector here in Atlantic Canada and beyond. We offer competitive compensation, benefits packages and training and development.

We recognize that empowered employees are more innovative, more efficient, deliver better customer service and can flat out-perform conventional organizations. Our people have built products for national deployments at the world's largest TV and Internet companies and leading real estate, financial and government organizations.

We are looking for passionate IT professionals who are curious about data, who love solving problems for customers and who want to grow their careers.

Join our growing team!