Lead Engineer

Vancouver, BC, Canada

Job Description




Job title: Lead Engineer
Job location: Canada(Remote)
Job type: Contract

  • Lead Engineer should have at least 10 years of hands on experience
  • Work location is remote (anywhere in Canada) but must work on PST time zone
  • Target start date is 4/6
Design and implement distributed data processing pipelines using Spark, Hive, Python, and other tools and languages prevalent in the Hadoop ecosystem. Ability to design and implement end to end solution.
Experience publishing RESTful API\'s to enable real-time data consumption using OpenAPI specifications
Experience with open source NOSQL technologies such as HBase, DynamoDB, Cassandra
Familiar with Distributed Stream Processing frameworks for Fast & Big Data like Apache Spark, Flink, Kafka stream
Build utilities, user defined functions, and frameworks to better enable data flow patterns.
Work with architecture/engineering leads and other teams to ensure quality solutions are implements, and engineering best practices are defined and adhered to.

Tech Stack : Pyspark, AWS, SQL, Airflow, Kafka Streams etc.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

Diverse Lynx

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD2148222
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Vancouver, BC, Canada
  • Education
    Not mentioned