Job title: Lead Engineer Job location: Canada(Remote) Job type: Contract
Lead Engineer should have at least 10 years of hands on experience
Work location is remote (anywhere in Canada) but must work on PST time zone
Target start date is 4/6
Design and implement distributed data processing pipelines using Spark, Hive, Python, and other tools and languages prevalent in the Hadoop ecosystem. Ability to design and implement end to end solution. Experience publishing RESTful API\'s to enable real-time data consumption using OpenAPI specifications Experience with open source NOSQL technologies such as HBase, DynamoDB, Cassandra Familiar with Distributed Stream Processing frameworks for Fast & Big Data like Apache Spark, Flink, Kafka stream Build utilities, user defined functions, and frameworks to better enable data flow patterns. Work with architecture/engineering leads and other teams to ensure quality solutions are implements, and engineering best practices are defined and adhered to.
Tech Stack : Pyspark, AWS, SQL, Airflow, Kafka Streams etc.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.