Senior Data Engineer
Toronto, ON, Canada
Job Description
b'
KPI Partners, A global consulting firm focused on strategy, technology, and digital transformation. We help companies tackle their most ambitious projects and build new capabilities. We provide solutions in Cloud, Data, Application Development & BI spaces. We enable your growth At KPI, you can become who you want to be and learn skills that will take you further in your career
Contract length: 6 months Salary: $70.00-$90.00 per hour Schedule:
- Continuously upgrade yourself
- Develop as a future leader
- Drive cloud enablement around the world
- Help establish the development and architectural standards for the team in areas of technical excellence.
- Work collaboratively with Product Management, DevOps, and other software developers to develop applications that can be easily tested and perform well under a variety of network conditions.
- Delight consumers by ensuring they have the data they need to inform decisions, where and when they need it.
- Champion adherence to best-practice development methodologies.
- Build and maintain data pipelines.
- Design and code appropriate, scalable, and secure algorithms, data structures, and software components.
- Follow good documentation practices.
- Lead design and code reviews.
- Facilitate automated testing so all teams can innovate at a rapid pace.
- Mentor and build skills across the team through effective standards setting, code reviews, and pairing.
- Tune production applications to maximize efficiency.
- Demonstrated technical leadership skills with ability to conduct code reviews and architect solutions.
- Develop ongoing metrics, analysis, and dashboards to guide important decisions.
- 5+ years of experience developing complex enterprise applications
- Great leadership skills
- Extensive experience in AWS, GCP or Azure
- Extensive experience working with relational and NoSql databases
- Experience with Docker and Serverless architectures like AWS Lambda, DynamoDB, ECS, S3, Amazon Kinesis, EventBridge, SQS, CloudFormation, Terraform, and/or other similar cloud services.
- Experience writing microservices/lambdas in Javascript/Typescript for data processing.
- Experience working in a complex enterprise environment and developing complex programs
- Experience with REST API architecture and development, especially using Swagger or Apigee.
- Knowledge of Git including version control, branching, merging/rebasing, and pull requests.
- Experience writing SQL and a procedural language (Python, R, etc.) for data handling. (Preferred: Snowflake DBT and SIngleStore DB).
- Strong focus on automation including Continuous Integration / Deployment with writing unit and integration tests.
- Experience in Agile/SCRUM Software Development Process
- Experience implementing data analytics, visualization tools and programs using Tableau, Grafana, and Google Sheets.
- Good security practices and experience writing code that manages customer data.
- Impeccable communication and team skills with shared ownership of code and other deliverables.
- Willingness to work with and learn new technologies.
- Build architectural models with synchronous and asynchronous patterns to decouple, integrate and scale services.
- Experience with real-time data processing.
- Familiar with GCP data stores including BigQuery, Bigtable and Datastore.
- Knowledge of architecting solutions in GCP, specifically using: Cloud functions, Composer, Cloud pub/sub, Dataflow and Stackdriver.
- Experience with team development tooling (especially with Jira and Github).
- Familiarity with Docker architectures, and Terraform deployments.
- Experience with MuleSoft and GraphQL
- Expert in Node.js
- Experience with distributed systems and federated authentication systems.
- Experience with Maven/Gradle build systems.
- Understanding of BFF (Backend-for-Frontend) patterns.
- Experience with development of self-healing, reliable and reactive systems.
Contract length: 6 months Salary: $70.00-$90.00 per hour Schedule:
- 8 hour shift
- Monday to Friday
- AWS: 3 years (required)
- data engineering: 10 years (required)
- Node.js: 1 year (required)
- SQS/SNS: 1 year (required)
Beware of fraud agents! do not pay money to get a job
MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.
Related Jobs
Job Detail
-
Job IdJD2143280
-
IndustryNot mentioned
-
Total Positions1
-
Job Type:Full Time
-
Salary:Not mentioned
-
Employment StatusPermanent
-
Job LocationToronto, ON, Canada
-
EducationNot mentioned