Senior/lead Spark Developer
Canada, Canada
Job Description
We have an ambitious goal to design solution for big retail company. The main focus is to support processing of big data volumes and integrate solution to current architecture.
Responsibilities
- Development (practical hand-on recent experience is mandatory):
- Python
- Spark
- Java/Kotlin/Groovy
- Azure Databricks, Data Factory
- Team task coordination
- Facilitating and evaluating technical skills of other team members
Skills
Must have
1. Apache Spark
2. Languages
a. Python for scripting
i. For supporting custom operations in Azure pipelines and/or Databricks
b. Java/Kotlin/Groovy
i. For supporting current services consuming the data (team might not be involved in this)
ii. There is a chance that custom script might be written in one of these languages for working with Azure Databricks
Required skills for developer:
3. Data Engineering Concepts
a. Patterns (ETL, ELT)
b. Data Integration
c. Data Migration
d. Data Analytics
e. Data Lake
f. Data Warehouse
g. CI/CD Data Pipeline
4. Azure
a. Azure Data Factory
b. Azure Databricks (together with Apache Sparks)
c. Azure Data Lake
d. Azure Data Warehouse
e. Azure Blob Storage
f. Azure Synapse Analytics
g. Azure Virtual Network
5. Databases
a. Informix
b. MySQL
Nice to have
Postgres, MongoDB, mysql, Elastic, Kafka
Languages
English: B2 Upper Intermediate
Seniority
Lead
Relocation package
If needed, we can help you with relocation process. .
Vacancy Specialization
BigData Development
Ref Number
VR-98710
Beware of fraud agents! do not pay money to get a job
MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.
Related Jobs
Job Detail
-
Job IdJD2207620
-
IndustryNot mentioned
-
Total Positions1
-
Job Type:Full Time
-
Salary:Not mentioned
-
Employment StatusPermanent
-
Job LocationCanada, Canada
-
EducationNot mentioned