Senior Data Engineer Assistant Vice President

Mississauga, ON, CA, Canada

Job Description

We need a Senior Data Engineer proficient in Spark, Scala/Java, and Hive, with extensive hands-on development experience in the Big Data Ecosystem.


--------------------------------------------------------------------------------------------------------------------------------------------------------

Key Responsibilities:


-------------------------

Design, implement, and optimize highly performant data pipelines using Spark, Scala/Java, and Hive on platforms like Cloudera Data Platform (CDP) or other Hadoop echo systems.

-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Take complete ownership of complex data engineering projects within the big data ecosystem, covering the entire lifecycle from initial design and development to deployment and ongoing maintenance.

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Develop robust and efficient Hive queries for extensive data analysis and reporting.

----------------------------------------------------------------------------------------

Champion and enforce best practices and coding standards for new and existing data flows to ensure they are robust, scalable, secure, and maintainable using Spark, Scala/Java, and Hive within the big data ecosystem.

---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Diagnose, troubleshoot, and resolve complex issues related to Spark, Scala/Java, and Hive applications and YARN resource management, implementing performance optimization solutions.

-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Proactively collaborate with stakeholders, working closely to develop solutions with full commitment and accountability.

----------------------------------------------------------------------------------------------------------------------------

Technical Skills & Experience


---------------------------------------

Proven hands-on development expertise with Apache Spark

------------------------------------------------------------

Strong programming proficiency in Scala and/or Java

-------------------------------------------------------

In-depth knowledge and practical experience with Hive, including query optimization and data analysis.

-----------------------------------------------------------------------------------------------------------

Experience with data platforms such as Cloudera Data Platform (CDP) is highly desirable.

--------------------------------------------------------------------------------------------

Education:


--------------

Bachelor's / Master's degree/University degree or equivalent experience

---------------------------------------------------------------------------


-

Job Family Group:



Technology
-

Job Family:




Applications Development
-

Time Type:




Full time
-

Primary Location Full Time Salary Range:




$94,300.00 - $141,500.00
-

Most Relevant Skills



Please see the requirements listed above.
-

Other Relevant Skills



For complementary skills, please see above and/or contact the recruiter.
-

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.



View Citi's EEO Policy Statement and the Know Your Rights poster.

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD2733741
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Mississauga, ON, CA, Canada
  • Education
    Not mentioned