About Us:
Rivian and Volkswagen Group Technologies is a joint venture between two industry leaders with a clear vision for automotive's next chapter. From operating systems to zonal controllers to cloud and connectivity solutions, we're addressing the challenges of electric vehicles through technology that will set the standards for software-defined vehicles around the world.
The road to the future is uncharted. By combining our expertise across connectivity, AI, security and more, we'll map a new way forward. Working together, we'll create a future that's more connected, more intelligent, more sustainable for everyone. Role Summary:
Rivian and Volkswagen Group Technologies is seeking a Software Engineer to join our Data & AI team. This role is pivotal in enabling our big data platform to operate seamlessly at a petabyte scale. The successful candidate will be an architect and custodian of a custom-built, Go-powered vehicle data processing framework, ensuring its smooth integration with our Databricks platform. Responsibilities:
Framework Development & Maintenance: Design, develop, and enhance a cutting-edge, petabyte-scale vehicle data processing framework using Go. This framework is the backbone of our data operations; therefore, the ability to write clean, efficient, and maintainable code is essential.
Databricks Integration: Collaborate closely with the big data platform team to ensure seamless integration of the framework with our Databricks environment. This involves understanding the intricacies of both systems and optimizing their interaction for maximum efficiency.
CI/CD & Kubernetes Management: Take ownership of the framework's deployment lifecycle. Implement and manage robust CI/CD pipelines on Kubernetes to ensure smooth, automated, and reliable deployments.
Performance Optimization: Continuously monitor the framework's performance, identify bottlenecks, and implement optimizations to ensure it operates at peak efficiency even as data volumes grow.
Troubleshooting & Issue Resolution: Proactively identify and resolve issues that may arise with the framework. The ability to diagnose problems quickly and implement effective solutions will be critical to maintaining system uptime.
Collaborative Development: Collaborate with data producers and consumers to deliver dependable and scalable solutions.
Staying Ahead of the Curve: Keep abreast of the latest advancements in big data technologies, data engineering practices, and cloud computing. Explore new tools and techniques to improve our data infrastructure. Qualifications:
MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.