loading
Image

Big Data engineer

,

PDF

Job Description

Experience : 4-6yrs 

Job description :

We seek a talented Data Engineer with AI & ML knowledge to join our team. As a Data Engineer or MLOps Engineer, your primary responsibility will be to develop & integrate ML solutions that focus on technology improvements. Specifically, you will be working on projects involving leveraging AI/ML for Data Management Efficiencies & Query Optimizations. 

Responsibilities:

– Collaborate with cross-functional teams such as Data Scientists, Product Partners and Partner Team Developers to identify opportunities for Big Data, Query ( Spark, Hive SQL, BigQuery, SQL ) tuning opportunities that can be solved using machine learning and generative AI.

– Write clean, high-performance, high-quality, maintainable code.

– Create backend applications using Python, docker, Google Cloud  & in-house ML frameworks to orchestrate end to end applications

– Design and develop Big Data Engineering Solutions & generative AI Applications for above ensuring scalability, efficiency, and maintainability of such solutions.

– Implement prompt engineering techniques to fine-tune and enhance LLMs for better performance and application-specific needs.

– Stay abreast of the latest advancements in the field of Generative AI Application Development and actively contribute to the research and development of new Generative AI Applications.

Requirements:

– Proven experience working as a Big Data & MLOps Engineer, with a focus on Python, Google Cloud, Spark, Spark SQL, BigQuery, and Generative AI Applications. 

– Deep understanding and experience in tuning Dataproc, BigQuery, and Spark Applications.

– Solid knowledge of software engineering best practices, including version co

Employment Status

Full Time

Educational Requirements

B.Tech

Experience Requirements

3 - <5 Years

Simillar Jobs

Image

Database Administrator 

Posted Sep 04, 2024

, , ,

Image

Lead Consultant

Posted Jul 16, 2025

, , ,

Image

System Engineer

Posted Jul 08, 2024

, , ,