Epicareer Might not Working Properly
Learn More

ETL Developer

Salary undisclosed

Checking job availability...

Original
Simplified

Key Responsibilities:

  • Write clean, efficient, and maintainable Python code following best practices.
  • Design and implement end-to-end ETL pipelines that incorporate ML/LLM transformations for data enrichment, classification, and standardization.
  • Build and maintain LLM-powered data transformation workflows for tasks like text normalization, entity extraction, and content classification
  • Work closely with product managers, solution architects, and other stakeholders to define project requirements and deliver impactful solutions.
  • Collaborate with ETL engineers and domain experts to understand data requirements and implement appropriate transformations
  • Stay abreast of emerging trends and technologies in AI/ML. Encourage continuous learning and the adoption of cutting-edge tools and methodologies.
  • Continuously enhance data quality, automation processes, and workflows.

Qualification:

  • Proven track record of working in large-scale projects.
  • Strong proficiency in Python programming with 5+ years of experience in building AI/ML solutions
  • Fluent in English, with excellent communication and presentation skills.
  • Strong proficiency in Python and relevant libraries
  • Practical knowledge of LLM (Llama, OpenAI, etc) for data transformation
  • Experience with transformer-based embeddings for text vectorization and similarity matching
  • Experience with SQL and NoSQL databases for data storage and retrieval
  • Knowledge of data validation and quality assurance methodologies
  • Bonus: Have deployed open-weight models locally

Key Responsibilities:

  • Write clean, efficient, and maintainable Python code following best practices.
  • Design and implement end-to-end ETL pipelines that incorporate ML/LLM transformations for data enrichment, classification, and standardization.
  • Build and maintain LLM-powered data transformation workflows for tasks like text normalization, entity extraction, and content classification
  • Work closely with product managers, solution architects, and other stakeholders to define project requirements and deliver impactful solutions.
  • Collaborate with ETL engineers and domain experts to understand data requirements and implement appropriate transformations
  • Stay abreast of emerging trends and technologies in AI/ML. Encourage continuous learning and the adoption of cutting-edge tools and methodologies.
  • Continuously enhance data quality, automation processes, and workflows.

Qualification:

  • Proven track record of working in large-scale projects.
  • Strong proficiency in Python programming with 5+ years of experience in building AI/ML solutions
  • Fluent in English, with excellent communication and presentation skills.
  • Strong proficiency in Python and relevant libraries
  • Practical knowledge of LLM (Llama, OpenAI, etc) for data transformation
  • Experience with transformer-based embeddings for text vectorization and similarity matching
  • Experience with SQL and NoSQL databases for data storage and retrieval
  • Knowledge of data validation and quality assurance methodologies
  • Bonus: Have deployed open-weight models locally