Epicareer Might not Working Properly
Learn More

Data Engineer / ETL Developer

Salary undisclosed

Checking job availability...

Original
Simplified
Responsibilities

  • Develop, manage, and optimize ETL processes to collect data from various sources (databases, APIs, files, etc.).
  • Clean, validate, and transform data to meet business requirements.
  • Build efficient and scalable data pipelines to support data warehousing or lakehouse solutions.
  • Design and manage database structures to support large-scale data processing.
  • Optimize query performance and ETL processes for faster and more efficient execution.
  • Collaborate with the data warehouse team to ensure data is properly stored and easily accessible.
  • Develop automation solutions to improve ETL process efficiency.
  • Monitor ETL processes to identify and resolve errors or bottlenecks in data pipelines.
  • Maintain technical documentation related to ETL processes and data integration.

Requirements

  • Bachelor Degree (S1), semua jurusan
  • Experience: Junior (1-3 thn), Middle (3-5 thn), Senior (52 thn)
  • Experience with Oracle Data Integrator (ODI) for building ETL pipelines
  • Familiar with data transformation, cleansing, and loading strategies.
  • Understand ETL including error handling, logging. and performance optimization
  • Experience in Oracle SQL and PL/SQL to create stored procedures and triggers for ETL operations
  • Familiar with data warehouse concepts like star schema, snowflake schema, and data marts.
  • Oracle Certified Specialist for Data Integration.
  • Familiar with Talend Open Studio or Talend Data Integration for designing ETL jobs, transformations, and workflows.
  • Understand ETL concepts and data warehousing principles, including data extraction, cleansing and transformation.
  • Experience with integrating different data sources (e.g., relational databases, flat files, APIs) usTalend.
  • Experience with Talend Big Data components (e.g., Spark, Hadoop, Hive, HBase) for integrating and processing large datasets.
  • Experience in implementing error-handling mechanisms, logging, and monitoring for ETL
  • Experience in optimizing talend jobs for performance and scalability.
  • Experience in writing scripting languaes (Python, Java, or Groovy) for advance customizations.
  • Talend Data Integration Certification