Data Engineer / ETL Developer
Salary undisclosed
Checking job availability...
Original
Simplified
Responsibilities
- Develop, manage, and optimize ETL processes to collect data from various sources (databases, APIs, files, etc.).
- Clean, validate, and transform data to meet business requirements.
- Build efficient and scalable data pipelines to support data warehousing or lakehouse solutions.
- Design and manage database structures to support large-scale data processing.
- Optimize query performance and ETL processes for faster and more efficient execution.
- Collaborate with the data warehouse team to ensure data is properly stored and easily accessible.
- Develop automation solutions to improve ETL process efficiency.
- Monitor ETL processes to identify and resolve errors or bottlenecks in data pipelines.
- Maintain technical documentation related to ETL processes and data integration.
- Bachelor Degree (S1), semua jurusan
- Experience: Junior (1-3 thn), Middle (3-5 thn), Senior (52 thn)
- Experience with Oracle Data Integrator (ODI) for building ETL pipelines
- Familiar with data transformation, cleansing, and loading strategies.
- Understand ETL including error handling, logging. and performance optimization
- Experience in Oracle SQL and PL/SQL to create stored procedures and triggers for ETL operations
- Familiar with data warehouse concepts like star schema, snowflake schema, and data marts.
- Oracle Certified Specialist for Data Integration.
- Familiar with Talend Open Studio or Talend Data Integration for designing ETL jobs, transformations, and workflows.
- Understand ETL concepts and data warehousing principles, including data extraction, cleansing and transformation.
- Experience with integrating different data sources (e.g., relational databases, flat files, APIs) usTalend.
- Experience with Talend Big Data components (e.g., Spark, Hadoop, Hive, HBase) for integrating and processing large datasets.
- Experience in implementing error-handling mechanisms, logging, and monitoring for ETL
- Experience in optimizing talend jobs for performance and scalability.
- Experience in writing scripting languaes (Python, Java, or Groovy) for advance customizations.
- Talend Data Integration Certification