Karier.mu (PT. Semesta Integrasi Digital)
Senior Data Engineer - SEKOLAH.MU
Description
Job Description
- Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, GCP, and AWS ‘big data’ technologies.
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Work with data and analytics experts to strive for greater functionality in our data systems.
Requirements
Requirements
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relation SQL and NoSQL database, including Postgres and Cassandra
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc
- Experience with GCP or AWS cloud services: EMR, RDS, Redshift, CloudSQL, BigQuery, etc
- Experience with stream-processing systems: Storm, Spark-streaming, etc
- Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc
Other Information
Benefits:
- Medical & Health Insurance
- Work From Home
- Flexible Time
- Employee Discounts
- Training & Proffesional Development
- Maternity & Paternity Leave
- Gadget Support
Sumber: https://jobs.talentics.id/sekolahmu/senior-data-engineer-j2sak?hide=other-opportunities
Poster


