Senior Data Engineer/ETL designer with python, snowflake and oracle experience
emagine
Dato: for 4 dage siden
By: København, Region Hovedstaden
Kontrakttype: Fuld tid

emagine is looking for a Senior Data Engineer/ETL designer for a client in the financial sector.
You will be responsible for optimizing data workflows, writing efficient scripting code e.g. bash, python and SQL, and manage both on prem and cloud-based hybrid infrastructure.
Key Responsibilities
Location: Copenhagen, Denmark
Onsite/remote: 3 days onsite, 2 days remote
You will be responsible for optimizing data workflows, writing efficient scripting code e.g. bash, python and SQL, and manage both on prem and cloud-based hybrid infrastructure.
Key Responsibilities
- Design, build and maintain scalable ELT pipeline
- Develop and optimize PLSQL queries and database objects for high performance data storage in Oracle
- Write python-based data engineering scripts to process data.
- Implement CI/CD pipelines for data infrastructure and workflow automation
- Understand and have experience of database change management
- Work one or more of the major cloud vendor
- Integrate and manage modern data stack.
- Monitor, debug and optimize data workflows and infrastructure performance.
- Ensure data quality, governance, and compliance with good practices
- Proficient in designing OLAP system and using techniques like STAR schema or denormalization.
- Python & PLSQL Proficiency
- ELT/ETL development using GUI-based tool e.g. IBM Datastage, ADF, Stitch, Matillion
- Database Management, Oracle, MSSQL, Snowflake
- DevOps & CI/CD understanding of Git, Docker, Kubernetes, Terraform, CI/CD pipeline development tool e.g. Jenkins, Bamboo, Azure DevOps
- Experience with test automation e.g. Robot, Selenium and understand the different test scenarios.
- Understanding version control technique Git, GitHub, GitLab
- Workflow Orchestration e.g. Airflow & Prefect.
- Streaming & Batch processing knowledge involving Kafka,
- Distributed and parallel Computing solution e.g. Spark, Flink or Dask.
- Data governance & security implementation RBAC, GDPR, HIPAA compliance
Location: Copenhagen, Denmark
Onsite/remote: 3 days onsite, 2 days remote
Se flere job i København, Region Hovedstaden