Data Engineer - OpenData APAC
Taiwan - TaipeiFull-TimeMid-levelSoftware Engineering
What You’ll Do
- Design and build reusable and configurable data pipelines using AWS.
- Work with data science teammates to turn AI/ML proofs of concept into properly engineered implementations.
- Improve our current environment with features, refactoring, and innovation
- Work with other data engineers on designs and code reviews.
- Work with security teams to ensure that all servers, platforms, and other resources meet security requirements.
Requirements
- Expert skills in Java or Python
- Experience developing sophisticated data pipelines in cloud-based environments (e.g. AWS) using scalable data processing tools (e.g. Apache Spark)
- Demonstrated ability to work with others, particularly providing guidance to other data
- Ability to communicate around complex ideas and topics in English with both technical and non-technical individuals.
Nice to Have
- Familiarity with Agile methodologies
- DevOps skills, especially CI/CD experience
- Configuring and maintaining cloud-based cluster computing resources and orchestration systems (e.g. EC2 instances, Kubernetes clusters, Elastic Beanstalk)
