Job brief
We are seeking to hire a Data Engineer to build and maintain data systems while ensuring each dataset is easy to analyze. A great part of the role will also revolve around improving data quality and efficiency.
Responsibilities
- Collaborate with the team to define the requirements for each task.
- Analyze, combine, and prepare raw data according to business requirements and design specifications.
- Design and build data pipelines and ETL processes.
- Reformulate existing frameworks to improve data quality and reliability.
- Conduct complex data analysis and generate standard reports as well as ad hoc reports.
- Collaborate with data scientists when needed.
- Document all processes and reports.Implements data quality monitoring methods and systems to ensure that production data is always accurate and available to key stakeholders and business processes that rely on it.
- Develop a long-term data platform architectural plan in collaboration with all business divisions and engineering teams.
Requirements
- Bachelor's degree in Data Engineering, Computer Engineering, or related field
- Proven experience as a Data Engineer or similar
- Experience with industry-standard ETL and data pipeline tools like AWS Glue, Kinesis, Power BI, Pentaho, Clover, SSRS
- Experience with both relational and non-relational databases (Postgres, MySQL, MSSQL, etc)
- Hands-on experience working with languages such as Python, Java, Scala, GoLang, shell scripting, etc
- Familiarity with data processing frameworks such as Spark, Hadoop, etc
- Excellent analytical and problem-solving skills
.webp)
.webp){kind=logo}
.webp)
.png){kind=small}
