Junior Data Engineer in Bucuresti

Job Description We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages. If you are detail-oriented, with excellent organizational skills and experience in this field, we’d like to hear from you. Responsibilities Big data processing/ETL pipelines Cleansing, parsing and standardising global datasets Data classification Entity extraction/resolution Pre-packaged code for processing and utilising third party data sources Efficiency/performance improvements through big data testing Requirements and skills We’re looking for individuals who have proven big data experience, either from a software deployment/implementation or a data science perspective Knowledge of at least one big data technology such as Spark, Hadoop or Elasticsearch A strong coding background in either Java, Python or Scala The desire to learn and code in Spark/Scala Experience working in an Agile environment Experience of building data processing pipelines for use in production batch systems, including either traditional ETL pipelines and/or analytics pipelines Experience in manipulating data through cleansing, parsing, standardising etc, especially in relation to improving data quality/integrity