Data Engineer in Constanţa

SQL (advanced) Azure (advanced) Python (advanced) W Square One Resources już od ponad 20 lat pomagamy firmom zarządzać procesami rekrutacyjnymi na szeroką skalę. Nasze biura zlokalizowane są w Londynie i Warszawie, ale relacje nawiązujemy z klientami z całego świata, od start-upów po globalne korporacje. Poza dobrymi relacjami z naszymi partnerami, dbamy również o naszych kandydatów, zapewniając im możliwość rozwoju zawodowego. Tworzymy zgrany zespół i szukamy osób, które pomogą mu się rozwijać i budować zespoły IT. Poznaj nas na: www.squareoneresources.pl We are currently recruiting for the position of: Data Engineer PROJECT: As part of the team, you will work on supporting data analysis pipelines in clinical trials in PD. Your work will be focused on times series data and surveys collected from PD subjects performing standardized activities on a smartphone remotely, and processing large amounts of passive monitoring data collected remotely by PD patients in clinical trials. RESPONSIBILITIES: Support the different stakeholders (project managers, clinical scientists, software/IT engineers, data scientists) with data engineering expertise. Create and maintain optimal data pipeline architecture Identify, design, and implement internal process improvements: automating manual processes, optimizing analysis reproducibility, results delivery, re-designing infrastructure for greater scalability, etc. Build analytics tools that utilize the data pipeline to provide actionable insights into treatment effect, disease progression, test compliance and other key metrics. Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. TECHNOLOGIES STACK: Expert knowledge of Python, in particular pandas library Proficient with Azure cloud environment and data processing on Azure Previous experience with visualization tools (e.g. matplotlib, seaborn, plotly) Being able to discuss with and understand various stakeholders (software engineers, data scientists, …) Strong analytical skills combined with conceptual thinking and structured working style Sound knowledge of best software development practices: unit testing, documentation, version control Proficiency in use of linux/bash 4+ years of working with programming language focused on data pipelines,eg. Python or R4+ years of experience working with SQLexperience with different types of storage (filesystem, relation, MPP, NoSQL) and working with various kinds of data (structured, unstructured, metrics, logs, etc.)experience in working in data architecture concepts (in any of following areas data modeling, metadata mng., workflow management, ETL/ELT, real-time streaming, data quality, distributed systems) cloud technologies with emphasis on data pipelines (Airflow, Glue, Dataflow - but also other smart solutions of handling data in the cloud - elastic, redshift, bigquery, lambda, s3, EBS etc.)1+ years of experience in Java and/or ScalaVery good knowledge of data serialization languages such as JSON, XML, YAMLExcellent knowledge of Git, Gitflow and DevOps tools (e.g. Docker, Bamboo, Jenkins, TerraformExcellent knowledge of Unix OFFER:Remote workB2B ContractInternational projectsLong-term cooperation