Big Data Developer Python Scala Spark in Constanţa

Do you care about the quality of your healthcare? So do we! Become a key team member and revolutionize healthcare data engineering platforms. Warsaw-based opportunity with the possibility to work 100% remote  As a  Senior Big Data Engineer,  you will join our Client, a leading global provider of advanced analytics, innovative technology solutions, and unique clinical research services to the life sciences industry. You will be working collaboratively with the team to design, develop, and support data engineering solutions. The platform for solutions helps solve complex business challenges pertaining to healthcare data such as mapping a wide variety of healthcare diagnosis data to standard coding frames. You will have the opportunity to solve complex engineering challenges and develop innovative solutions Your main responsibilities:  Build pipelines for processing big amounts of medical data Participate in system design, development, deployment and maintenance  Configuration and prototyping of new systems  Conduct peer code reviews  Consistently and proactively expanding knowledge, network, and know-how to incorporate new thinking into current processes/products/tools/methods  Contribute to the definition and adoption of technical standards  Work closely with the data analysts to identify and provide the required data  Create comprehensive automated unit and integration tests  As an ideal candidate, you have:  6+ years of experience in data engineering, ETL design and implementation    Experience with batch processing (3+ years) Demonstrate commercial experience with Databricks and Azure cloud Experience with Python (3+ years)  Familiarity with data analysis, profiling, integration and reporting (2+ years)  Excellent knowledge about SQL and Scala (4+ years)  Experience with Apache Spark, Kafka, Flink and HDFS   Great analytical and troubleshooting skills  Bachelor’s Degree in Computer Science or another related field Familiarity with Agile methodologies We offer you: ITDS Business Consultants is involved in many various, innovative and professional IT projects for international companies in Europe. We offer an environment for professional, ambitious, and driven people. The offer includes: Stable and long-term cooperation with very good conditions  Enhance your skills and develop your expertise in different industries Work on the most strategic projects available in the market Define your career roadmap and develop yourself in the best and fastest possible way by delivering strategic projects for different clients of ITDS over several years Participate in Social Events, training, and work in an international environment Access to attractive Medical Package Access to Multisport Program Access to Pluralsight Flexible hours & remote work Internal number #4668