Senior Data Engineer in Constanţa

Distributed systems (regular) Python (regular) ETL (advanced) AWS (advanced) Redshift (advanced) SQL (advanced) Snowflake (advanced) ROLE OVERVIEW Brainly is scaling! We are looking for an experienced, highly motivated Senior Data Engineer to join our Search Team and help us build data infrastructure that will enable scaling and improvement of Brainly’s search ecosystem. You will be working with a team of engineers and data scientists on problems spanning from data ingestion, operating platform at scale, and experimenting on information retrieval algorithms and relevance tuning. Your areas of expertise will help us mostly in these areas:Developing efficient data ingestion and transformation from multiple sourcesBuilding and enhancing data pipelines for search quality monitoring Are you a goal-driven team player? Do you like tackling new challenges using leading-edge industry tools? Can you adapt to rapidly changing conditions while learning and bettering yourself? Are you a detail-oriented expert who loves focusing on quality? If you answered yes to these questions, you might just be the perfect candidate for this role!  WHAT YOU’LL DODesign, develop and own operational data solutions for gathering and preparing data sets for further usage by search engineers and data scientistsDesign, develop and own reporting data solutions for further understanding Brainly search and optimizing processesEvaluate existing data processing architectures and identifying optimizations in terms of scalabilityWork with multiple data sources: analytics and log data Design and implement scalable ETL pipelines for providing the datasets required for rapid experimenting as well as for production use casesEstablish the data framework to be used by various search system technologiesAssemble and transform complex unstructured datasets into features that are digestible for search systems and solutionsCollaborate with other teams across the organization WHAT MAKES YOU THE PERFECT CANDIDATE4+ years of experience developing and maintaining data processing workflows and applications using one of few solutions like Matillion, AWS Glue, Apache Spark, EMR, or similar Experience with writing code in one of the programming languages (Python preferred) Hands-on experience with developing and maintaining distributed systemsUnderstanding and experience in working on streaming and batch processingSolid understanding of object-oriented and functional programmingSolid understanding, experience with designing and implementation of ETL, ELT WHAT WILL BLOW OUR MINDSExperience with Docker, Kubernetes, Terraform, and AWS EcosystemExperience with Matillion, AWS Redshift, Ascend.io, Snowflake, AWS KinesisMS degree in Computer Science, a similar technical field of study, or have equivalent practical experience WHAT YOU GET BY JOINING BRAINLYWe want to see you grow along with us – you will have 800$ per year for personal development, extra time for attending conferences and workshops, and unlimited access to an online learning platform (courses from Coursera, Udacity, Udemy, Harvard ManageMentor, and many others!)Health is important, which is why at Brainly, we fully cover private health & dental care packages for you and your family and provide you with a sport card (Multisport Plus in Poland, Andjoy in Spain) You will also get an access to online individual psychological consultations with professionals in English & Polish via the Mental Health HelplineFlexible working hours – working requires communication, so we work within the European business hours, but we also know that life may be unpredictable, so if you need to jump out of work (doctor’s appointment, emergency, anything) – no problem!Your personal concierge AskHenry will support you in your daily duties, eg. planning your dream vacationWe will provide you with all the necessary equipment & tools, including an additional budget for accessories which will make your remote setup even more comfortable.You can join internal communities and contribute to charity, diversity and inclusion initiatives, take part in great internal events or represent Brainly at conferences or meet-ups.WHAT IS BRAINLYBrainly is the online learning platform where over 350 million students and parents go from questioning to understanding. With their smartphones, users can snap a photo to instantly solve any problem or homework question and be matched with a Brainly product such as Community Q&A, Brainly Tutor, Math Solver or Textbook Detective.Brainly is built to provide students, parents, experts, and teachers with a collaborative platform and tools needed to succeed in any educational environment. Based in Kraków, Poland, with U.S. headquarters in New York City, Brainly apps and websites are visited by users from over 35 countries.Backed by Prosus, Point Nine Capital, General Catalyst, Runa Capital, Learn Capital and Kulczyk Investments. Learn more about Brainly at www.brainly.com. By sending us your application you agree that Brainly sp. z o.o. will process your personal data to participate in this recruitment process. If you want to know more about how Brainly processes your personal data please click here.