Инженер по работе с данными, Москва Ленинградский пр.
RUSSIA
Job description
Обязанности:
· Support development of ETL data pipelines, including designing, data modelling, coding, testing, scalability, operability, and ongoing metrics.
· Collaborate with product manager, business stakeholders, BI engineers, data analysts, data scientists, IT to deliver sustainable and quality results
· Partner with Sector team to leverage global solutions and best practices
· Build tools and libraries that reduce new pipeline development time
· Create metrics to measure the quality and validity of 2nd and 3rd party vendor data
· Research and document data abnormalities and track them as bugs with the engineering teams responsible Требования:
· Bachelor’s Degree (Computer Science or related preferred)
· 2+ years of professional experience using Python or similar programming language
· Knowledge of engineering best practices for the full software development life cycle, including coding standards, code reviews, source control management, continuous integrations, testing, and operations
· RDBMS databases and SQL language
· Microsoft Azure stack, AWS and GCP is a plus
· Nice to have: Knowledge of Web Scraping, Airflow, Kubernetes and Docker