Data Engineer
Internship Wrocław, POLAND
Job description
EY Global Delivery Services means 31.000 specialists providing globally IT, HR, finance, project management and strategic business services to EY member firms. In addition we deliver support and solutions to clients from all over the world.
The opportunity
As a Data Engineer, you will be responsible for building and optimizing our data pipeline architecture. The ideal candidate is an experienced data pipeline builder, with expertise in working with large data sets. The Data Engineer will support our software developers, architects, and DevOps team on data initiatives. Ability to work in an Agile/Scrum model.
Your key responsibilities
·
Create, build and deploy data pipelines that clean and process data for analysis
·
Build reusable component pipelines that can be assembled for more complex pipelines
·
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
·
Work with structured and unstructured data sets
·
Work with QA to develop an automation test strategy for data pipelines that aligns with the platform’s architecture
Skills and attributer for success
·
5+ years’ experience as a Data Engineer
·
Experience with big data tools: Apache NiFi, Hadoop, Spark, Kafka, etc.
·
Experience with the Cloudera technology stack
·
Knowledge of relational SQL and NoSQL databases, including Postgres and Cassandra
·
Use of with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
·
Experience with public cloud services: SCP
·
Knowledge of stream-processing systems: Storm, Spark-Streaming, etc.
·
Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
What working at EY GDS offers
In EY GDS you can count on stable employment and upgrading your career. You will meet people and gain important knowledge and insights that will stay with you throughout your professional life.
If you can confidently demonstrate that you meet the criteria above, please contact us as soon as possible.
Make your mark.
Apply now.