Data Engineer II
Alpharetta, USA Teaching
Job description
EY is a global leader in assurance, tax, transaction and advisory services. Technology is at the heart of what we do and deliver at EY. Technology solutions are integrated in the client services we deliver and are key to our innovation as an organization.
Fueled by strategic investment in technology and innovation, Client Technology seeks to drive growth opportunities and solve complex business problems for our clients through building a robust platform for business and powerful product engine that are vital to innovation at scale. As part of Client Technology, you’ll work with technologists and business experts, blending EY’s deep industry knowledge and innovative ideas with our platforms, capabilities, and technical expertise. As a catalyst for change and growth, you’ll be at the forefront of integrating emerging technologies from AI to Data Analytics into every corner of what we do at EY. That means more growth for you, exciting learning opportunities, career choices, and the chance to make a real impact.
The project
This open role is for an integrated data platform that allows different service lines to perform various data management activities including onboard data, perform data ingestion, data processing, mapping to centralized taxonomy and then consume data for their respective product offering needs to support their clients. There is also potential to collaborate on additional platforms and offerings within the Client Technology group.
The selected candidate
• Leads the delivery of processes to extract, transform and load data from disparate sources into a form that is consumable by analytics processes, for projects with moderate complexity, using strong technical capabilities
• Designs, develops and produces data models of relatively high complexity, leveraging a sound understanding of data modelling standards to ensure high quality
• Builds networks with other departments across the business to help define and deliver business value, and may interface and communicate with program teams, management and stakeholders as required to deliver small to medium-sized projects
• Applies advanced big data concepts to ingest, process and transform data and store data in variety storage technologies
• Applies Graph and AI/ML to data and data components supporting business requirements
Your key responsibilities include
• Leading the production of high-quality data engineering deliverables, helping to ensure project timelines are met, and providing informal mentoring / training to junior members of the team
• Leading the delivery of data quality reviews including data cleansing where required to ensure integrity and quality
• Leading the delivery of data models, data storage models and data migration to manage data within the organization, for a small to medium-sized project
• Resolving escalated design and implementation issues with moderate to high complexity
• Analyzing the latest industry trends such as cloud computing and distributed processing and beginning to infer risks and benefits of their use in business
• Providing technical expertise to maximize value from current applications, solutions, infrastructure and emerging technologies and seek to continuously improve internal processes
• Developing working relationships with peers across other engineering teams and beginning to collaborate to develop leading data engineering solutions
• Driving adherence to the relevant data engineering and data modelling processes, procedures and standards
Skills and attributes for success
• Batch and Event Processing - Capability to design an efficient way of processing high volumes of data where a group of transactions is collected over a period of time or on an event driven method
• Data Integration (Sourcing, Storage and Migration) - Capability to design and implement models, capabilities and solutions to manage data within the enterprise (structured and unstructured, data archiving principles, data warehousing, data sourcing, etc.). This includes the data models, storage requirements and migration of data from one system to another
• Data Quality, Profiling and Cleansing - Capability to review (profile) a data set to establish its quality against a defined set of parameters and to highlight data where corrective action (cleansing) is required to remediate the data
• Data Services - Experience building data services with asynchronous calls to data sources. Using functional and reactive programming features in modern java and open source libraries
Intermediate understanding of the following tools and technologies, and how to apply them to solve business problems
Essential:
• Experience with Spring Boot, Spring Cloud, Kafka, EventHub
• Good knowledge of Docker / Containers and Event Driven Architectures
• Expertise with Azure functions, Azure Key Vault integration, Azure blob storage configurations
• Hands-on experience with Azure Databricks, Delta Lake, Azure Functions, Azure Data Factory
• Hands-on experience in developing AI/ML algorithms to detect data anomalies and patterns using Python, R and similar technologies
• Expertise with Graph Databases - Azure Cosmos/Gremlin, Neo4j, Spark GraphFrames
• Expertise in NoSQL Databases – CosmosDB, MongoDB
• Expertise in index, search and exploration using Elastic
• Hands-on experience with Programming Languages – Java, Node.js, Python, R, SQL, XML
• Relational SMP Databases – Azure SQL PaaS, PostgreSQL, Synapse
Nice to have:
• APIGEE, AKS
• Azure Cognitive Services, Databricks MLFlow is a big plus
• Elasticsearch, Kibana
Education
• B.S. in Actuarial, Behavior Economics, Computer Science, Data Analytics, Data Science, Econometrics, Engineering, IT, Cyber Security, or related field preferred
What we look for
• Strong analytical skills and problem-solving ability
• A self-starter, independent-thinker, curious and creative person with ambition and passion
• Excellent inter-personal, communication, collaboration, and presentation skills
• Customer focused
• Excellent time management skills
• Positive and constructive minded
• Takes responsibility for continuous self-learning
• Takes the lead and makes decisions in critical times and tough circumstances
• Attention to detail
• High levels of integrity and honesty
What working at EY offers
We offer a competitive remuneration package where you’ll be rewarded for your individual and team performance. Our comprehensive Total Rewards package includes support for flexible working and career development, and with FlexEY you can select benefits that suit your needs, covering holidays, health and well-being, insurance, savings and a wide range of discounts, offers and promotions. Plus, we offer:
• Support, coaching and feedback from some of the most engaging colleagues around
• Opportunities to develop new skills and progress your career
• The freedom and flexibility to handle your role in a way that’s right for you
EY is committed to being an inclusive employer and we are happy to consider flexible working arrangements. We strive to achieve the right balance for our people, enabling us to deliver excellent client service whilst allowing you to build your career without sacrificing your personal priorities.
About EY
As a global leader in assurance, tax, transaction and advisory services, we’re using the finance products, expertise and systems we’ve developed to build a better working world. That starts with a culture that believes in giving you the training, opportunities and creative freedom to make things better. Whenever you join, however long you stay, the exceptional EY experience lasts a lifetime.
If you can confidently demonstrate that you meet the criteria above, please contact us as soon as possible.
Make your mark.
Apply now.
EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, national origin, protected veteran status, disability status, or any other legally protected basis, in accordance with applicable law.