Sr Data ETL Engineer

Job description

3045068
City

Evendale
Career Level

Experienced
Relocation Assistance

No
Business

GE Digital
Business Segment

Digital Technology
Function

Digital Technology
Country/Territory

United States
U.S. State, China or Canada Provinces

Ohio
Postal Code

45241
Role Summary/Purpose

The Sr Data ELT Engineer will have an exciting opportunity to work with one of the world’s largest datasets (petabyte range). Big data provides a unique challenge in all aspects of data acquisition, data enrichment, and analytics scheduling and operationalization that drives high-visibility, cross-division Aviation outcomes.
Essential Responsibilities

·  Develop data ingestion jobs in tools such as Talend to acquire, stage, and aggregate data in technologies like HAWQ, Hive, Spark, HDFS, and Greenplum

·  Use and write ETL jobs using both built-in Talend components and custom made scripts in Python, Java, and Spark

·  Develop big data ingestion jobs in Talend for relational, big data, streaming, IOT, flat file, JSON, API, and many other data sources

·  Experience with writing SQL that is able to transform, pivot, and stitch big data sets, both relational and non-relational

·  Create data ingestion ETL flows using message queueing

·  Optimize Talend jobs to reduce memory and storage consumption

·  DevOps - Responsible for data ingestion jobs during operations and upgrading, configuring, and managing the Talend and HVR platforms

·  Operate in Agile framework, creating user stories from and tasks from customer requirements to track project progress
Qualifications/Requirements

Basic Qualifications

·  Bachelor’s Degree in Computer Science / Engineering, IT, or Data Analytics from an accredited university or college

Basic Qualifications

·  Legal authorization to work in the U.S. is required. We will not sponsor individuals for employment visas, now or in the future, for this job.

·  Must be willing to travel

·  Must be willing to work out of an office located in Evendale, Ohio
Desired Characteristics

·  Experience with ETL architecture concepts or developing ETL jobs

·  Experience working with databases

·  Experience performing Talend Data Integration (Including experience implementing integration jobs in a production environment)

·  Experience working with Hadoop Big Data ecosystems and tools such as Hive, Spark, etc.

·  Excellent written and verbal communication skills, especially with product owners

·  Self-driven to learn new technology and build technical skill sets

·  Experience with Agile project delivery frameworks and participating in Scrum ceremonies

·  Experience with CDC-based enterprise data ingestion technologies (Talend or HVR)

·  Hands-on experience with streaming data architecture (Spark Streaming, message queues, etc.)

·  Hands-on proficiency in one or more scripting languages (e.g., Java, Python, Scala, R, Shell scripting)

·  Experience with Hadoop data flow tools such as Sqoop, Flume, and Nifi

·  Experience with Hadoop workflow tools such as Spark and Spark streaming

·  Experience consuming REST and WSDL services

·  Experience working with databases and hands-on proficiency in SQL

·  Familiarity with Greenplum data modeling, or MPP-style data warehouse or PostgreSQL knowledge

·  Perform development and operations duties, sometimes requiring support during off-work hours

·  Expertise with using the Linux command line

#DTR
About Us

GE is the world's Digital Industrial Company, transforming industry with software-defined machines and solutions that are connected, responsive and predictive. Through our people, leadership development, services, technology and scale, GE delivers better outcomes for global customers by speaking the language of industry.
GE offers a great work environment, professional development, challenging careers, and competitive compensation. GE is anEqual Opportunity Employer . Employment decisions are made without regard to race, color, religion, national or ethnic origin, sex, sexual orientation, gender identity or expression, age, disability, protected veteran status or other characteristics protected by law.
Additional Eligibility Qualifications

GE will only employ those who are legally authorized to work in the United States for this opening.