Data Engineer, Davengers(Data Avengers)
DESCRIPTION
This is a 12 Month Contract opportunity.
As a data engineer are you looking for opportunity to be among software developers, machine learning scientists to build a data platform that not only caters to BI and reporting but also extends to machine learning applications?
As a data engineer in AEE, you will: - Design, implement and support an analytical data infrastructure serving both business intelligence and machine learning applications. This is a 12 Month Contract opportunity.
- Managing AWS resources including EC2,Redshift,EMR-Spark etc
- Collaborate with Product Managers, Financial and Business analysts to recognize and help adopt best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies
- Explore and learn the latest AWS technologies to provide new capabilities and increase efficiency
- Collaborate with other tech teams to implement advanced analytics algorithms that exploit our rich datasets for statistical analysis, prediction, clustering and machine learning
- Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers
BASIC QUALIFICATIONS
- 1+ years of data engineering experience
- Experience with SQL
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
- Experience with one or more scripting language (e.g., Python, KornShell)
PREFERRED QUALIFICATIONS
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.