Data Engineer, Network Capacity Services
DESCRIPTION
AWS is one of the world’s largest and most highly-available networks, that continuously grows year over year, increasing in complexity and criticality. Scaling the network to meet user’s demand is a unique challenge: Network Capacity Services (NCS) builds the infrastructure to manage the demand forecast and the planning of the future state of the network. We own the software system that predicts future needs, elaborates where new network infrastructure has to be deployed, and builds the plan according to physical constraints. The complexity, size, and speed of growth reflect on the software we develop and operate, which must fit the need of a mission critical function for AWS.
We are looking for a Data Engineer to build the data pipelines and centralised data store for applications within the NCS organisation which supports the scaling of one of the world’s largest and most complex networks. Our customers rely on Amazon’s network for their success and our data engineers supports building a cost-effective and unconstrained network by transforming and ingesting data into the datastore and producing metrics and insights for data-driven network planning. Within the NCS team, you will champion frameworks that empower our internal customers to seamlessly consume network planning data. The ideal candidate possesses a robust understanding of data modelling concepts. Continual acquisition of expertise, iterative approaches, and adaptability are key facets of this role. We seek individuals deeply committed to pragmatic problem-solving and unafraid to pioneer new territories. Your ability to craft extendable designs and maintainable technical solutions while keeping long-term visions in focus will be paramount.
You’ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You’ll collaborate with people across AWS to help us deliver the highest standards while providing seemingly infinite capacity at the lowest possible cost for our customers. And you’ll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion.
Key job responsibilities
Be part of a high-bar, agile team with global responsibility and build infrastructure to enable data-driven network planning.
Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using AWS big data technologies.
Explore and learn the latest technologies to provide new capabilities and increased efficiency
Collaborate with Data Scientists and Business Intelligence Engineers (BIEs) to recognise and help adopt best practices in reporting and analysis and help users make the most out of the data for their decision making.
BASIC QUALIFICATIONS
- Experience in data engineering
- Experience with data modeling, warehousing and building ETL pipelines
- Knowledge of distributed systems as it pertains to data storage and computing
- Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence
PREFERRED QUALIFICATIONS
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice (https://www.amazon.jobs/en/privacy_page) to know more about how we collect, use and transfer the personal data of our candidates.
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/content/en/how-we-hire/accommodations.