Software Development Engineer, Big Data Technologies - EDC - Othrys
DESCRIPTION
Come join us in creating a singular analytical data platform that caters to all of Amazon's business and offer them accelerated business insights and data-driven innovation by providing trustworthy, intuitive, and cost-efficient solutions under the umbrella of compliance, security, and agility.
Amazon is big and very data driven. BDT organization launched the next generation analytics platform to make this easy at an Amazon scale.
We are expanding our new data lake marketplace for data producers and consumers across amazon to easily and securely share large volumes of analytical data, run massively parallel analytics and share the gained insights.
As part of the BDT organization, we develop the core of the data lake that includes cataloging, storage, access, compliance and quality and we’re looking for top engineers to push the enevelop to all types of datasets used at amazon.
This is a hands-on position where you will be doing everything from designing and building highly scalable components and industry leading features to formulating strategy for EMR, Redshift and other AWS analytical tech at Amazon, mentor other engineers and directly work with our business partners, data engineers and analysts to help them get the best results. You need to not only be a top software developer with excellent programming skills with a stellar record of delivery but also show bias for customer obsession. You need to have a passion for very large scale databases and massively parallel computing. You will work with the latest AWS technologies in the big data space such as Sagemaker, Lake formation, Glue, Redshift, Athena to build new applications that leverage these technologies and open source framework / formats like Apache Spark, Hive, Presto, Flink, Iceberg and Hudi.
To get a better idea on the work we have done read the following use case stories:
https://aws.amazon.com/solutions/case-studies/amazon-migration-analytics/
https://aws.amazon.com/solutions/case-studies/amazon-database-migration/
Come help us build for the future of data analytics!
Key job responsibilities
Your responsibilities will include:
- Keeping your finger on the pulse of the constantly evolving and growing big data field, newer data formats, and industry standards.
- Working backwards from the customer translating complex functional and technical requirements into detailed architecture and design.
- Influencing Product direction and strategy with insights from technical and architectural perspective.
- Delivering systems and features with high quality, on time
- Stay current on technical knowledge to keep pace with rapidly changing technology, and work with the team in bringing new technologies on board
- Mentor junior engineers
- Work across teams to drive overall technical strategy.
- Deep dive into existing architecture and eliminate points of efficiency bottlenecks.
A day in the life
An SDE-2 On Othrys team begins their day with a plan that is created in advance and tracked over a 2 week sprint.
The morning is spent meeting LT, and other engineers to collaborate on cross cutting projects.
After lunch Othrys SDEs share their progress and brainstorming during daily stand-up.
Afternoons are spent focused on individual tasks and 1:1s. (With a coffee break at time of choice.)
Othrys SDEs participate in fortnightly backlog grooming and sprint planning activities.
Othrys Oncall focuses on hosting office-hours and Operational reviews, responding to user questions, and mitigating operational issues (<1 critical issue per week).
About the team
The Othrys team owns the charter to register external (to Andes) datasets into Andes, keeping them in sync with the source and making them available to data consumers. We handle the complexity of managing consumers and consumption paths on behalf of dataset owners, and also protect consumers from breaking changes made by dataset owners.
We explore the frontier of analytical assets of all types and build streamlined onboarding pathways for them to be integrated into Andes, allowing these assets to benefit from Andes' features. Our team comprises 3 SDE1, 2 experienced SDE2, and 1 tenured SDE3 professional, with access to Principle Engineers within our immediate organizational group.
BASIC QUALIFICATIONS
- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- 3+ years of computer science fundamentals (object-oriented design, data structures, algorithm design, problem solving and complexity analysis) experience
- 3+ years of programming using a modern programming language such as Java, C++, or C#, including object-oriented design experience
- Bachelor's degree in computer science or equivalent
- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Strong Communication skills (written and Verbal)
PREFERRED QUALIFICATIONS
- Master's degree in computer science or equivalent
- 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- 5+ years of computer science fundamentals (object-oriented design, data structures, algorithm design, problem solving and complexity analysis) experience
- 5+ years of programming using a modern programming language such as Java, C++, or C#, including object-oriented design experience
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $129,300/year in our lowest geographic market up to $223,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.