Sr. Language Data Scientist, Alexa Customer Journeys
DESCRIPTION
The Alexa Customer Journeys team is seeking a Sr. Language Data Scientist with experience in the field of Natural Language Processing, Machine Learning, or Large Language Models, expertise in handling large data sets, and strong analytic skills. You will play a critical role in innovative projects by driving design of Alexa features. The key responsibilities are to generate high-quality data and to run and evaluate experiments, which involves prompt engineering our Large Language Model for API delivery. You will work closely with engineers, scientists and program managers to ensure we're providing the best Alexa experience for millions of our customers.
As a Sr. Language Data Scientist, you will start by diving deep into a couple of critical projects across Alexa experiences . You will collaborate with fellow language data scientists, program managers, as well as stakeholders in science, engineering, and product teams to understand the role data plays in developing data sets and exemplars that meet customer needs. You will analyze and automate processes for collecting and annotating LLM inputs and outputs to assess data quality and measurement.
You will apply state-of-the-art Generative AI techniques to analyze how well our data represents human language and run experiments to gauge downstream interactions. You will work collaboratively with other language data scientists and scientists to design and implement principled strategies for data optimization.
Key job responsibilities
- Collaborate with Scientists and Software Engineers to help design APIs and evaluate performance of LLM
- Produce and manipulate different types of language data, analyze, and provide efficient solutions
- Design and lead a data collection; define scope and target, provide a guideline and training, guide teams cross sites to meet the quality bar, and run evaluation of data for hand off
- Engineer prompts to guide generative AI to produce desired outputs in context
- Automate operations and perform data analysis using python, or other scripting language.
- Advocate strict adherence to annotation guidelines
- Test and deploy changes to Alexa's language understanding codebase
- Identify and solve production issues that are impacting the Alexa customer experience,
- Collaborate with other linguists, scientists and designers in creating optimal solutions to elevate the customer experience
- Own the customer-facing machine learning and deterministic models for a specific domain of features
- Use modeling tools to bootstrap and test new functionalities
BASIC QUALIFICATIONS
- Bachelor's degree in operations research, applied mathematics, theoretical computer science, or equivalent
- 4+ years of data scientist or similar role involving data extraction, analysis, statistical modeling and communication experience
- Experience in Python or another scripting languages
- Experience in Natural Language Processing, Machine Learning, or Large Language Models
- Practical knowledge of version control and agile development
- Excellent communication, strong organizational skills and detail-oriented
- Comfortable working in a fast paced, highly collaborative, and dynamic work environment
- Ability to work in a fast-paced and rapidly-changing environment
- Experience managing multiple competing priorities and projects
- Experience with reporting tools like Tableau or other BI packages
PREFERRED QUALIFICATIONS
- Master's degree in a quantitative field such as statistics, mathematics, data science, business analytics, economics, finance, engineering, or computer science
- Experience as a leader and mentor on a data science team
- Experience using very large datasets
- Knowledge of scripting for automation (e.g., Python, Perl, Ruby)
- Familiarity with Java for debugging & following code
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, disability, age, or other legally protected status. If you would like to request an accommodation, please notify your Recruiter.
The base salary for this position ranges from $143,200/year up to $239,100/year. Salary is based on a number of factors and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. Applicants should apply via our internal or external career site.