senior data engineer (Seattle OR Remote)

About the job

From the beginning, Starbucks set out to be a different kind of company. One that not only celebrated coffee and the rich tradition, but that also brought a feeling of connection.

As a Senior Data Engineer, is responsible for design, development, testing and support for data pipelines to enable continuous data processing for data exploration, data preparation and real-time business analytics.

As a Senior Data Engineer, You Will

Design, architect, and build data pipelines and data lakes, and develop data products and features for integration with existing cloud platform.

• Design and build cutting-edge, multi-microservice solutions to support Starbucks’s growth worldwide. Collaborate with development teams and other Starbucks Technology team developer leads to initiate process improvements for new and existing systems through data analytics.
• Drive deployment approach, including planning and execution, data conversion approach, script development and execution, warranty period, and transition of the solution to the platform’s operational context.
• Extract data from various database and perform exploratory data analysis including cleansing, processing, and aggregating data. Maintain high-performance and scalable data ingestion pipelines for analytics solutions. Maintain big data technologies, including Spark, Hive, and Hadoop.
• Ensure security and authorization practices are developed and followed to protect sensitive personal data. Employ scaling and automation to data preparation techniques.
• Perform requirements gathering and backlog refinement, lead shaping and guiding systems approach, drive project initiation, contribute to functional design, and lead technical design and development.
• Implement secure practices in building and deploying applications in cloud.
• Deploy recommended systems/platform using container and microservice technologies. Lead deployment approach, including planning and execution, data conversion approach, script development and execution, warranty period, and transition of the solution to the platform’s operational context.

Provide analytic support, including code documentation, data transformation, and algorithms to Starbucks Technology teams to implement analytic insights and recommendations into business processes.

• Work with data engineering team to build and support non-interactive (batch, distributed) and real-time, highly available data, data pipeline, and technology capabilities, including cluster analysis, network analysis and anomaly detection.
• Analyze, design, develop, and implement solutions in Oracle Exadata, Oracle Big Data Appliance (BDA), and Azure using Procedural Language/Structured Query Language (PLSQL), Spark, and relevant technologies (Python, Scala, Hadoop, Parquet).
• Architect and build large scale data pipelines using orchestration tools, including Airflow and Continuous Integration (CI) tools, including Jenkins, Hudson, Sonar, and Maven. Implement relevant cloud-based (Azure or AWS) technologies.
• Design and develop solutions to integrate disparate data sources into a consistent data product. Support system and integration testing activities, initiate design reviews for new applications, ensure they adhere to software development standards.

Work with infrastructure provisioning and configuration tools to develop scripts to automate deployment of physical and virtual environments and develop tools to monitor usage of virtual resources. Provide support and resolution for escalated software application issues.

• Code, test, debug, document, and implement complex software applications; and create more complex prototypes and ensure deliverables are high quality and meet user expectations.
• Initiate and lead root cause analysis efforts to identify and implement solutions to operational issues. Design and develop solutions to integrate disparate data sources into a consistent data product.
• Develop scripts to automate deployment of physical and virtual environments and develop tools to monitor usage of virtual resources by utilizing infrastructure provisioning and configuration tools.
• Develop and maintain documentation related to all assigned systems and projects to support training, system administration, deployment, and operational processes and procedures. Lead and train partners in diagnosing, troubleshooting and remediating incidents and problems to support end-user community.
• Attend daily scrum meetings and provide update on tasks assigned in current sprint.

We’d Love To Hear From People With

Bachelor’s or Master’s degree in computer science, management information systems, or related discipline, or equivalent work experience

We are looking for strong hands-on knowledge in the following:

• Strong/expert Spark in a Cloud environment, Azure preferred
• Hands on data pipeline development, ingest patterns
• Strong knowledge in NoSQL database technologies
• Core understanding of Distributed database systems
• Distributed Analytical processing
• Python and or Scala.

Architect and design large scale high performance distributed systems (7-10 years)

SQL Platform (7-10 years)

No-SQL Platform (3+ years)

Spark (3+ years)

Data platform implementation on Azure or AWS (3+ years)

CI/CD experience (2+ years)

Exposure to SOA architecture (2+ years)

Join us and be part of something bigger. Apply today!

Starbucks and its brands are an equal opportunity employer of all qualified individuals.

Qualified applicants with criminal histories will be considered for employment in a manner consistent with all federal state and local ordinances. Starbucks Corporation is committed to offering reasonable accommodations to job applicants with disabilities. If you need assistance or an accommodation due to a disability, please contact us at 206-318-0660 or via email at [email protected]