Principal Data Engineer

Job Details

Description

The Principal Data Engineer will work with stakeholders – both business and technology organization teams, to gather functional and non-functional requirements, derive data requirements, drive data security, define and develop data models for cloud and on-prem systems, and build data pipelines. The Data Engineer role will work closely with other Architects, Innovation Specialists, Data Owners, Data Stewards, Product Owners, Data Engineers, BI Developers, and Infrastructure teams to implement data solutions with optimized performance.

Work location: 
This position can be located at our headquarters in Tulsa, OK or remotely in the states where we operate (Arkansas, Colorado, Georgia, Illinois, Iowa, Kansas, Louisiana, Minnesota, Missouri, Nebraska, New Mexico, North Carolina, Oklahoma, South Carolina, South Dakota, Tennessee, Texas, Virginia, Wisconsin, Wyoming)

Responsibilities

• Develop, maintain, and support data models, data integrations with cloud and on-prem applications, ETL/ELT & ML pipelines on Cloud-based platforms
• Leveraging Agile, CI/CD, data security and DevOps methodologies to deliver high-quality products on-time
• Building Automation tools to improve data governance components and process surveillance
• Document data processes and engineering design to enable long-term support
• Integrating DevOps in the process as we scale
• Help build data cloud architecture and assist with vendor selection
• Translate Data Science, Data Architecture, and Business requirements into effective data models, data flows and data pipelines
• Work with cloud providers to develop a macro midstream data model
• Work to identify opportunities for new data-driven products and ways to improve existing products.
• Design quality, scalable data models for business processes
• Write data aggregation and integration scripts, e.g. ETL/ELT and Stream Analytics
• Apply statistical models to classify data and develop new key performance indicators.
• Deliver data to consumers through analytics platforms.
• Decompose complex problems into simplified repeatable deliverables
• Act as a thought leader in defining data engineering / analysis methods ensuring the team continues to apply cutting-edge approaches

Knowledge Requirements

• Bachelor’s degree or equivalent working experience required
• Experience with cloud data platforms (Azure, AWS, or google)
• Experience in streaming, data wrangling and enterprise data
• Knowledge of modern data security practices
• Experience with KSQL, SQL, Python and PySpark
• 7+ years of relevant work experience in Data Modeling and/ or data management
• 5+ years of relevant work experience with ETL / ELT
• Extensive knowledge of design patterns for Data Engineering
• 5+ years developing with relational databases (MS SQL, Oracle, MySQL)
• Experience developing commercial software using Object Oriented Technologies
• Database/Data Warehouse experience
• Experience with business intelligence tools.
• Strong quantitative skills (mathematics/statistics).
• Experience designing relational and dimensional data models

Additional requirements: Regular attendance; the ability to communicate effectively orally and in writing in English with co- workers, supervisors, internal and external customers; the ability to work in stressful conditions; the ability to adapt and respond in changing circumstances; the ability to use a personal computer with the Windows(R) operating system to complete time sheets, send and receive email, and access information posted on the Company‘s intranet; availability as needed to work on both a scheduled and call-out basis; and the ability to work at the assigned job site. The above statements are intended to describe the general nature and level of work being performed by employees assigned to this job. They are not intended to be an exhaustive list of all responsibilities, duties, skills, or working conditions.

Magellan Midstream Holdings GP, LLC is an Equal Opportunity Employer and we do not discriminate against applicants due to race, ethnicity, gender, age, religion, national origin, veteran status, sexual orientation, sex, gender identity, or on the basis of disability. All qualified applicants will receive consideration for employment.

Requisition Number: DATAE002843