Data Engineer - Trading at Shell

Job Description:

• You will be part of a community of experts in different capabilities in Information Digital Engineering driving ideas to reality embedding AI in every part of our organisation from making our existing businesses more effective and efficient and make us competitive as we accelerate the development of the next generation of clean energy solutions.
• The Data & Engineering family is a family of data & software engineering experts who create business value every day with their cutting-edge knowledge. We maximize value from information & data, using our domain knowledge & deep technical expertise in market leading data & software engineering tools, to deliver actionable data driven insights for Shell

What’s the role

• As a data engineer, you will work closely with traders and analysts to help create data solutions in Python, Databricks and Azure, to extract, process, store and display their data, in line with best practice software engineering processes and architecture patterns. In collaboration with a quantitative engineer, you are also expected to help productionize the traders’ quantitative models into data-driven software applications.

What you’ll be doing

• You will design and build data foundations and end to end solutions for Shell to maximize value from data. You are a key person to convert Vision and Data Strategy for IT solutions and deliver them. With your knowledge you will help create data-driven thinking within the organization, not just within IT teams, but also in the wider Shell stakeholder community.

You will:

• Communicate with both technical developers and business managers and gain respect and trust of leaders and staff.
• Actively deliver the roll-out and embedding of Data Foundation initiatives in support of the key business programs advising on the technology and using leading market standard tools.
• Coordinate the change management process, incident management and problem management process.
• Ensure traceability of requirements from Data through testing and scope changes, to training and transition.
• Drive implementation efficiency and effectiveness across the pilots and future projects to minimize cost, increase speed of implementation and maximize value delivery.

What you bring

You will be an asset in our team, bringing deep technical skills and capabilities to become a key part of projects defining the data journey in Shell, keen to engage, network and innovate in collaboration with companywide teams. 

We focus on continuous learning of new technologies to make our future ready.

• Degree level in STEM, computer science, engineering, mathematics, or a relevant field of applied mathematics.
• Proven years of experience in the IT industry
• Proven technology champion in working with relational, Data warehouses databases, query authoring (SQL) as well as working familiarity with a variety of databases. Experience/Knowledge in working with NoSQL databases and can create E2E pipelines.
• Experienced in building and optimizing complex queries. Good with manipulating, processing and extracting value from large, disconnected datasets.
• Proven experience in working with (cloud-based) data engineering technologies like Azure / AWS, Databricks. Your experience in handling big data sets and big data technologies will be an asset.
• Strong Python Developer with up-to-date skills, including web development, cloud (ideally Azure), Docker, testing, DevOps (ideally terraform + GitHub actions). 
• Knowledge of application design, security, release, testing and packaging.
• Very Good understanding in Data Foundation initiatives, like Modelling, Data Quality Management, Data Governance, Data Maturity Assessments and Data Strategy in support of the key business stakeholders.
• Good understanding of math, finance, as role interacts with Quant Devs, analysts and traders.
• Experience in working with AGILE, KANBAN methodologies. Able to run a sprint.
• Ability to apply an analytical thought process and process complex information.
• Able to work in a fast-paced front office environment and communicate directly with Quant Devs, analysts and traders.
• Gas/Power Trading knowledge - Experience working in a Gas/Power trading environment, preferably LNG Trading.
• Risk - Modelling & understanding of risk & risk management.
• Quantitative modelling skills - Statistical methods to conduct analysis and develop models based on data, such as valuation models and predictive models.
• Previously created or enhanced CI/CD build and releases pipelines.
• Experience in working with scripting languages such as YAML, PowerShell, Terraform etc.
• Experience with big data tools: Kafka, Hadoop, Spark and similar technologies. Experience with stream-processing systems
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow and more.
• Certification in Azure