Input Output Logo

Input Output

Senior Data Engineer - Technical Intelligence

Reposted 6 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in United Kingdom
Senior level
Remote
Hiring Remotely in United Kingdom
Senior level
The Senior Data Engineer will architect scalable pipelines on AWS, analyze blockchain data, and collaborate with leadership on data-driven decisions.
The summary above was generated by AI

Who are we?

IOG, is a technology company focused on Blockchain research and development. We are renowned for our scientific approach to blockchain development, emphasizing peer-reviewed research and formal methods to ensure security, scalability, and sustainability. Our projects include decentralized finance (DeFi), governance, and identity management, aiming to advance the capabilities and adoption of blockchain technology globally.

We invest in the unknown, applying our curiosity and desire for positive change to everything we do. By fueling creativity, innovation, and progress within our teams, our products and services are designed for people to be fearless, to be changemakers.

What the role involves:

As a Senior Data Engineer in the Technical Intelligence (TechInt) team, you will play a crucial role in shaping the company's strategic direction. The TechInt team's core function is to analyze the blockchain industry, providing leadership with data-driven insights into competitor activities, emerging trends and projects, and areas of technical innovation.

You will contribute to an automated process that leverages a data warehouse alongside machine learning (ML) and artificial intelligence (AI) on AWS to generate these insights. 

The role works closely with senior leadership and involves direct exposure to strategic decision-making, with a focus on analyzing company strategy and new venture planning from a quantitative perspective.

  • Own and drive the end-to-end data process for intelligence (business and technical), across all the ventures of the company. This involves acquiring, processing (ETL), modeling with AI/ML, and reporting. 
  • Serve as the competitive positioning expert in the blockchain landscape, responsible for providing data insights that fulfill stakeholder requirements.
  • Architect and build performant and scalable data engineering pipelines using AWS. Drive the data system design, modeling, data quality, and delivery. 
  • Work with senior leadership and stakeholders to understand data value, define key metrics for competitive positioning, and gather requirements. Work closely with data engineers and analysts to deliver the agreed-upon requirements.
  • Work with data scientists, ML, and AI engineers to operationalize models and integrate LLM-related logic into data pipelines.
  • Use Scrum methodologies to drive prioritization, planning, and execution of tasks for the data intelligence team.

Requirements

Who you are:

  • A MSc/PhD in Computer Science, AI, or a related field is a strong plus.
  • Typically 7+ years of professional experience in data engineering or data science.
  • Expertise in data modeling and data warehousing, including building and optimizing data schemas and data lakes.
  • Hands-on experience specifically with AWS data services like Glue, Redshift, S3, Lambda, Athena.
  • Advanced proficiency in Python, SQL, PySpark.
  • Hands-on experience with big data frameworks like Apache Spark, DBT, workflow orchestration tools like Apache Airflow or AWS Step Functions, and Infrastructure-as-Code like CloudFormation or Terraform.
  • Hands-on experience with MLOps in operationalizing machine learning models in production.
  • Experience leading and mentoring data engineers and driving data system projects from conception to completion.
  • Solid critical thinking, research, and problem-solving skills, with the ability to quickly grasp any data-related domain. 
  • Solid foundation of large-scale data systems, including data warehousing and data processing, including parallel processing, data partitioning, cost efficiency.
  • Solid data programming covering algorithms, data structures, design patterns, and relational databases.
  • Solid software development practices, version control, testing, and CI/CD.
  • Knowledge of Machine Learning (ML), Natural Language Processing (NLP), or Deep Learning (DL).
  • Knowledge of the Blockchain domain and passionate about gaining further breadth and depth of the domain.

Benefits
  • Remote work
  • Laptop reimbursement
  • New starter package to buy hardware essentials (headphones, monitor, etc)
  • Learning & Development opportunities
  • Competitive PTO 

At IOG, we value diversity and always treat all employees and job applicants based on merit, qualifications, competence, and talent. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Top Skills

Apache Airflow
Spark
Aws Athena
Aws Glue
Aws Lambda
Aws Redshift
Aws S3
Aws Step Functions
CloudFormation
Dbt
Pyspark
Python
SQL
Terraform

Similar Jobs

12 Hours Ago
Remote or Hybrid
Dunstable, Bedfordshire, England, GBR
Entry level
Entry level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
The Systems Platform Engineer I supports Storage and Backup deployments, troubleshooting, maintenance, and providing technical expertise across teams while ensuring compliance and documentation.
Top Skills: BackupCohesity NetbackupDatabase Systems AdministrationDellHpPureSanStorageUnixVeritas
12 Hours Ago
In-Office or Remote
30 Locations
Senior level
Senior level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
The EMEA Sales Leader will drive the company's expansion in the region, establish sales pipelines, develop partnerships, and oversee the sales team.
Top Skills: AIB2B SaasMachine LearningSales Management
12 Hours Ago
Remote or Hybrid
28 Locations
Senior level
Senior level
Information Technology • Security • Software • Cybersecurity • App development • Data Privacy
The Director of Data & Analytics will lead a multidisciplinary team, unify the analytics strategy, and oversee data governance and platform evolution to enhance decision-making and business impact at MacPaw.
Top Skills: AIBi ToolsCRMData AnalyticsData EngineeringData WarehousesMartechMlModern Data Stacks

What you need to know about the Manchester Tech Scene

Home to a £5 billion digital ecosystem, including MediaCity, which consists of major players like the BBC, ITV and Ericsson, Manchester is one of the U.K.'s top digital tech hubs, at the forefront of advancements in film, television and emerging sectors like as e-sports, while also fostering a community of professionals dedicated to pushing creative and technological boundaries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account