Senior Data Engineer
-
Location
Cardiff
-
Sector:
-
Job type:
-
Salary:
£60000 - £65000 per annum
-
Contact:
Jeffrey Barr
-
Email:
jbarr@yolkrecruitment.com
-
Contact phone:
02920 220078
-
Job ref:
BH-28313-3
-
Published:
almost 2 years ago
-
Expiry date:
2022-06-04
-
Start date:
2022-05-04 00:00:00
-
Consultant:
ConsultantDrop
Yolk Recruitment are on the lookout for a Senior Data Engineer to join one of our exciting and rapidly growing fintech clients.
This role gives the exciting opportunity to gain exposure to big data architecture and MPP processes.
The ideal candidate will have a passion for data-based solutions and cloud-based environments.
Reason for the role:
Expansion of the team.
Responsibilities:
- Extracting data from various data sources for example relational databases, files and API’s)
- Help evolve our data platform with a view towards growth and high throughput.
- Execute practices such as continuous integration and test-driven development to enable the rapid delivery of working code.
- Design and build metadata driven data pipeline using Python and SQL in accordance with guidelines set by the Data Architect
- Ship medium to large features independently using industry standard processing patterns
- Experience developing ETL pipelines in python
- Experience implementing data architectures in analytical data warehouses such as Snowflake, Redshift or BigQuery
- Awareness of cloud technology particularly AWS.
- Knowledge of automated delivery processes
- Comfortable working with relational databases such as Oracle, PostgreSQL, MySQL, and MariaDB (PostgreSQL preferred)
- Hands on experience with data orchestrators such as Airflow, Prefect, Dagster or Luigi (Airflow Preferred)
- Experience designing and building autonomous data pipelines
