Job Description
We are looking for a highly motivated Senior Data Engineer to join our team.
If you consider yourself a flexible and proactive person and want to face new professional challenges, send us your application! We look forward to being part of your growth and we will certainly build a successful future together!
Technical skills
- Knowledge of Spark and Delta: The candidate should have experience and familiarity with using Spark and Delta for data processing and analysis
- Technical depth: The hiring manager expects the candidate to possess a strong technical understanding and depth in areas such as databases, testing, and performance tuning
- Data modelling concepts: The candidate should have a good understanding of data modelling principles and concepts
- Experience with SQL Server/Synapse: Knowledge and experience working with SQL Server or Synapse (formerly known as SQL Data Warehouse) is desired
- Familiarity with unit testing: The candidate should have knowledge and experience in implementing unit testing practices for their code, rather than relying solely on manual testing
- Python skills: Proficiency in Python programming is expected, as it is used for SQLbased + transformations and other tasks
- CI/CD knowledge: Understanding of Continuous Integration/Continuous Deployment (CI/CD) processes and its implementation is desired
- Experience with performance tuning: The candidate should have knowledge and practical experience in optimizing performance for data processing tasks
- Understanding of indexing and partitioning: Familiarity with indexing and partitioning concepts for optimizing data access and query performance is expected
- Familiarity with ADF pipelines: The candidate should be comfortable with Azure Data Factory (ADF) pipelines and have experience in monitoring and managing them
- Additional knowledge of CDL, Python-based Spark, and monitoring ADF pipelines
Personal skills
- Team spirit and mutual support
- Good communication and interpersonal skills
- Critical thinking and analytical skills
Are you interested in this opportunity?
Send us your CV
