Cloud Data Engineer
Job Description
Job Title: Cloud Data Engineer
Work Arrangement: Hybrid flexible working
Type of Position: Permanent
We’re offering an exciting opportunity to join our team in the capacity of a Cloud Data Engineer, working with one of our esteemed clients in the Asset Management sector. Your role involves developing, deploying, and maintaining a robust automated test framework for their advanced cloud platform.
As a successful candidate, you’ll be a vital part of a dynamic team committed to delivering expansive, high-performance systems. Your responsibilities extend to ensuring a smooth transition to a DevOps lifecycle, playing a pivotal role in supporting our client’s visionary goals within Asset Management.
Job Detail:
As a Cloud Data Engineer, you’ll be responsible for designing, developing, testing, and deploying solutions for strategic projects. Your focus includes delivering high-performance systems, creating frameworks, and seamlessly transitioning to a DevOps lifecycle. Leverage your expertise to mentor, contribute hands-on work, and provide leadership in collaboration with business stakeholders.
Key Responsibilities:
- Collaborate on implementing solutions aligned with best practices and AWS Well-Architected Framework, guided by senior team members.
- Contribute to designing robust, cost-effective, fault-tolerant systems with support from experienced team members.
- Implement Cloud Architecture patterns based on approved standards, fostering innovation in simple patterns aligned with customer needs.
- Educate the team on implementing best practices and provide hands-on technical support.
- Build Data Pipelines using Python, SQL, Lambda, and Step Functions.
- Craft optimized Data Models for enhanced business usability.
- Develop and optimize data tables for performance.
- Maintain metadata for an augmented data catalogue and produce support documentation.
- Collaborate with internal business customers to troubleshoot and optimize SQL and reporting solutions.
Experience Required:
Essential:
- Prior experience in banking, Financial Asset Management, or a regulated environment is a must.
- Proven Agile/Scrum experience, delivering in sprints and collaborating effectively.
- Familiarity with AWS Serverless technologies, including Cognito, Lambda, Amazon Athena, Sage Maker, EventHub, API Gateway, and AWS Glue.
- Proficiency in JDBC/ODBC, SQL query processing, and distributed query engines.
- Advantageous skills: Previous use of Python, NodeJS, or UX Development.
- Hands-on experience with SDLC, covering Coding Standards, Code Reviews, Source Control (Bitbucket/GitHub), Build Processes, Testing, and Operations.
Desired:
- Experience in data warehousing and data modeling is advantageous.
- A background in Big Data or Machine Learning is a valuable asset.
- Experience in consultancy work is a plus.
You should be proficient in using the following to create data processing solutions:
- Azure Data Factor and/or AWS Data Pipeline
- Azure Synapse Analytics and/or Amazon Redshift or Amazon Athena
- Azure Stream Analytics and/or Amazon Kinesis Analytics
- Azure Event Hubs and/or Amazon Kinesis
- Azure Data Lake Storage and/or Amazon Simple Storage Service (S3) with appropriate configurations
- Azure Databrick and/or Amazon EMR (Elastic MapReduce)
Benefits:
- Employee bonus scheme
- Competitive salary complemented by annual pay reviews.
- Holiday package of 25 days plus bank holidays
- Engage in weekly, monthly, and yearly events, fostering a vibrant work environment
- Expenses to end client offices covered
- Prioritize your well-being with Vitality Health Insurance
- Flexitime available to support work-life balance
- Invest in your professional growth with industry-recognized qualifications provided by the company
- Experience the best of both worlds with our hybrid working model.
- Join a supportive and inclusive company culture that values diversity and teamwork
What’s Next?
We’ll review your application and contact you if we have any questions. If you’re selected to move forward in the interview process, we’ll schedule a call to learn more about your experience and qualifications.
We look forward to hearing from you!
Established in Didsbury, Connexa Technology Ltd is becoming one of the UK’s fastest growing IT and Technology recruitment companies.
People. Technology. Connected.
Connexa Technology is acting as an Employment Agency in relation to this vacancy.
