The job involves designing, developing, and enhancing the AWS data environment. Responsibilities include setting up AWS Data Platform, building scalable Data Lake solutions, and troubleshooting complex Data Pipelines. It requires expertise in data engineering and leading proofs-of-concept to production.
Company Description
Webtellect is an established software consulting firm. We are equivalent to the finest "custom home builders" as it applies to software. We build software for those companies who have funding but not the resources or for those companies who have the resources but not bandwidth. We analyze, design, develop, test, deploy, maintain, and learn from our engagements to improve for the next. We all share a passion and joy for software excellence. As such, Webtellect consultants are highly coveted.
Job Description
To design, development, and enhancement of our AWS data environment.
Qualifications
- Experience setting up AWS Data Platform – AWS CloudFormation, DevelopmentEndPoints, AWS Glue, EMR and Jupyter/Sagemaker Notebooks, Redshift, S3, and EC2 instances.
- Track record of successfully building scalable Data Lake solutions that connects to distributed data storage using multiple data connectors.
- Must have a background in data engineering – Data Warehouse Development experience would be perfect
- Must have strong skills in SQL, Python, PySpark, and AWS
- Experience in designing, developing, optimizing and troubleshooting complex Data Pipelines using Spark cluster
- Ability to lead proofs-of-concepts and then effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialization.
- Serve as an expert; envision and integrate emerging data technologies, anticipate new trends to solve complex business and technical problems.
Additional Information
Notes:
- 6 month contract.
- ** No 3rd parties. **
- ** No Visas allowed **
Top Skills
AWS
Pyspark
Python
SQL
Similar Jobs
Cloud • Information Technology
The Cloud Data Engineer will work alongside the Data Architect and client data professionals to develop solutions involving data migration, modeling, and optimization. Responsibilities include implementing ETL/data pipelines, maintaining data loading activities, and resolving issues related to identity and access management. A strong background in AWS technologies and SQL is essential.
Top Skills:
AWSPythonSQL
Healthtech • Pharmaceutical
As a Principal Data & Integration AWS Engineer, you will lead agile software development, ensure data governance, and contribute to strategy alignment. Responsibilities include hands-on coding, team management, project monitoring, and providing performance insights to management. You will mentor staff and assist with budgeting while responding to audits and RFP processes.
Top Skills:
AWSSQL
Insurance • Legal Tech • Social Impact
As a Data Scientist at Atticus, you will help build a data-driven culture, designing metrics, building data pipelines, conducting experiments, and launching models to improve client outcomes and support decision-making. Your role will involve collaborating with cross-functional teams and contributing to product insights that enhance user experiences.
Top Skills:
PythonRSQL
What you need to know about the Manchester Tech Scene
Home to a £5 billion digital ecosystem, including MediaCity, which consists of major players like the BBC, ITV and Ericsson, Manchester is one of the U.K.'s top digital tech hubs, at the forefront of advancements in film, television and emerging sectors like as e-sports, while also fostering a community of professionals dedicated to pushing creative and technological boundaries.
