Senior Data Engineer
GFL Environmental Inc.
Date: 4 days ago
City: Vaughan, ON
Contract type: Full time
We are seeking a highly skilled Data Engineer with experience in designing and maintaining real-time data streaming pipelines and building robust data lake infrastructure and architecture. The right candidate will be excited by the prospect of optimizing and building data architecture to support our next generation of products and data initiatives.
Key Responsibilities:
GFL is committed to equal opportunity for all, without regard to race, religion, color, national origin, citizenship, sex, sexual orientation, gender identity, age, veteran status, disability, genetic information, or any other protected characteristic. If you are interested in applying for employment and need special assistance or an accommodation to apply for a posted position, please contact [email protected]
Key Responsibilities:
- Design, develop, and maintain scalable, real-time and batch data pipelines using AWS Glue, Lambda, Apache Spark, and Kafka.
- Implement data lake architecture to ensure efficient data storage, processing, and retrieval.
- Collaborate with cross-functional teams to understand data requirements and ensure the data infrastructure supports their needs.
- Use Terraform to manage and provision infrastructure in a reproducible and scalable manner.
- Optimize and troubleshoot complex data pipelines, ensuring high availability and performance.
- Explore and integrate the latest technologies to enhance our data processing capabilities.
- Work in a fast-paced, startup-like environment where you will take ownership of key projects and contribute to our overall data strategy.
- 3 - 5 years of experience as an intermediate engineer with proficiency in AWS services.
- Strong programming skills in python and SQL.
- Strong experience with Apache Spark and Delta Lake for big data processing.
- Expertise in using Terraform for Infrastructure as Code (IAAC).
- Proficiency using standard DevOps tool such as Github, Azure DevOps, etc.
- Experience with Kafka and real-time data streaming pipelines along with geospatial data processing and analysis will be good to have.
- Work with complex and large datasets that will challenge and expand your skill set.
- Be part of a startup-like environment where your ideas and contributions directly impact the company's success.
- Take ownership of projects and have the autonomy to drive them from inception to completion.
- Grow your career in a fast-paced environment with plenty of opportunities to learn and work with the latest technologies.
- Collaborate with a passionate and innovative team that values your input and encourages professional growth.
GFL is committed to equal opportunity for all, without regard to race, religion, color, national origin, citizenship, sex, sexual orientation, gender identity, age, veteran status, disability, genetic information, or any other protected characteristic. If you are interested in applying for employment and need special assistance or an accommodation to apply for a posted position, please contact [email protected]
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Collections Supervisor
GFL Environmental Inc.,
Vaughan, ON
3 weeks ago
The Collection Supervisor is responsible for overseeing the collections team to ensure efficient recovery of outstanding accounts while maintaining professionalism and compliance with company policies and regulatory standards. This role requires strong leadership, problem-solving abilities, and a customer-focused approach to resolve delinquent accounts effectively.Key Responsibilities:Supervise and support the collections team, ensuring productivity and adherence to company guidelines. Monitor and analyze...
Customer Experience Manager
ASSA ABLOY Group,
Vaughan, ON
3 weeks ago
Record is a leading provider of automated pedestrian door solutions, dedicated to delivering exceptional customer experiences. We are seeking a Customer Experience Manager to enhance our customer and product support , drive efficiency in order management. This role will be instrumental in maintaining strong relationships with customers.As a Customer Experience Manager , you will serve as the primary liaison between...
Abercrombie & Fitch - Key Lead, Vaughan Mills
Abercrombie & Fitch Co.,
Vaughan, ON
3 weeks ago
Company DescriptionAbercrombie & Fitch Co. is a global, digitally led omnichannel specialty retailer of apparel and accessories catering to kids through millennials with assortments curated for their specific lifestyle needs.The company operates a family of brands, including Abercrombie & Fitch, YPB, abercrombie kids, Hollister and Gilly Hicks, each sharing a commitment to offer products of enduring quality and exceptional comfort...
