Discover jobs
Job Search
data engineer
Title posted on indeed.com - Sr. Data Engineer
Posted on October 23, 2024 by Employer details Princeton IT Services
Job details
*Job Title: Sr Data Engineer* *Location:* Canada *Type:* Full-time *Responsibilities:* * Design, develop, and maintain scalable data and file ingestion frameworks. * Collaborate with cross-functional teams, analysts, and stakeholders to define data requirements and technical solutions. * Optimize data ingestion frameworks for performance and reliability. * Implement data governance and security best practices. * Troubleshoot data integrity and performance issues. * Conduct code reviews and enforce coding standards. * Mentor junior engineers and provide guidance on complex projects. * Participate in architectural and design discussions. * Work on process automation to mitigate data application issues. * Stay updated with the latest data engineering trends and technologies. *Requirements:* * 5-6 years of experience in data engineering with a focus on scalable data ingestion frameworks. * 3-4 years of hands-on experience with AWS services (Redshift, S3, DynamoDB, EMR serverless, Lambdas, Step Functions, etc.). * Proficiency in ETL development using Python, PySpark, and Big Data technologies (Hadoop, Spark). * Strong SQL skills and experience with RDBMS (PostgreSQL, Redshift, MySQL, etc.). * In-depth knowledge of data warehousing concepts, data modeling, and ETL processes. * Excellent communication skills to explain complex technical concepts to non-technical stakeholders. * Experience working with Agile methodologies and Scrum processes. * Strong problem-solving skills with the ability to work independently and mentor junior developers. * 2-3 years of experience in the financial or other highly regulated industries. * Familiarity with JIRA, DevOps, and CI/CD best practices. * Experience with emerging technologies like AWS QuickSight, Amazon Co-Pilot, or similar tools. *Education:* * Bachelor?s Degree in Computer Science, Information Systems, Mathematics, Software Engineering, or a related field. Job Type: Full-time Pay: $90,000.00-$100,000.00 per year Experience: * Data engineering: 8 years (required) * AWS platform using, Redshift, S3, DynamoDB, Lambda: 6 years (required) * ETL development and data modelling: 4 years (required) * IT/ Finance industry: 3 years (required) * Jira: 3 years (required) * QuickSight, Co-Pilot: 1 year (preferred) * Devops and CI/ CD: 3 years (required)- LocationCalgary, AB
- Workplace information On site
- Salary$90,000 to $100,000YEAR annually
- Terms of employment Term or contractFull time
- Starts as soon as possible
- vacancies 1 vacancy
- Source indeed.com #9498583864
Important notice: This job posting has been provided by a partner site. Job Bank is not responsible for this content.
Report a problem with this job posting
- Date modified: