Data Engineer - Web Scraping

Overview

Neotech Solutions needs you to be a part of our highly motivated group of technology experts.

We share a passion for technology and the community we serve, and we are committed to building long-lasting, productive relationships. We focus on giving back to the community, positively impacting society, and providing quality solutions that work. We believe in autonomy, mastery and purpose and in trusting people to do the right thing - and we think Neotech Solutions is a pretty great place to be a part of.

Note: Please feel comfortable applying, even if you don't meet all the requirements for the position. We'll let you in on a secret: there's no such thing as a "perfect" candidate. Everyone can grow at Neotech Solutions. We strongly encourage members of underrepresented groups and people of diverse backgrounds to apply. Apply now if this is a role that would make you excited to come into work every day!

Core Responsibilities

• Create and improve processes, tools, workflows, and resilient data architecture to scrape web content.
• Manage data accuracy and quality.
• Identify and rectify any issues with breaks as well as scale scrapers as needed.
• Organisational Relationships
• This position reports to the Senior Director of Data Innovation.

Knowledge, Skills, and Abilities

• Web scraping experience (Scrapy or similar technologies)
• Solid understanding of web technologies (HTML, JavaScript, CSS, XPath, JSON, etc)
• Basic Linux and Git experience
• Python
• Scrapy Python library
• AWS/AWS Batch
• Familiarity with data processing tools (pandas, regex, SQL)

Credentials and Experience

• 2+ years Python experience, preferred
• Professional experience with web scraping preferred

We Offer

• Competitive compensation based on your skills
• Learning resources like Udemy, Saisoft, and internal development meetups
• An awesome culture with opportunities to meet like-minded people; whether you're into gaming, reading, hiking, or craft food and drink, there's a club for that.
• Philanthropic events to get involved in the community
• Flexible hours and paid time off