Data Operations Engineer

Blue Grid is working on a cyber security research project which relies on collecting intelligence from many sources in “threat actor space.” This data collection includes terabytes of data dumps that are shared and trafficked in the underground, as well as hundreds of dark web forums, markets for stolen goods, and ransomware sites. The Text Collection (TC) team builds the data collection and analytics that transform this mass of raw data into structured intelligence information that our customers use to defend their people and networks. You will be responsible for data collection and operational data engineering on data dumps and “malware logs” from infected computers.

Job Description:

• Collecting raw data from the threat actor environment on a daily basis
• Supervising automatic processing of this structured raw data. Investigating and resolving data processing problems. Fixing and improving our data processing code so it will automatically handle similar data scenarios.
• Processing and indexing “snowflake” data dumps. Assess the security value of data in a dump file, assess the technical format (SQL dump, structured text data), decide how to process the data to extract the key security information, and execute on the tasks of processing and indexing.

Requirements:

• Very flexible and outcome-oriented. Comfortable in a work environment where urgent issues arise often, and where quickly resolving issues has immediate security value for our end customers
• General knowledge of cybersecurity (or more) and interest in working “upstream” close to the threat actors who are compromising computers/networks
• 3+ years experience in software engineering using Python:
• You’ve worked in a professional software engineering environment that involves thorough code testing and review processes
• Strong problem-solving capabilities and experience troubleshooting data issues within your own processes and those of your peers.
• Fluent in English, written and spoken
• Experience with MongoDB, ElasticSearch, and AWS cloud services is highly desirable

Nice To Have:

• Knowledge of Russian, reading and writing in a basic technical setting

What we offer

• Take Ownership
• In BlueGrid.io, we nurture a culture of accountability and taking ownership over our responsibilities. We are focused and care about the outcome. Act with integrity and own it!
• Learning is the King
• Knowledge, passion and sharing our skills is highly valued. We learn from our mistakes and strive towards daily improvements of ourselves and motivate others in our team to do the same.
• Hold my Beer!
• We love fire starters! To be truly great you need to take risks and we encourage our team to take the initiative to go the extra mile. Our culture is rich with individuals who are not afraid to think and work outside-the-box.
• Catch the Ball
• Every individual in BlueGrid.io is remarkable, but we are a team above all else. Catch the ball if it’s going in your direction, but don’t forget to help out a teammate if he’ll miss his. Oh, and yea — we don’t play with assholes.
• Don’t Forget to Play
• All work and no play make our work dull. Playfulness and cherishing our inner child gives us all a little break, but it also promotes creativity and brings everyone together. And we can always find a way to celebrate.