Airnow Hiring for AirnowData – Data Engineer (crawlers) Job at London, England Full Time

At Airnow, we’re on the path to creating the most complete and powerful mobile strategy platform, managing everything required to turn an app into a business. Our products are centred around distribution, tracking, performance, intelligence and monetisation. Our focus is to combine our services into a single platform to allow customers to maximise the advertising spend and improve the quality of our advertising inventory.

We are a globally distributed team of 70 staff, principally operating from US, UK, Hong Kong & Dubai, with all technical operations run from the UK where our London Headquarters are based.

Historically the company has had three core divisions, which we are integrating to form the single unified platform. These divisions are Media – our mobile ad Network and campaign solution; Data – for monitoring apps, benchmarking competitors and understanding market trends as well as ASO (App Store Optimisation) fundamentals; Cyber Security – to secure and protect our customers and their apps.

About Airnow Data Service

Airnow Data collects huge amounts of data about mobile apps and their usage and turns them into valuable metrics. Our customers range from app developers, investors, health care companies and startups. We love analysing data, building distributed systems, and helping people understand complicated market dynamics through our data.

Who we’re looking to hire

We’re looking for an experienced GCP/Data/Software Engineer. You’ll take ownership of our crawl pipeline, architecting and implementing new solutions, keeping them running with high uptime and scaling them up to handle load. Experience writing good software is a must as is experience with distributed systems and big data – we’re looking for someone with good intuition about what good architecture looks like.

Our Stack

Our crawl tech-stack is mostly Ruby running on GCP. We have a large distributed infrastructure, consisting of hundreds of systems ranging from scrapers, data processing clusters, database and API servers, etc.

Languages – Ruby, Python, Javascript, SQL, R

We write tests, practice peer code review, pair programming and continuous deployment on all our code and systems. We love blue-green deployments and anything immutable and we push very hard toward automation.