Sr. Backend Software Data Engineer - Java/Python Apache Spark

Profile

*We are open to remote work anywhere in North America*

As an Engineer on Lookout’s Data Engineering team, you will be working on a platform that processes hundreds of millions of security events daily. You will support real-time analysis in the Lookout Security Cloud, as well as

ad hoc

analysis by researchers and analysts hunting for new mobile threats. Your datasets will directly support product features such as data dashboards and threat detection. We’re looking for engineers who understand both data and infrastructure, and are enthusiastic about working on both.

Do you have good software development skills with Python and Java or Scala? Do you have experience with frameworks such as Apache Spark or Kafka?

Then you could be Lookout's next Sr. Backend Software Data Engineer with ability to work remotely.

Responsibilities:

Design, build & maintain reliable systems for storing, transforming, and analyzing large amounts of data using Apache Spark, Apache Airflow, and related technologies

Manage infrastructure for batch and streaming data processing and data storage, including maintaining CI/CD tooling, system patching and upgrades, monitoring, and performance analysis

Work with analysts and engineers across the company to meet quality and timeliness goals for data products

Requirements:

B.S. in Computer Science or related experience

5 years experience designing, implementing, and maintaining complex software systems

Programming experience in Python, Scala, and/or Java

Experience with Big Data processing systems such as Spark, Kafka, Airflow, and Storm

Cloud experience with AWS, GCP, or Azure

Experience with agile software development, code reviews, git, and task management through tools like Jira.

Desired Skills:

Experience with ETL workflow & scheduling systems such as Airflow and/or Luigi

Knowledge of configuration management & deployment using tools such as Ansible, Chef, Puppet or Spinnaker.

About Lookout:

Lookout is an integrated endpoint-to-cloud security company. Our mission is to secure and empower our digital future in a privacy-focused world where mobility and cloud are essential to all we do for work and play. We enable consumers and employees to protect their data, and to securely stay connected without violating their privacy and trust. Lookout is trusted by millions of consumers, the largest enterprises and government agencies, and partners such as AT&T, Verizon, Vodafone, Microsoft, Google, and Apple. Headquartered in San Francisco, Lookout has offices in Amsterdam, Boston, Bangalore, London, Sydney, Tokyo, Toronto and Washington, D.C.

#LI-NS1

Company info

Lookout, Inc.
Website : https://www.lookout.com