Senior Data Engineer in USA

We are currently looking for Data Engineers to facilitate integrations between lab instruments and downstream machine-learning pipelines

Location:

Quantori is an international team: we have colleagues who work not only from office but also remotely from all over the world.

Responsibilities:

  • Developing software solutions to integrate lab data acquisition instruments with machine learning pipelines. 
  • Building data systems and pipelines  
  • Preparing data for prescriptive and predictive modeling  
  • Designing end-to-end pipelines within a hybrid big data architecture using Cloud Native AWS, Python, GO, etc.  
  • Managing and integrating data across different database systems (Postgres, SQLite) and networked storage systems (SMB, NFS).  
  • Utilizing cloud technologies such as AWS SNS and SQS for event notification, S3 for object storage, EC2 for virtual machines, and VPC for networking.  
  • Liaising with clients/customers to develop and deliver production-ready solutions.  
  • Utilizing ticketing systems like Jira, ServiceNow, and GitHub/GitLab Issues for project tracking and management. 
 

What we expect:

  • Profound knowledge and hands-on experience with Python, GO, Spark, Databricks, DWH (Postgres, SQLite), and networked storage systems (SMB, NFS)  
  • Experience working in laboratories or with life sciences clients  
  • Familiarity with lab instrumentation and typical lab data formats (XML, json)
  • Experience with databases (Postgres, SQLite) and networked storage systems (SMB, NFS)  
  • Expertise with AWS services essential for Data Engineering: AWS Glue, AWS 
  • Experience deploying solutions on cloud platforms such as AWS SNS, SQS, S3, EC2, and VPC.
  • Adept and diligent in working with ticketing systems such as Jira, ServiceNow, and GitHub/GitLab Issues. 
  • Experience with version control systems (git), CI/CD pipelines (GitHub/GitLab), and Configuration-as-Code tools (Terraform, Ansible).  
  • Strong security mindset with in-depth knowledge in authentication, encryption, least privilege, and defense.  
  • Strong upper-intermediate or higher (B2+) proficiency in English  
  • Solid analytical and problem-solving skills  
  • Availability across the San Francisco Bay Area, California,USA; PST availability is required 
  • Frequent visits up to 3-4 times a week to the client's office

Nice to have:

  • Ability to expedite processes in a complex and dynamic environment. 
  • Strong interpersonal skills to maintain good relationships with customers/clients. 
  • Agile and adaptable to iteratively deliver solutions in response to changing business needs. 
 

We offer:

  • Competitive compensation 
  • Remote work
  • Flexible working hours 
  • A team with an excellent tech expertise
  • one year contract with possible extension based on project needs and performance 
 
This field is required
This field is required
The maximum number of characters is 500

PDF / DOC / DOCX / RTF / Max 10 Mb

If you don't see an open position that suits your skills stack and/or professional background but you are interested in working with us — please send your CV to career@quantori.com. We will try to find something special and interesting for you!
Back to open job positions