Cloud Storage Technical Lead
The project team focuses on development of scalable file storage solutions for cloud based High Performance Computing (HPC) platforms. The ideal candidate will have a strong background in both traditional parallel filesystems and modern cloud-native storage solutions such as S3, ElastiCache and File Cache. You should also have extensive experience with AWS, infrastructure as code, CI/CD pipelines. As a Cloud Storage Technical Lead, you will play a crucial role in designing, building, and maintaining the robust, scalable and secure storage infrastructure for life sciences R&D. Time zone: Expected availability according to full PST time zone coverage
Location:
Quantori is an international team: we have colleagues who work not only from office but also remotely from all over the world.
Responsibilities:
- Design, implement, and maintain scalable and high performance file storage environments on AWS.
- Develop and manage infrastructure as code using tools such as Terraform and Ansible.
- Automate deployment pipelines and improve CI/CD processes using GitLab CI/CD.
- Collaborate with cross-functional teams to understand the computational needs of scientists andtranslate them into effective platform solutions.
- Monitor and optimize platform performance, ensuring reliability and scalability.
- Troubleshoot and resolve issues related to infrastructure, deployment, and applicationperformance.
- Provide technical guidance and mentorship to junior team members.
- Identify and advance collaboration opportunities with other product teams, such as integrationwith existing data movement and data catalog solutions.
What we expect:
- AWS: Deep understanding of AWS services and best practices for building scalable, secure, and cost-effective cloud environments.
- DevOps: Proven experience with DevOps practices, including infrastructure as code (Terraform, Ansible), continuous integration, and continuous deployment (GitLab CI/CD).
- IAM: Prior experience integrating storage with common identity and access management solutions such as Active Directory and IAM Identity Center.
- Version Control: Proficiency with Git and experience managing code repositories.
- Expert level proficiency with POSIX file system semantics.
- Proficiency with POSIX I/O profiling for high performance / high throughput workloads
- Expert level proficiency in at least one high performance / parallel filesystem technology such asWeka, Lustre, GPFS, CEPH or JuiceFS.
- High proficiency with Amazon S3 object storage.
- High proficiency with Network File System (NFS) semantics and solutions.
- Knowledge of security best practices in cloud environments and experience implementing them.
- Excellent communicator, ability to clearly share architecture plans, designs, risks, andimplementation with a variety of stakeholders
- Experience: 7+ years working in engineering, solution architecture, or DevOps, with a track record of successfully delivering complex projects.
- Problem Solving: Strong analytical and problem-solving skills, with the ability to troubleshoot complex issues in distributed systems.
- Team Player: Ability to work effectively in a collaborative team environment, as well as independently when required.
Nice to have:
- Prior experience with AWS managed services for file storage, such as EFS, FSx for Lustre, or FSx for OpenZFS.
- Prior experience with at least one POSIX interface solution for S3 object storage, such as S3 Mountpoint, CunoFS, or goofys.
- Prior experience with cloud data caching solutions such as Amazon ElastiCache or Amazon File Cache.
We offer:
- Long-term (up to a year) contract with possible extension based on project needs and performance
- Competitive compensation
- Flexible working hours
- A team with an excellent tech expertise
If you don't see an open position that suits your skills stack and/or professional background but you are interested in working with us — please send your CV to career@quantori.com. We will try to find something special and interesting for you!