HPC Systems Engineer | Experienced Hire
Indexed description
What You'll Do
Automate and Evolve: Contribute to our library of home-grown tools, written primarily in Python and Bash, to automate monitoring, and maintenance, allowing you to focus on performance related issues and projects.
Collaborate: Work closely with Strategy Developers, Quantitative Researchers, and trade-supporting application teams to translate complex problems into scalable solutions. Coordinate with IT infrastructure teams, including storage and networking, to identify and implement the best solutions.
Optimize: Tune operating systems and batch workflows for performance. Dive deep on root-cause analysis of systems issues. Integrate all of these solutions into our systems effectively and efficiently.
Comprehensive HPC Environment Management: Oversee all aspects of our HPC environment, including the scheduler, parallel filesystems, GPUs, and interconnects.
High throughput storage: Implement and optimize high-performance storage solutions, including Lustre, VAST, and GPFS, to efficiently support and enhance cluster performance.
Capacity Planning and Design: Develop strategies to ensure optimal resource allocation and scalability, using analytics to forecast needs and design efficient, reliable systems.
Troubleshooting and Tuning: Utilize monitoring and diagnostic tools to quickly pinpoint failures, streamline troubleshooting processes, and ensure the timely recovery of disrupted workflows.
What We're Looking For
- A Bachelor’s degree in Engineering, Computer Science, Information Systems, or a related discipline.
- 5-7 years of progressive experience building Linux and/or Windows based HPC based platforms.
- Familiarity with kernel-level and I/O subsystem tweaks and tools such as sysctl, strace, tcpdump, and netstat. Bonus points for equivalent Windows knowledge (registry, procmon, wireshark, tshark).
- Recent hands-on experience with automation in Python or other tools.
- Experience administering Lustre, GPFS, VAST, or other parallel filesystems.
- Understanding of resource schedulers like HTCondor, SLURM, or similar.
If you're a recruiting agency and want to partner with us, please reach out to [email protected]. Any resume or referral submitted in the absence of a signed agreement will not be eligible for an agency fee.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search