Perplexity is seeking an AI Software Engineer - Data Platform to join their team in the Buffalo-Niagara Falls Area. The role involves building the next-gen AI Data Platform to revolutionize online search and interaction.
About the Role
As an AI Software Engineer - Data Platform, you will collaborate with AI Product, Applied ML, Post-Training, and Data Science teams to design, build, and maintain scalable data pipelines and data lakes. You will develop, deploy, and monitor the entire data lifecycle for ingestion, transformation, streaming, and storage at high scale. Additionally, you will implement tools and abstractions on top of data infrastructure for various analytics, recommendations, AI product, and post-training use cases, working closely with product and AI teams to develop reusable data resources and design patterns.
About You
Required:
Extensive programming and data engineering skills, with proficiency in open source & distributed data processing (AWS, Spark, Flink, Iceberg).
Familiarity with cloud-based data services (e.g., AWS, RDS, DynamoDB), containerized infrastructure (e.g., EKS, Docker), and data streaming (Flink, Spark streaming, CDC).
Strong quantitative and engineering skills with experience in estimating performance at high scale.
Experience supporting various ML/AI engineering teams to build scalable platforms to accelerate R&D for frontier models and AI products.
Self-motivated with a strong sense of ownership of systems and designs.
5+ years of industry experience in distributed systems or AI infrastructure.
Benefits
Comprehensive health, dental, and vision insurance for you and your dependents.
401(k) plan.
Equity may be part of the total compensation package.