Data Acquisition Engineer
13 hours ago
Louisville
Data Acquisition Engineer Fully Remote (U.S. only) | Full-time | $136,000 – $221,000 + performance bonus Job description: Data Acquisition Engineer Location: Fully Remote (U.S. Only) Compensation: $136,000 - $221,000 + Performance Bonus Job Type: Full-time About the Role We are seeking an exceptional Data Acquisition Engineer to architect, design, and build next-generation software systems for large-scale event-ticketing, dynamic pricing, and marketplace integrations. This is a high-impact technical leadership role ideal for a senior technologist who thrives on solving complex infrastructure challenges from the ground up. Developing proprietary tools, intelligent automation frameworks, and AI-driven decision systems that redefine efficiency across live-event commerce. You'll work closely with a Senior Backend Engineer powering the foundational tech stack and a product manager deeply experienced in the industry and lead cross-functional engineering efforts spanning data architecture, API frameworks, proxy and scraping infrastructure, and multi-layer user-interface systems serving tens of thousands of transactions daily. Key Responsibilities • Architect and develop custom end-to-end software platforms powering ticket-marketplace operations, pricing algorithms, and automation - including our NestJS/Fastify API, Bull/Redis job pipelines, and Temporal-orchestrated workflows., • Design and deploy scalable, cloud-native systems leveraging AWS (EC2, Lambda, API Gateway, S3, ECR, CloudFormation / Pulumi / Terraform), with services containerized in Docker and orchestrated via Kubernetes., • Develop high-performance front-end interfaces and dashboards using React (or similar modern frameworks) emphasizing UX responsiveness and maintainability., • Build and orchestrate proxy and scraping infrastructures capable of large-volume synchronization with intelligent throttling and resilience., • Integrate and deploy AI-enhanced modules (e.g., demand forecasting, pricing prediction, fraud detection) using Python, TensorFlow, or PyTorch., • Lead architecture reviews, enforce clean design principles, and mentor mid-level engineers in scalable code patterns and performance optimization., • Collaborate across product, BI, and infrastructure teams to translate operational bottlenecks into automation and data-driven opportunities., • Oversee security, compliance, and reliability for multi-tenant APIs, distributed services (AMQP messaging, MongoDB/Postgres data layers), and marketplace data handling., • Continuously improve CI/CD pipelines (GitHub Actions), testing frameworks, and DevOps reliability, with full observability via OpenTelemetry and Jaeger. Minimum Qualifications • 8+ years of professional software engineering experience with a record of shipping scalable, high-performance applications., • Bachelor's degree in Computer Science, Computer Engineering, or related discipline (Master's preferred)., • Proven expertise building and operating proxy and scraping infrastructure at scale - including proxy pools, headless browser automation, and cost-aware throttling., • Advanced proficiency in Node.js, TypeScript, and Python for backend systems and services (NestJS experience a strong plus)., • Experience with React for front-end systems and internal tools., • Proven expertise in AWS cloud architecture, containerization (Docker, Kubernetes / Swarm), and infrastructure-as-code., • Strong knowledge of NoSQL and relational databases (MongoDB, PostgreSQL, etc.) including schema design and performance tuning., • Deep understanding of RESTful API design, authentication, rate-limiting, and security best practices., • Demonstrated success integrating machine-learning models or AI frameworks into production environments., • Excellent debugging, problem-solving, and architectural design skills. Preferred Qualifications • Prior experience in event-ticketing, e-commerce, or real-time marketplace systems., • Microservice and message-driven architecture experience (RabbitMQ / AMQP)., • Experience with workflow orchestration tools such as Temporal, Airflow, or AWS Step Functions., • Advanced knowledge of AWS security, monitoring, and cost optimization., • Familiarity with distributed tracing and observability tooling (OpenTelemetry, Jaeger)., • Publications, patents, or open-source contributions showing innovation and leadership., • Familiarity with AI-assisted automation, proxy orchestration, or multi-layer data visualization frameworks. In a Typical Day, You Will • Architect APIs, pipelines, and internal tools for real-time marketplace operations., • Collaborate with product and infrastructure teams to deploy intelligent automation systems., • Lead technical design reviews and ensure modular, maintainable codebases., • Optimize and deploy AI-powered models for operational forecasting and decisioning., • Maintain and monitor performance of high-throughput distributed systems (NestJS services, Redis/Bull queues, Temporal-orchestrated workflows, and AMQP-based messaging) running on Docker and Kubernetes. Interview Process Candidates will be invited to: • Present a portfolio or GitHub repository showcasing architectural or AI-driven projects., • Complete a technical case study demonstrating system design and optimization., • Participate in a live technical interview focused on API integration, cloud architecture, and advanced coding practices. Why Join Us • Competitive salary + bonus, • Opportunity to shape the future of event-ticketing automation and global marketplace intelligence., • Work alongside the future of elite engineers solving complex, high-volume challenges at scale., • High autonomy in a fast-moving, data-driven environment that rewards innovation and execution. Benefits: • Flexible schedule, • Health insurance, • Paid time off, • Weekly DoorDash Meals